Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20251025 08:02:21.371119 14616 test_util.cc:276] Using random seed: 368379617
2025-10-25T08:02:21Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2025-10-25T08:02:21Z Disabled control of system clock
I20251025 08:02:21.385351 14616 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
/tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.70.62:39499
--webserver_interface=127.14.70.62
--webserver_port=0
--builtin_ntp_servers=127.14.70.20:37905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20251025 08:02:21.479333 14624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251025 08:02:21.479503 14624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251025 08:02:21.479553 14624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251025 08:02:21.482563 14624 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251025 08:02:21.482602 14624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251025 08:02:21.482620 14624 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251025 08:02:21.482635 14624 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251025 08:02:21.485842 14624 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.70.20:37905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.70.62:39499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.70.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.14624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d0cb013a5aad754f2ed06c25f5ec3d8a1873622
build type DEBUG
built by None at 25 Oct 2025 07:43:14 UTC on 24a791456cd2
build id 8706
I20251025 08:02:21.486704 14624 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251025 08:02:21.487622 14624 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251025 08:02:21.492730 14630 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251025 08:02:21.492738 14629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:21.492901 14624 server_base.cc:1047] running on GCE node
W20251025 08:02:21.492763 14632 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:21.493482 14624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251025 08:02:21.494330 14624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251025 08:02:21.495468 14624 hybrid_clock.cc:648] HybridClock initialized: now 1761379341495457 us; error 30 us; skew 500 ppm
I20251025 08:02:21.496901 14624 webserver.cc:492] Webserver started at http://127.14.70.62:44847/ using document root <none> and password file <none>
I20251025 08:02:21.497422 14624 fs_manager.cc:362] Metadata directory not provided
I20251025 08:02:21.497483 14624 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251025 08:02:21.497642 14624 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251025 08:02:21.499105 14624 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data/instance:
uuid: "94a96657c5fd49398b88e9ad615bfe1e"
format_stamp: "Formatted at 2025-10-25 08:02:21 on dist-test-slave-2g2p"
I20251025 08:02:21.499526 14624 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/wal/instance:
uuid: "94a96657c5fd49398b88e9ad615bfe1e"
format_stamp: "Formatted at 2025-10-25 08:02:21 on dist-test-slave-2g2p"
I20251025 08:02:21.502475 14624 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251025 08:02:21.504459 14638 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251025 08:02:21.505295 14624 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:21.505391 14624 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data,/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/wal
uuid: "94a96657c5fd49398b88e9ad615bfe1e"
format_stamp: "Formatted at 2025-10-25 08:02:21 on dist-test-slave-2g2p"
I20251025 08:02:21.505461 14624 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251025 08:02:21.538484 14624 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251025 08:02:21.539048 14624 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251025 08:02:21.539201 14624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251025 08:02:21.545878 14624 rpc_server.cc:307] RPC server started. Bound to: 127.14.70.62:39499
I20251025 08:02:21.545878 14690 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.70.62:39499 every 8 connection(s)
I20251025 08:02:21.546799 14624 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data/info.pb
I20251025 08:02:21.550125 14691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:21.550256 14616 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu as pid 14624
I20251025 08:02:21.550365 14616 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/wal/instance
I20251025 08:02:21.551534 14616 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
/tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.70.61:44347
--webserver_interface=127.14.70.61
--webserver_port=0
--builtin_ntp_servers=127.14.70.20:37905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20251025 08:02:21.553393 14691 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } has no permanent_uuid. Determining permanent_uuid...
I20251025 08:02:21.565248 14691 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } has no permanent_uuid. Determining permanent_uuid...
W20251025 08:02:21.565833 14640 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.70.61:44347: connect: Connection refused (error 111)
W20251025 08:02:21.566648 14691 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.70.61:44347: Network error: Client connection negotiation failed: client connection to 127.14.70.61:44347: connect: Connection refused (error 111)
I20251025 08:02:21.615839 14691 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } attempt: 1
W20251025 08:02:21.617144 14691 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.70.61:44347: Network error: Client connection negotiation failed: client connection to 127.14.70.61:44347: connect: Connection refused (error 111)
W20251025 08:02:21.648962 14693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251025 08:02:21.649120 14693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251025 08:02:21.649154 14693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251025 08:02:21.651968 14693 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251025 08:02:21.652007 14693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251025 08:02:21.652024 14693 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251025 08:02:21.652056 14693 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251025 08:02:21.655373 14693 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.70.20:37905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.70.61:44347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.70.61
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.14693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d0cb013a5aad754f2ed06c25f5ec3d8a1873622
build type DEBUG
built by None at 25 Oct 2025 07:43:14 UTC on 24a791456cd2
build id 8706
I20251025 08:02:21.656226 14693 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251025 08:02:21.657178 14693 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251025 08:02:21.661836 14704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251025 08:02:21.661842 14701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251025 08:02:21.661839 14702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:21.661935 14693 server_base.cc:1047] running on GCE node
I20251025 08:02:21.662597 14693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251025 08:02:21.663511 14693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251025 08:02:21.664666 14693 hybrid_clock.cc:648] HybridClock initialized: now 1761379341664654 us; error 30 us; skew 500 ppm
I20251025 08:02:21.666131 14693 webserver.cc:492] Webserver started at http://127.14.70.61:41597/ using document root <none> and password file <none>
I20251025 08:02:21.666620 14693 fs_manager.cc:362] Metadata directory not provided
I20251025 08:02:21.666678 14693 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251025 08:02:21.666831 14693 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251025 08:02:21.668128 14693 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data/instance:
uuid: "33b7e3c702ec44079d8b76a0ce6bae97"
format_stamp: "Formatted at 2025-10-25 08:02:21 on dist-test-slave-2g2p"
I20251025 08:02:21.668538 14693 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/wal/instance:
uuid: "33b7e3c702ec44079d8b76a0ce6bae97"
format_stamp: "Formatted at 2025-10-25 08:02:21 on dist-test-slave-2g2p"
I20251025 08:02:21.671507 14693 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20251025 08:02:21.673409 14710 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251025 08:02:21.674253 14693 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20251025 08:02:21.674345 14693 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data,/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/wal
uuid: "33b7e3c702ec44079d8b76a0ce6bae97"
format_stamp: "Formatted at 2025-10-25 08:02:21 on dist-test-slave-2g2p"
I20251025 08:02:21.674418 14693 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251025 08:02:21.685318 14691 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } attempt: 2
W20251025 08:02:21.686583 14691 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.70.61:44347: Network error: Client connection negotiation failed: client connection to 127.14.70.61:44347: connect: Connection refused (error 111)
I20251025 08:02:21.687517 14693 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251025 08:02:21.688014 14693 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251025 08:02:21.688239 14693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251025 08:02:21.694269 14762 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.70.61:44347 every 8 connection(s)
I20251025 08:02:21.694267 14693 rpc_server.cc:307] RPC server started. Bound to: 127.14.70.61:44347
I20251025 08:02:21.695114 14693 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data/info.pb
I20251025 08:02:21.696062 14616 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu as pid 14693
I20251025 08:02:21.696141 14616 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/wal/instance
I20251025 08:02:21.696676 14616 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
/tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.70.60:34453
--webserver_interface=127.14.70.60
--webserver_port=0
--builtin_ntp_servers=127.14.70.20:37905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20251025 08:02:21.697624 14763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:21.700785 14763 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } has no permanent_uuid. Determining permanent_uuid...
I20251025 08:02:21.708164 14763 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } has no permanent_uuid. Determining permanent_uuid...
I20251025 08:02:21.713224 14763 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } has no permanent_uuid. Determining permanent_uuid...
W20251025 08:02:21.713802 14714 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.70.60:34453: connect: Connection refused (error 111)
W20251025 08:02:21.714478 14763 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.70.60:34453: Network error: Client connection negotiation failed: client connection to 127.14.70.60:34453: connect: Connection refused (error 111)
I20251025 08:02:21.763775 14763 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } attempt: 1
W20251025 08:02:21.764912 14763 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.70.60:34453: Network error: Client connection negotiation failed: client connection to 127.14.70.60:34453: connect: Connection refused (error 111)
I20251025 08:02:21.777732 14691 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } attempt: 3
I20251025 08:02:21.781526 14691 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } has no permanent_uuid. Determining permanent_uuid...
W20251025 08:02:21.782648 14691 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.70.60:34453: Network error: Client connection negotiation failed: client connection to 127.14.70.60:34453: connect: Connection refused (error 111)
W20251025 08:02:21.792088 14765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251025 08:02:21.792263 14765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251025 08:02:21.792337 14765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251025 08:02:21.795342 14765 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251025 08:02:21.795392 14765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251025 08:02:21.795423 14765 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251025 08:02:21.795465 14765 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251025 08:02:21.798844 14765 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.70.20:37905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.70.60:34453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.70.60
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.14765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d0cb013a5aad754f2ed06c25f5ec3d8a1873622
build type DEBUG
built by None at 25 Oct 2025 07:43:14 UTC on 24a791456cd2
build id 8706
I20251025 08:02:21.799772 14765 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251025 08:02:21.800794 14765 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251025 08:02:21.805461 14773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251025 08:02:21.805567 14774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:21.805619 14765 server_base.cc:1047] running on GCE node
W20251025 08:02:21.805454 14776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:21.806031 14765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251025 08:02:21.806808 14765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251025 08:02:21.807936 14765 hybrid_clock.cc:648] HybridClock initialized: now 1761379341807916 us; error 36 us; skew 500 ppm
I20251025 08:02:21.809425 14765 webserver.cc:492] Webserver started at http://127.14.70.60:39233/ using document root <none> and password file <none>
I20251025 08:02:21.809911 14765 fs_manager.cc:362] Metadata directory not provided
I20251025 08:02:21.809984 14765 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251025 08:02:21.810173 14765 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251025 08:02:21.811544 14765 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data/instance:
uuid: "7109d31951574de3bf05a86c94c11d21"
format_stamp: "Formatted at 2025-10-25 08:02:21 on dist-test-slave-2g2p"
I20251025 08:02:21.811954 14765 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/wal/instance:
uuid: "7109d31951574de3bf05a86c94c11d21"
format_stamp: "Formatted at 2025-10-25 08:02:21 on dist-test-slave-2g2p"
I20251025 08:02:21.813796 14691 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } attempt: 1
W20251025 08:02:21.814906 14691 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.70.60:34453: Network error: Client connection negotiation failed: client connection to 127.14.70.60:34453: connect: Connection refused (error 111)
I20251025 08:02:21.815268 14765 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20251025 08:02:21.817159 14782 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251025 08:02:21.818012 14765 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:21.818099 14765 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data,/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/wal
uuid: "7109d31951574de3bf05a86c94c11d21"
format_stamp: "Formatted at 2025-10-25 08:02:21 on dist-test-slave-2g2p"
I20251025 08:02:21.818207 14765 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251025 08:02:21.833058 14763 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } attempt: 2
W20251025 08:02:21.834043 14763 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.14.70.60:34453: Network error: Client connection negotiation failed: client connection to 127.14.70.60:34453: connect: Connection refused (error 111)
I20251025 08:02:21.835964 14765 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251025 08:02:21.836434 14765 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251025 08:02:21.836565 14765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251025 08:02:21.842486 14765 rpc_server.cc:307] RPC server started. Bound to: 127.14.70.60:34453
I20251025 08:02:21.842491 14834 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.70.60:34453 every 8 connection(s)
I20251025 08:02:21.843304 14765 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data/info.pb
I20251025 08:02:21.845582 14835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:21.848544 14835 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } has no permanent_uuid. Determining permanent_uuid...
I20251025 08:02:21.851109 14616 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu as pid 14765
I20251025 08:02:21.851194 14616 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/wal/instance
I20251025 08:02:21.855906 14835 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } has no permanent_uuid. Determining permanent_uuid...
I20251025 08:02:21.859301 14835 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } has no permanent_uuid. Determining permanent_uuid...
I20251025 08:02:21.866161 14835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21: Bootstrap starting.
I20251025 08:02:21.867934 14835 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:21.868546 14835 log.cc:826] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21: Log is configured to *not* fsync() on all Append() calls
I20251025 08:02:21.869804 14835 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21: No bootstrap required, opened a new log
I20251025 08:02:21.872409 14835 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:21.872534 14835 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:21.872571 14835 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7109d31951574de3bf05a86c94c11d21, State: Initialized, Role: FOLLOWER
I20251025 08:02:21.872856 14835 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:21.873171 14844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:21.873263 14844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:21.873659 14835 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: configured and running, proceeding with master startup.
W20251025 08:02:21.877216 14855 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251025 08:02:21.877281 14855 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251025 08:02:21.876276 14765 master_runner.cc:186] Error getting master registration for 127.14.70.62:39499: OK, instance_id { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" instance_seqno: 1761379341543846 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20251025 08:02:21.878168 14765 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251025 08:02:21.890079 14691 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } attempt: 2
I20251025 08:02:21.895318 14691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Bootstrap starting.
I20251025 08:02:21.897612 14691 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:21.898357 14691 log.cc:826] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Log is configured to *not* fsync() on all Append() calls
I20251025 08:02:21.899974 14691 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: No bootstrap required, opened a new log
I20251025 08:02:21.903110 14691 raft_consensus.cc:359] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:21.903261 14691 raft_consensus.cc:385] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:21.903312 14691 raft_consensus.cc:740] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a96657c5fd49398b88e9ad615bfe1e, State: Initialized, Role: FOLLOWER
I20251025 08:02:21.903689 14691 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:21.904131 14858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:21.904306 14858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:21.904731 14691 sys_catalog.cc:565] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: configured and running, proceeding with master startup.
W20251025 08:02:21.909165 14869 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251025 08:02:21.909274 14869 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251025 08:02:21.908957 14624 master_runner.cc:186] Error getting master registration for 127.14.70.61:44347: OK, instance_id { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" instance_seqno: 1761379341692695 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20251025 08:02:21.910706 14624 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251025 08:02:21.925216 14763 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } attempt: 3
I20251025 08:02:21.931476 14763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Bootstrap starting.
I20251025 08:02:21.933735 14763 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:21.934489 14763 log.cc:826] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Log is configured to *not* fsync() on all Append() calls
I20251025 08:02:21.936053 14763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: No bootstrap required, opened a new log
I20251025 08:02:21.939224 14763 raft_consensus.cc:359] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:21.939378 14763 raft_consensus.cc:385] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:21.939451 14763 raft_consensus.cc:740] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33b7e3c702ec44079d8b76a0ce6bae97, State: Initialized, Role: FOLLOWER
I20251025 08:02:21.939850 14763 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:21.940339 14872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:21.940495 14872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:21.940954 14763 sys_catalog.cc:565] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: configured and running, proceeding with master startup.
W20251025 08:02:21.945351 14883 catalog_manager.cc:1568] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20251025 08:02:21.945475 14883 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20251025 08:02:21.948045 14693 master_runner.cc:263] No leader master found from master 33b7e3c702ec44079d8b76a0ce6bae97
I20251025 08:02:21.948100 14693 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20251025 08:02:22.040410 14644 tablet.cc:2378] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20251025 08:02:22.087484 14788 tablet.cc:2378] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251025 08:02:22.094017 14844 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:22.094153 14844 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:22.095014 14844 leader_election.cc:290] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94a96657c5fd49398b88e9ad615bfe1e (127.14.70.62:39499), 33b7e3c702ec44079d8b76a0ce6bae97 (127.14.70.61:44347)
I20251025 08:02:22.095487 14737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7109d31951574de3bf05a86c94c11d21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" is_pre_election: true
I20251025 08:02:22.095491 14665 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7109d31951574de3bf05a86c94c11d21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a96657c5fd49398b88e9ad615bfe1e" is_pre_election: true
I20251025 08:02:22.095716 14737 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7109d31951574de3bf05a86c94c11d21 in term 0.
I20251025 08:02:22.095716 14665 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7109d31951574de3bf05a86c94c11d21 in term 0.
I20251025 08:02:22.096087 14784 leader_election.cc:304] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7109d31951574de3bf05a86c94c11d21, 94a96657c5fd49398b88e9ad615bfe1e; no voters:
I20251025 08:02:22.096331 14844 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:22.096400 14844 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:22.096437 14844 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:22.097244 14844 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:22.097517 14844 leader_election.cc:290] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [CANDIDATE]: Term 1 election: Requested vote from peers 94a96657c5fd49398b88e9ad615bfe1e (127.14.70.62:39499), 33b7e3c702ec44079d8b76a0ce6bae97 (127.14.70.61:44347)
I20251025 08:02:22.097882 14665 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7109d31951574de3bf05a86c94c11d21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94a96657c5fd49398b88e9ad615bfe1e"
I20251025 08:02:22.097892 14737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7109d31951574de3bf05a86c94c11d21" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "33b7e3c702ec44079d8b76a0ce6bae97"
I20251025 08:02:22.097991 14665 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:22.098002 14737 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:22.098977 14737 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7109d31951574de3bf05a86c94c11d21 in term 1.
I20251025 08:02:22.098970 14665 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7109d31951574de3bf05a86c94c11d21 in term 1.
I20251025 08:02:22.099259 14784 leader_election.cc:304] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7109d31951574de3bf05a86c94c11d21, 94a96657c5fd49398b88e9ad615bfe1e; no voters:
I20251025 08:02:22.099442 14844 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:22.099645 14844 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 1 LEADER]: Becoming Leader. State: Replica: 7109d31951574de3bf05a86c94c11d21, State: Running, Role: LEADER
I20251025 08:02:22.099936 14844 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:22.101802 14885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7109d31951574de3bf05a86c94c11d21. Latest consensus state: current_term: 1 leader_uuid: "7109d31951574de3bf05a86c94c11d21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:22.101903 14885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: This master's current role is: LEADER
I20251025 08:02:22.102309 14887 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251025 08:02:22.103135 14887 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251025 08:02:22.107435 14665 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 1 FOLLOWER]: Refusing update from remote peer 7109d31951574de3bf05a86c94c11d21: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:22.107426 14737 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 1 FOLLOWER]: Refusing update from remote peer 7109d31951574de3bf05a86c94c11d21: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:22.107973 14844 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:22.108315 14885 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [LEADER]: Connected to new peer: Peer: permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:22.111536 14858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7109d31951574de3bf05a86c94c11d21. Latest consensus state: current_term: 1 leader_uuid: "7109d31951574de3bf05a86c94c11d21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:22.111657 14858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:22.111810 14872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7109d31951574de3bf05a86c94c11d21. Latest consensus state: current_term: 1 leader_uuid: "7109d31951574de3bf05a86c94c11d21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:22.111900 14872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:22.113634 14885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7109d31951574de3bf05a86c94c11d21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:22.113721 14885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: This master's current role is: LEADER
I20251025 08:02:22.114123 14888 mvcc.cc:204] Tried to move back new op lower bound from 7214609785266196480 to 7214609785243897856. Current Snapshot: MvccSnapshot[applied={T|T < 7214609785266196480}]
I20251025 08:02:22.115039 14872 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7109d31951574de3bf05a86c94c11d21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:22.115129 14872 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:22.115572 14890 mvcc.cc:204] Tried to move back new op lower bound from 7214609785266196480 to 7214609785243897856. Current Snapshot: MvccSnapshot[applied={T|T < 7214609785266196480}]
I20251025 08:02:22.117702 14844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7109d31951574de3bf05a86c94c11d21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:22.117790 14844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: This master's current role is: LEADER
I20251025 08:02:22.118702 14858 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7109d31951574de3bf05a86c94c11d21" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:22.118796 14858 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:22.119132 14889 mvcc.cc:204] Tried to move back new op lower bound from 7214609785266196480 to 7214609785243897856. Current Snapshot: MvccSnapshot[applied={T|T < 7214609785266196480}]
I20251025 08:02:22.119870 14887 catalog_manager.cc:1357] Generated new cluster ID: f2d8b893da824042af3b8623826039ce
I20251025 08:02:22.119920 14887 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251025 08:02:22.139119 14887 catalog_manager.cc:1380] Generated new certificate authority record
I20251025 08:02:22.140293 14887 catalog_manager.cc:1514] Loading token signing keys...
I20251025 08:02:22.149736 14887 catalog_manager.cc:6022] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21: Generated new TSK 0
I20251025 08:02:22.150524 14887 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251025 08:02:22.154151 14616 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
/tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.70.1:0
--local_ip_for_outbound_sockets=127.14.70.1
--webserver_interface=127.14.70.1
--webserver_port=0
--tserver_master_addrs=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--builtin_ntp_servers=127.14.70.20:37905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20251025 08:02:22.250068 14897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251025 08:02:22.250286 14897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251025 08:02:22.250357 14897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251025 08:02:22.253293 14897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251025 08:02:22.253386 14897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.70.1
I20251025 08:02:22.256739 14897 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.70.20:37905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.70.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.14.70.1
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--never_fsync=true
--heap_profile_path=/tmp/kudu.14897
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.70.1
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 1d0cb013a5aad754f2ed06c25f5ec3d8a1873622
build type DEBUG
built by None at 25 Oct 2025 07:43:14 UTC on 24a791456cd2
build id 8706
I20251025 08:02:22.257539 14897 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251025 08:02:22.258487 14897 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251025 08:02:22.263978 14902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251025 08:02:22.264045 14903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251025 08:02:22.263976 14905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:22.264204 14897 server_base.cc:1047] running on GCE node
I20251025 08:02:22.264511 14897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251025 08:02:22.264948 14897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251025 08:02:22.266081 14897 hybrid_clock.cc:648] HybridClock initialized: now 1761379342266071 us; error 32 us; skew 500 ppm
I20251025 08:02:22.267551 14897 webserver.cc:492] Webserver started at http://127.14.70.1:39697/ using document root <none> and password file <none>
I20251025 08:02:22.268015 14897 fs_manager.cc:362] Metadata directory not provided
I20251025 08:02:22.268072 14897 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251025 08:02:22.268229 14897 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251025 08:02:22.269521 14897 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/data/instance:
uuid: "ab02c9d78a9d42f193755d436c8d44b2"
format_stamp: "Formatted at 2025-10-25 08:02:22 on dist-test-slave-2g2p"
I20251025 08:02:22.269935 14897 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/instance:
uuid: "ab02c9d78a9d42f193755d436c8d44b2"
format_stamp: "Formatted at 2025-10-25 08:02:22 on dist-test-slave-2g2p"
I20251025 08:02:22.272859 14897 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:22.274667 14911 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251025 08:02:22.275589 14897 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:22.275668 14897 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/data,/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal
uuid: "ab02c9d78a9d42f193755d436c8d44b2"
format_stamp: "Formatted at 2025-10-25 08:02:22 on dist-test-slave-2g2p"
I20251025 08:02:22.275728 14897 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251025 08:02:22.292724 14897 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251025 08:02:22.293174 14897 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251025 08:02:22.293301 14897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251025 08:02:22.293697 14897 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251025 08:02:22.294538 14897 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251025 08:02:22.294582 14897 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251025 08:02:22.294616 14897 ts_tablet_manager.cc:616] Registered 0 tablets
I20251025 08:02:22.294637 14897 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251025 08:02:22.302691 14897 rpc_server.cc:307] RPC server started. Bound to: 127.14.70.1:35401
I20251025 08:02:22.302749 15024 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.70.1:35401 every 8 connection(s)
I20251025 08:02:22.303474 14897 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/data/info.pb
I20251025 08:02:22.309134 14616 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu as pid 14897
I20251025 08:02:22.309252 14616 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/instance
I20251025 08:02:22.312022 14616 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
/tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.70.2:0
--local_ip_for_outbound_sockets=127.14.70.2
--webserver_interface=127.14.70.2
--webserver_port=0
--tserver_master_addrs=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--builtin_ntp_servers=127.14.70.20:37905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20251025 08:02:22.312723 15026 heartbeater.cc:344] Connected to a master server at 127.14.70.62:39499
I20251025 08:02:22.312755 15025 heartbeater.cc:344] Connected to a master server at 127.14.70.60:34453
I20251025 08:02:22.312913 15025 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:22.312913 15026 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:22.313474 15025 heartbeater.cc:507] Master 127.14.70.60:34453 requested a full tablet report, sending...
I20251025 08:02:22.313474 15026 heartbeater.cc:507] Master 127.14.70.62:39499 requested a full tablet report, sending...
I20251025 08:02:22.313817 15027 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:22.313889 15027 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:22.314050 15027 heartbeater.cc:507] Master 127.14.70.61:44347 requested a full tablet report, sending...
I20251025 08:02:22.314903 14799 ts_manager.cc:194] Registered new tserver with Master: ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:22.314903 14727 ts_manager.cc:194] Registered new tserver with Master: ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:22.314904 14655 ts_manager.cc:194] Registered new tserver with Master: ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:22.316108 14799 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.14.70.1:41829
W20251025 08:02:22.406919 15032 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251025 08:02:22.407111 15032 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251025 08:02:22.407178 15032 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251025 08:02:22.410099 15032 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251025 08:02:22.410255 15032 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.70.2
I20251025 08:02:22.413380 15032 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.70.20:37905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.70.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.14.70.2
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--never_fsync=true
--heap_profile_path=/tmp/kudu.15032
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.70.2
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 1d0cb013a5aad754f2ed06c25f5ec3d8a1873622
build type DEBUG
built by None at 25 Oct 2025 07:43:14 UTC on 24a791456cd2
build id 8706
I20251025 08:02:22.414263 15032 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251025 08:02:22.415153 15032 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251025 08:02:22.420513 15037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251025 08:02:22.420598 15038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251025 08:02:22.420573 15040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:22.420723 15032 server_base.cc:1047] running on GCE node
I20251025 08:02:22.421034 15032 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251025 08:02:22.421501 15032 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251025 08:02:22.422636 15032 hybrid_clock.cc:648] HybridClock initialized: now 1761379342422621 us; error 32 us; skew 500 ppm
I20251025 08:02:22.424067 15032 webserver.cc:492] Webserver started at http://127.14.70.2:34933/ using document root <none> and password file <none>
I20251025 08:02:22.424525 15032 fs_manager.cc:362] Metadata directory not provided
I20251025 08:02:22.424580 15032 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251025 08:02:22.424731 15032 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251025 08:02:22.426003 15032 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/data/instance:
uuid: "e51a2be794f04642b89386067ecbc77e"
format_stamp: "Formatted at 2025-10-25 08:02:22 on dist-test-slave-2g2p"
I20251025 08:02:22.426421 15032 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/instance:
uuid: "e51a2be794f04642b89386067ecbc77e"
format_stamp: "Formatted at 2025-10-25 08:02:22 on dist-test-slave-2g2p"
I20251025 08:02:22.429353 15032 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:22.431190 15046 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251025 08:02:22.432039 15032 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:22.432130 15032 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/data,/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal
uuid: "e51a2be794f04642b89386067ecbc77e"
format_stamp: "Formatted at 2025-10-25 08:02:22 on dist-test-slave-2g2p"
I20251025 08:02:22.432202 15032 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251025 08:02:22.449014 15032 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251025 08:02:22.449482 15032 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251025 08:02:22.449618 15032 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251025 08:02:22.450054 15032 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251025 08:02:22.450879 15032 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251025 08:02:22.450924 15032 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251025 08:02:22.450973 15032 ts_tablet_manager.cc:616] Registered 0 tablets
I20251025 08:02:22.451010 15032 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251025 08:02:22.458514 15032 rpc_server.cc:307] RPC server started. Bound to: 127.14.70.2:37455
I20251025 08:02:22.458563 15159 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.70.2:37455 every 8 connection(s)
I20251025 08:02:22.459262 15032 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/data/info.pb
I20251025 08:02:22.467206 15160 heartbeater.cc:344] Connected to a master server at 127.14.70.60:34453
I20251025 08:02:22.467209 15162 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:22.467278 15161 heartbeater.cc:344] Connected to a master server at 127.14.70.62:39499
I20251025 08:02:22.467397 14616 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu as pid 15032
I20251025 08:02:22.467419 15161 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:22.467422 15160 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:22.467419 15162 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:22.467481 14616 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/instance
I20251025 08:02:22.467939 15160 heartbeater.cc:507] Master 127.14.70.60:34453 requested a full tablet report, sending...
I20251025 08:02:22.467928 15161 heartbeater.cc:507] Master 127.14.70.62:39499 requested a full tablet report, sending...
I20251025 08:02:22.468837 14798 ts_manager.cc:194] Registered new tserver with Master: e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:22.467928 15162 heartbeater.cc:507] Master 127.14.70.61:44347 requested a full tablet report, sending...
I20251025 08:02:22.469264 14655 ts_manager.cc:194] Registered new tserver with Master: e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:22.469400 14727 ts_manager.cc:194] Registered new tserver with Master: e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:22.469482 14798 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.14.70.2:36507
I20251025 08:02:22.469753 14616 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
/tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.14.70.3:0
--local_ip_for_outbound_sockets=127.14.70.3
--webserver_interface=127.14.70.3
--webserver_port=0
--tserver_master_addrs=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--builtin_ntp_servers=127.14.70.20:37905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20251025 08:02:22.562110 15167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251025 08:02:22.562304 15167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251025 08:02:22.562347 15167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251025 08:02:22.565342 15167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251025 08:02:22.565459 15167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.14.70.3
I20251025 08:02:22.568635 15167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.70.20:37905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.14.70.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.14.70.3
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--never_fsync=true
--heap_profile_path=/tmp/kudu.15167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.14.70.3
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 1d0cb013a5aad754f2ed06c25f5ec3d8a1873622
build type DEBUG
built by None at 25 Oct 2025 07:43:14 UTC on 24a791456cd2
build id 8706
I20251025 08:02:22.569432 15167 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251025 08:02:22.570361 15167 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20251025 08:02:22.575977 15175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251025 08:02:22.575997 15173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251025 08:02:22.575977 15172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:22.576220 15167 server_base.cc:1047] running on GCE node
I20251025 08:02:22.576540 15167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251025 08:02:22.576946 15167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251025 08:02:22.578083 15167 hybrid_clock.cc:648] HybridClock initialized: now 1761379342578064 us; error 30 us; skew 500 ppm
I20251025 08:02:22.579597 15167 webserver.cc:492] Webserver started at http://127.14.70.3:46181/ using document root <none> and password file <none>
I20251025 08:02:22.580097 15167 fs_manager.cc:362] Metadata directory not provided
I20251025 08:02:22.580148 15167 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251025 08:02:22.580318 15167 server_base.cc:895] This appears to be a new deployment of Kudu; creating new FS layout
I20251025 08:02:22.581641 15167 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/data/instance:
uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
format_stamp: "Formatted at 2025-10-25 08:02:22 on dist-test-slave-2g2p"
I20251025 08:02:22.582058 15167 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/instance:
uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
format_stamp: "Formatted at 2025-10-25 08:02:22 on dist-test-slave-2g2p"
I20251025 08:02:22.584918 15167 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s
I20251025 08:02:22.587083 15181 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251025 08:02:22.587900 15167 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20251025 08:02:22.588003 15167 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/data,/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal
uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
format_stamp: "Formatted at 2025-10-25 08:02:22 on dist-test-slave-2g2p"
I20251025 08:02:22.588075 15167 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251025 08:02:22.615566 15167 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251025 08:02:22.616034 15167 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251025 08:02:22.616173 15167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251025 08:02:22.616626 15167 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20251025 08:02:22.617452 15167 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20251025 08:02:22.617499 15167 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20251025 08:02:22.617563 15167 ts_tablet_manager.cc:616] Registered 0 tablets
I20251025 08:02:22.617590 15167 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20251025 08:02:22.625756 15167 rpc_server.cc:307] RPC server started. Bound to: 127.14.70.3:45447
I20251025 08:02:22.625819 15294 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.70.3:45447 every 8 connection(s)
I20251025 08:02:22.626607 15167 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/data/info.pb
I20251025 08:02:22.634440 14616 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu as pid 15167
I20251025 08:02:22.634546 14616 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/instance
I20251025 08:02:22.635427 15296 heartbeater.cc:344] Connected to a master server at 127.14.70.62:39499
I20251025 08:02:22.635542 15297 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:22.635620 15296 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:22.635622 15297 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:22.636086 15297 heartbeater.cc:507] Master 127.14.70.61:44347 requested a full tablet report, sending...
I20251025 08:02:22.636086 15296 heartbeater.cc:507] Master 127.14.70.62:39499 requested a full tablet report, sending...
I20251025 08:02:22.636605 15295 heartbeater.cc:344] Connected to a master server at 127.14.70.60:34453
I20251025 08:02:22.636672 15295 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:22.636832 15295 heartbeater.cc:507] Master 127.14.70.60:34453 requested a full tablet report, sending...
I20251025 08:02:22.637022 14655 ts_manager.cc:194] Registered new tserver with Master: f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:22.637053 14727 ts_manager.cc:194] Registered new tserver with Master: f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:22.637377 14799 ts_manager.cc:194] Registered new tserver with Master: f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:22.638015 14799 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.14.70.3:41607
I20251025 08:02:22.640465 14616 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
I20251025 08:02:22.652634 14616 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu with pid 14765
W20251025 08:02:22.659686 15305 connection.cc:537] client connection to 127.14.70.60:34453 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251025 08:02:22.660099 15305 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.14.70.60:34453)
I20251025 08:02:22.817711 15025 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
W20251025 08:02:22.818445 15025 heartbeater.cc:646] Failed to heartbeat to 127.14.70.60:34453 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.70.60:34453: connect: Connection refused (error 111)
I20251025 08:02:22.910501 14869 catalog_manager.cc:1269] Loaded cluster ID: f2d8b893da824042af3b8623826039ce
I20251025 08:02:22.910568 14869 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: loading cluster ID for follower catalog manager: success
I20251025 08:02:22.912626 14869 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: acquiring CA information for follower catalog manager: success
I20251025 08:02:22.913756 14869 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251025 08:02:22.946576 14883 catalog_manager.cc:1269] Loaded cluster ID: f2d8b893da824042af3b8623826039ce
I20251025 08:02:22.946643 14883 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: loading cluster ID for follower catalog manager: success
I20251025 08:02:22.948177 14883 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: acquiring CA information for follower catalog manager: success
I20251025 08:02:22.949234 14883 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251025 08:02:22.970939 15160 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
W20251025 08:02:22.971668 15160 heartbeater.cc:646] Failed to heartbeat to 127.14.70.60:34453 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.70.60:34453: connect: Connection refused (error 111)
I20251025 08:02:23.093396 15342 raft_consensus.cc:493] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7109d31951574de3bf05a86c94c11d21)
I20251025 08:02:23.093508 15342 raft_consensus.cc:515] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:23.094358 15342 leader_election.cc:290] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 94a96657c5fd49398b88e9ad615bfe1e (127.14.70.62:39499), 7109d31951574de3bf05a86c94c11d21 (127.14.70.60:34453)
I20251025 08:02:23.094661 14665 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "94a96657c5fd49398b88e9ad615bfe1e" is_pre_election: true
W20251025 08:02:23.095455 14714 leader_election.cc:336] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7109d31951574de3bf05a86c94c11d21 (127.14.70.60:34453): Network error: Client connection negotiation failed: client connection to 127.14.70.60:34453: connect: Connection refused (error 111)
I20251025 08:02:23.095532 14714 leader_election.cc:304] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 33b7e3c702ec44079d8b76a0ce6bae97; no voters: 7109d31951574de3bf05a86c94c11d21, 94a96657c5fd49398b88e9ad615bfe1e
I20251025 08:02:23.095677 15342 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251025 08:02:23.133669 15345 raft_consensus.cc:493] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7109d31951574de3bf05a86c94c11d21)
I20251025 08:02:23.133787 15345 raft_consensus.cc:515] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:23.134588 15345 leader_election.cc:290] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 33b7e3c702ec44079d8b76a0ce6bae97 (127.14.70.61:44347), 7109d31951574de3bf05a86c94c11d21 (127.14.70.60:34453)
I20251025 08:02:23.134953 14736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "94a96657c5fd49398b88e9ad615bfe1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" is_pre_election: true
I20251025 08:02:23.135098 14736 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a96657c5fd49398b88e9ad615bfe1e in term 1.
I20251025 08:02:23.135442 14640 leader_election.cc:304] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33b7e3c702ec44079d8b76a0ce6bae97, 94a96657c5fd49398b88e9ad615bfe1e; no voters:
I20251025 08:02:23.135672 15345 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251025 08:02:23.135736 15345 raft_consensus.cc:493] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7109d31951574de3bf05a86c94c11d21)
I20251025 08:02:23.135792 15345 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 1 FOLLOWER]: Advancing to term 2
W20251025 08:02:23.135766 14642 leader_election.cc:336] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7109d31951574de3bf05a86c94c11d21 (127.14.70.60:34453): Network error: Client connection negotiation failed: client connection to 127.14.70.60:34453: connect: Connection refused (error 111)
I20251025 08:02:23.136691 15345 raft_consensus.cc:515] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:23.137041 15345 leader_election.cc:290] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [CANDIDATE]: Term 2 election: Requested vote from peers 33b7e3c702ec44079d8b76a0ce6bae97 (127.14.70.61:44347), 7109d31951574de3bf05a86c94c11d21 (127.14.70.60:34453)
I20251025 08:02:23.137331 14736 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "94a96657c5fd49398b88e9ad615bfe1e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "33b7e3c702ec44079d8b76a0ce6bae97"
I20251025 08:02:23.137452 14736 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 1 FOLLOWER]: Advancing to term 2
W20251025 08:02:23.138037 14642 leader_election.cc:336] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7109d31951574de3bf05a86c94c11d21 (127.14.70.60:34453): Network error: Client connection negotiation failed: client connection to 127.14.70.60:34453: connect: Connection refused (error 111)
I20251025 08:02:23.138527 14736 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a96657c5fd49398b88e9ad615bfe1e in term 2.
I20251025 08:02:23.138849 14640 leader_election.cc:304] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33b7e3c702ec44079d8b76a0ce6bae97, 94a96657c5fd49398b88e9ad615bfe1e; no voters: 7109d31951574de3bf05a86c94c11d21
I20251025 08:02:23.139083 15345 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 2 FOLLOWER]: Leader election won for term 2
I20251025 08:02:23.139209 15345 raft_consensus.cc:697] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 2 LEADER]: Becoming Leader. State: Replica: 94a96657c5fd49398b88e9ad615bfe1e, State: Running, Role: LEADER
I20251025 08:02:23.139462 15345 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:23.139613 15295 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.140581 15348 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94a96657c5fd49398b88e9ad615bfe1e. Latest consensus state: current_term: 2 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
W20251025 08:02:23.140641 15295 heartbeater.cc:646] Failed to heartbeat to 127.14.70.60:34453 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.14.70.60:34453: connect: Connection refused (error 111)
I20251025 08:02:23.140663 15348 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: This master's current role is: LEADER
I20251025 08:02:23.140918 15350 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251025 08:02:23.141775 15350 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251025 08:02:23.142113 15350 catalog_manager.cc:1269] Loaded cluster ID: f2d8b893da824042af3b8623826039ce
I20251025 08:02:23.142156 15350 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251025 08:02:23.142642 15350 catalog_manager.cc:1514] Loading token signing keys...
I20251025 08:02:23.142980 15350 catalog_manager.cc:6033] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Loaded TSK: 0
I20251025 08:02:23.143668 15350 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251025 08:02:23.153820 14655 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_6fe17f710bf146d8b58856909d6e582d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.153939 14653 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_b9bf89f57b344006b4e0975c046107e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.154001 14652 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_65fb35408e534db5b401eb950a699116"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.153832 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_9d7b8d8d0cf249d0b9331dd7b98f13e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.154296 14651 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_6d0f32c1f7964a1b8f3791e4b9f711a2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.154413 14650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_a78b99091ef6453faad2811684b66741"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.154639 14649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_649c856ce9a143c09a86a397a710b4d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.155107 14651 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6d0f32c1f7964a1b8f3791e4b9f711a2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:23.155085 14655 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6fe17f710bf146d8b58856909d6e582d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.155236 14648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_c4ef3ad8b8904e06a91e4869ceb38294"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.155356 14652 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65fb35408e534db5b401eb950a699116 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:23.155524 14648 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4ef3ad8b8904e06a91e4869ceb38294 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:23.155620 14653 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9bf89f57b344006b4e0975c046107e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.155820 14647 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_a96480a36d5a4440958a186bc653879a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.155954 14650 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a78b99091ef6453faad2811684b66741 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:23.156105 14647 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a96480a36d5a4440958a186bc653879a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.155827 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_d5902255980d41f196ea71a6e6e27832"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.156404 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5902255980d41f196ea71a6e6e27832 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:23.155225 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d7b8d8d0cf249d0b9331dd7b98f13e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:23.155078 14649 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_649c856ce9a143c09a86a397a710b4d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.159303 14736 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 2 FOLLOWER]: Refusing update from remote peer 94a96657c5fd49398b88e9ad615bfe1e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 6. (index mismatch)
I20251025 08:02:23.159708 15348 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20251025 08:02:23.160189 14642 consensus_peers.cc:597] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e -> Peer 7109d31951574de3bf05a86c94c11d21 (127.14.70.60:34453): Couldn't send request to peer 7109d31951574de3bf05a86c94c11d21. Status: Network error: Client connection negotiation failed: client connection to 127.14.70.60:34453: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:23.161384 15342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94a96657c5fd49398b88e9ad615bfe1e. Latest consensus state: current_term: 2 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:23.161494 15342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:23.163039 15354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:23.163136 15354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: This master's current role is: LEADER
I20251025 08:02:23.164775 15342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:23.164880 15342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:23.165983 14655 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_65fb35408e534db5b401eb950a699116" } new_table_name: "default.Table_9fc00a365ab54475a7e7dab7aa68485a" modify_external_catalogs: true
I20251025 08:02:23.166469 14647 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_a96480a36d5a4440958a186bc653879a" } new_table_name: "default.Table_2e7bb7b759ef41acbc322deacbaa9c2f" modify_external_catalogs: true
I20251025 08:02:23.167111 14652 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_6fe17f710bf146d8b58856909d6e582d" } new_table_name: "default.Table_318ecfa0636a4258b6529554f15b63f3" modify_external_catalogs: true
I20251025 08:02:23.170375 14646 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_d5902255980d41f196ea71a6e6e27832" } new_table_name: "default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a" modify_external_catalogs: true
I20251025 08:02:23.170544 14650 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_b9bf89f57b344006b4e0975c046107e5" } modify_external_catalogs: true
I20251025 08:02:23.170632 14648 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_6d0f32c1f7964a1b8f3791e4b9f711a2" } modify_external_catalogs: true
I20251025 08:02:23.170706 14648 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_6d0f32c1f7964a1b8f3791e4b9f711a2" } modify_external_catalogs: true
I20251025 08:02:23.171252 14654 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_9d7b8d8d0cf249d0b9331dd7b98f13e8" } modify_external_catalogs: true
I20251025 08:02:23.171346 14654 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_9d7b8d8d0cf249d0b9331dd7b98f13e8" } modify_external_catalogs: true
I20251025 08:02:23.171628 14653 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_a78b99091ef6453faad2811684b66741" } modify_external_catalogs: true
I20251025 08:02:23.171715 14653 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_a78b99091ef6453faad2811684b66741" } modify_external_catalogs: true
I20251025 08:02:23.170718 14651 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_c4ef3ad8b8904e06a91e4869ceb38294" } new_table_name: "default.Table_8d5d70ca9382482e848e7111f5c93aa9" modify_external_catalogs: true
I20251025 08:02:23.170642 14650 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_b9bf89f57b344006b4e0975c046107e5" } modify_external_catalogs: true
W20251025 08:02:23.174343 14647 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 932a836af66e495fb57c742d3e91855a consensus state has no leader
W20251025 08:02:23.174654 14655 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a3ce2a5793554b09a44edbfa6c315eb1 consensus state has no leader
I20251025 08:02:23.175161 14649 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_649c856ce9a143c09a86a397a710b4d9" } modify_external_catalogs: true
I20251025 08:02:23.175256 14649 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_649c856ce9a143c09a86a397a710b4d9" } modify_external_catalogs: true
W20251025 08:02:23.176108 14652 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6d9fd3a6b2d41c5881248c0960c3ee7 has no consensus state
W20251025 08:02:23.179446 14646 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0653e41881de421f9d87e3030b9dbf26 has no consensus state
I20251025 08:02:23.183272 15094 tablet_service.cc:1505] Processing CreateTablet for tablet a3ce2a5793554b09a44edbfa6c315eb1 (DEFAULT_TABLE table=default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.183712 14648 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet 155ef1af89d84fc9a52799d1f523052a
I20251025 08:02:23.183960 14653 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet a8aa28467cee46a89d5dbaa760605543
I20251025 08:02:23.184092 14654 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet ff95468709fa419aa50e05edf69f8835
W20251025 08:02:23.184139 14651 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 634a93b40b7c49c799b711bf7ac36eb2 has no consensus state
I20251025 08:02:23.184253 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ce2a5793554b09a44edbfa6c315eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.184340 14650 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet 2ab08ba58d554d41a233b6a0ad880570
I20251025 08:02:23.184494 14649 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet 0835fbe5c2984ecf809dec1c6ce9e873
I20251025 08:02:23.186659 14959 tablet_service.cc:1505] Processing CreateTablet for tablet a3ce2a5793554b09a44edbfa6c315eb1 (DEFAULT_TABLE table=default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.187443 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ce2a5793554b09a44edbfa6c315eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.187580 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 932a836af66e495fb57c742d3e91855a (DEFAULT_TABLE table=default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.187800 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932a836af66e495fb57c742d3e91855a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.188820 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 932a836af66e495fb57c742d3e91855a (DEFAULT_TABLE table=default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.188827 15229 tablet_service.cc:1505] Processing CreateTablet for tablet a3ce2a5793554b09a44edbfa6c315eb1 (DEFAULT_TABLE table=default.Table_65fb35408e534db5b401eb950a699116 [id=5f9d1d9d2f904f94b00324cca656cb17]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.189520 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932a836af66e495fb57c742d3e91855a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.189800 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3ce2a5793554b09a44edbfa6c315eb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.190546 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 932a836af66e495fb57c742d3e91855a (DEFAULT_TABLE table=default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.190778 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932a836af66e495fb57c742d3e91855a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.194622 15369 tablet_bootstrap.cc:492] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.196570 15227 tablet_service.cc:1505] Processing CreateTablet for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (DEFAULT_TABLE table=default.Table_318ecfa0636a4258b6529554f15b63f3 [id=9af7f62b46de47af9bfae466af91660b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.196776 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d9fd3a6b2d41c5881248c0960c3ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.196794 15092 tablet_service.cc:1505] Processing CreateTablet for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (DEFAULT_TABLE table=default.Table_318ecfa0636a4258b6529554f15b63f3 [id=9af7f62b46de47af9bfae466af91660b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.197005 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d9fd3a6b2d41c5881248c0960c3ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.197048 15369 tablet_bootstrap.cc:654] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.197837 15369 log.cc:826] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2: Log is configured to *not* fsync() on all Append() calls
I20251025 08:02:23.198344 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 634a93b40b7c49c799b711bf7ac36eb2 (DEFAULT_TABLE table=default.Table_8d5d70ca9382482e848e7111f5c93aa9 [id=49b9829b389140a5b7f81f6fc6025cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.198563 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634a93b40b7c49c799b711bf7ac36eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.199337 15369 tablet_bootstrap.cc:492] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.199501 15369 ts_tablet_manager.cc:1403] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20251025 08:02:23.199512 15226 tablet_service.cc:1505] Processing CreateTablet for tablet 0653e41881de421f9d87e3030b9dbf26 (DEFAULT_TABLE table=default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.199719 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0653e41881de421f9d87e3030b9dbf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.200095 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 0653e41881de421f9d87e3030b9dbf26 (DEFAULT_TABLE table=default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.200265 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0653e41881de421f9d87e3030b9dbf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.201514 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 634a93b40b7c49c799b711bf7ac36eb2 (DEFAULT_TABLE table=default.Table_8d5d70ca9382482e848e7111f5c93aa9 [id=49b9829b389140a5b7f81f6fc6025cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.201714 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634a93b40b7c49c799b711bf7ac36eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.202077 14958 tablet_service.cc:1505] Processing CreateTablet for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (DEFAULT_TABLE table=default.Table_318ecfa0636a4258b6529554f15b63f3 [id=9af7f62b46de47af9bfae466af91660b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.202313 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d9fd3a6b2d41c5881248c0960c3ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.202389 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 0653e41881de421f9d87e3030b9dbf26 (DEFAULT_TABLE table=default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.202600 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0653e41881de421f9d87e3030b9dbf26. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.203162 15370 tablet_bootstrap.cc:492] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:23.204125 14642 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet a3ce2a5793554b09a44edbfa6c315eb1 (table default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet a3ce2a5793554b09a44edbfa6c315eb1 consensus state has no leader
I20251025 08:02:23.204465 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 634a93b40b7c49c799b711bf7ac36eb2 (DEFAULT_TABLE table=default.Table_8d5d70ca9382482e848e7111f5c93aa9 [id=49b9829b389140a5b7f81f6fc6025cd8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.204679 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 634a93b40b7c49c799b711bf7ac36eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.205163 15370 tablet_bootstrap.cc:654] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.205768 15370 log.cc:826] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e: Log is configured to *not* fsync() on all Append() calls
I20251025 08:02:23.206557 15369 raft_consensus.cc:359] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.206722 15369 raft_consensus.cc:385] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.206763 15369 raft_consensus.cc:740] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.207046 15370 tablet_bootstrap.cc:492] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.207206 15370 ts_tablet_manager.cc:1403] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20251025 08:02:23.207154 15369 consensus_queue.cc:260] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.207872 15369 ts_tablet_manager.cc:1434] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20251025 08:02:23.208102 15369 tablet_bootstrap.cc:492] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.209031 15369 tablet_bootstrap.cc:654] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.209765 15372 tablet_bootstrap.cc:492] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.210058 15369 tablet_bootstrap.cc:492] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.210153 15369 ts_tablet_manager.cc:1403] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:23.210661 15369 raft_consensus.cc:359] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.210784 15369 raft_consensus.cc:385] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.210839 15369 raft_consensus.cc:740] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.210829 15370 raft_consensus.cc:359] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.211011 15370 raft_consensus.cc:385] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.210963 15369 consensus_queue.cc:260] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.211066 15370 raft_consensus.cc:740] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.211287 15369 ts_tablet_manager.cc:1434] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.211315 14649 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet a3ce2a5793554b09a44edbfa6c315eb1 (table default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]). Expected version 1 got 0
I20251025 08:02:23.211500 15369 tablet_bootstrap.cc:492] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.211496 15370 consensus_queue.cc:260] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.211727 15372 tablet_bootstrap.cc:654] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.212177 15370 ts_tablet_manager.cc:1434] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20251025 08:02:23.212289 15369 tablet_bootstrap.cc:654] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.212630 15026 heartbeater.cc:499] Master 127.14.70.62:39499 was elected leader, sending a full tablet report...
I20251025 08:02:23.212661 15372 log.cc:826] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Log is configured to *not* fsync() on all Append() calls
I20251025 08:02:23.213866 15370 tablet_bootstrap.cc:492] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.214043 14649 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 932a836af66e495fb57c742d3e91855a (table default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935]). Expected version 1 got 0
I20251025 08:02:23.214140 14649 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 0653e41881de421f9d87e3030b9dbf26 (table default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]). Expected version 1 got 0
I20251025 08:02:23.214244 14649 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet a3ce2a5793554b09a44edbfa6c315eb1 (table default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]). Expected version 1 got 0
I20251025 08:02:23.214327 14649 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 634a93b40b7c49c799b711bf7ac36eb2 (table default.Table_8d5d70ca9382482e848e7111f5c93aa9 [id=49b9829b389140a5b7f81f6fc6025cd8]). Expected version 1 got 0
I20251025 08:02:23.214401 14649 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (table default.Table_318ecfa0636a4258b6529554f15b63f3 [id=9af7f62b46de47af9bfae466af91660b]). Expected version 1 got 0
I20251025 08:02:23.214820 15370 tablet_bootstrap.cc:654] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.215597 14649 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet a3ce2a5793554b09a44edbfa6c315eb1 (table default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]). Expected version 1 got 0
I20251025 08:02:23.215865 15369 tablet_bootstrap.cc:492] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.215965 15369 ts_tablet_manager.cc:1403] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:23.216431 15370 tablet_bootstrap.cc:492] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.216414 15369 raft_consensus.cc:359] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.216486 15369 raft_consensus.cc:385] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.216497 15370 ts_tablet_manager.cc:1403] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:23.216531 15369 raft_consensus.cc:740] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.216640 15369 consensus_queue.cc:260] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.216841 15369 ts_tablet_manager.cc:1434] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.216915 15370 raft_consensus.cc:359] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.217016 15370 raft_consensus.cc:385] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.217027 15369 tablet_bootstrap.cc:492] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.217056 15370 raft_consensus.cc:740] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.217159 15370 consensus_queue.cc:260] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.217485 15370 ts_tablet_manager.cc:1434] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.217644 15161 heartbeater.cc:499] Master 127.14.70.62:39499 was elected leader, sending a full tablet report...
I20251025 08:02:23.217973 15370 tablet_bootstrap.cc:492] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.218174 15369 tablet_bootstrap.cc:654] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.219135 15370 tablet_bootstrap.cc:654] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.219995 14650 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 932a836af66e495fb57c742d3e91855a (table default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935]). Expected version 1 got 0
I20251025 08:02:23.220095 14650 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 0653e41881de421f9d87e3030b9dbf26 (table default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]). Expected version 1 got 0
I20251025 08:02:23.220153 14650 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet a3ce2a5793554b09a44edbfa6c315eb1 (table default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]). Expected version 1 got 0
I20251025 08:02:23.220202 14650 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 634a93b40b7c49c799b711bf7ac36eb2 (table default.Table_8d5d70ca9382482e848e7111f5c93aa9 [id=49b9829b389140a5b7f81f6fc6025cd8]). Expected version 1 got 0
I20251025 08:02:23.220268 14650 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (table default.Table_318ecfa0636a4258b6529554f15b63f3 [id=9af7f62b46de47af9bfae466af91660b]). Expected version 1 got 0
I20251025 08:02:23.220978 14651 master_service.cc:954] ReplaceTablet: received request to replace tablet 932a836af66e495fb57c742d3e91855a from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.221383 15372 tablet_bootstrap.cc:492] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.221529 15372 ts_tablet_manager.cc:1403] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s
I20251025 08:02:23.221604 15370 tablet_bootstrap.cc:492] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.221859 15370 ts_tablet_manager.cc:1403] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:23.222297 15370 raft_consensus.cc:359] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.222389 15370 raft_consensus.cc:385] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.222422 15370 raft_consensus.cc:740] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.222528 15370 consensus_queue.cc:260] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.222752 15370 ts_tablet_manager.cc:1434] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.223245 15370 tablet_bootstrap.cc:492] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.224114 15370 tablet_bootstrap.cc:654] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.224476 15372 raft_consensus.cc:359] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.224682 15372 raft_consensus.cc:385] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.224751 15372 raft_consensus.cc:740] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.225263 15372 consensus_queue.cc:260] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.226059 15372 ts_tablet_manager.cc:1434] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
I20251025 08:02:23.226822 14651 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 932a836af66e495fb57c742d3e91855a
I20251025 08:02:23.227136 14651 catalog_manager.cc:6719] ReplaceTablet: tablet 932a836af66e495fb57c742d3e91855a deleted and replaced by tablet 5f9b311ee33a42d5a1c1d8b41576bb54
I20251025 08:02:23.227202 14654 master_service.cc:954] ReplaceTablet: received request to replace tablet 0653e41881de421f9d87e3030b9dbf26 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.227304 14653 master_service.cc:954] ReplaceTablet: received request to replace tablet a3ce2a5793554b09a44edbfa6c315eb1 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.228133 15372 tablet_bootstrap.cc:492] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.228135 14648 master_service.cc:954] ReplaceTablet: received request to replace tablet 0653e41881de421f9d87e3030b9dbf26 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.228500 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 932a836af66e495fb57c742d3e91855a with delete_type TABLET_DATA_DELETED (replaced by tablet 5f9b311ee33a42d5a1c1d8b41576bb54) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.228608 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 932a836af66e495fb57c742d3e91855a with delete_type TABLET_DATA_DELETED (replaced by tablet 5f9b311ee33a42d5a1c1d8b41576bb54) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.229034 15372 tablet_bootstrap.cc:654] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.229903 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 932a836af66e495fb57c742d3e91855a with delete_type TABLET_DATA_DELETED (replaced by tablet 5f9b311ee33a42d5a1c1d8b41576bb54) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.230533 14651 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (table default.Table_318ecfa0636a4258b6529554f15b63f3 [id=9af7f62b46de47af9bfae466af91660b]). Expected version 1 got 0
W20251025 08:02:23.230697 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 932a836af66e495fb57c742d3e91855a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 932a836af66e495fb57c742d3e91855a already in progress: creating tablet
I20251025 08:02:23.231009 14650 master_service.cc:954] ReplaceTablet: received request to replace tablet 932a836af66e495fb57c742d3e91855a from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.231213 14646 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (table default.Table_318ecfa0636a4258b6529554f15b63f3 [id=9af7f62b46de47af9bfae466af91660b]). Expected version 1 got 0
I20251025 08:02:23.231451 15372 tablet_bootstrap.cc:492] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.231528 15372 ts_tablet_manager.cc:1403] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:23.231840 14649 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (table default.Table_318ecfa0636a4258b6529554f15b63f3 [id=9af7f62b46de47af9bfae466af91660b]). Expected version 1 got 0
I20251025 08:02:23.232353 15369 tablet_bootstrap.cc:492] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.232429 15369 ts_tablet_manager.cc:1403] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251025 08:02:23.232497 15296 heartbeater.cc:499] Master 127.14.70.62:39499 was elected leader, sending a full tablet report...
I20251025 08:02:23.233355 14649 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (table default.Table_318ecfa0636a4258b6529554f15b63f3 [id=9af7f62b46de47af9bfae466af91660b]). Expected version 1 got 0
I20251025 08:02:23.233397 14654 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 0653e41881de421f9d87e3030b9dbf26
I20251025 08:02:23.233572 15372 raft_consensus.cc:359] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.233659 14654 catalog_manager.cc:6719] ReplaceTablet: tablet 0653e41881de421f9d87e3030b9dbf26 deleted and replaced by tablet af15eb3890ab43fb878d1c90ce58c4d9
I20251025 08:02:23.233656 15372 raft_consensus.cc:385] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.233695 15372 raft_consensus.cc:740] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.233986 15369 raft_consensus.cc:359] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.234092 15369 raft_consensus.cc:385] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.234051 15372 consensus_queue.cc:260] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.234123 15369 raft_consensus.cc:740] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.234274 15369 consensus_queue.cc:260] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.234326 15372 ts_tablet_manager.cc:1434] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:23.234470 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 0653e41881de421f9d87e3030b9dbf26 with delete_type TABLET_DATA_DELETED (replaced by tablet af15eb3890ab43fb878d1c90ce58c4d9) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.234516 15369 ts_tablet_manager.cc:1434] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.234536 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 0653e41881de421f9d87e3030b9dbf26 with delete_type TABLET_DATA_DELETED (replaced by tablet af15eb3890ab43fb878d1c90ce58c4d9) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.235944 15369 tablet_bootstrap.cc:492] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.235935 15372 tablet_bootstrap.cc:492] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.236652 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 0653e41881de421f9d87e3030b9dbf26 with delete_type TABLET_DATA_DELETED (replaced by tablet af15eb3890ab43fb878d1c90ce58c4d9) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.236876 15372 tablet_bootstrap.cc:654] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.236902 15369 tablet_bootstrap.cc:654] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.237739 14653 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet a3ce2a5793554b09a44edbfa6c315eb1
I20251025 08:02:23.237869 15370 tablet_bootstrap.cc:492] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.237941 15370 ts_tablet_manager.cc:1403] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:23.238015 14653 catalog_manager.cc:6719] ReplaceTablet: tablet a3ce2a5793554b09a44edbfa6c315eb1 deleted and replaced by tablet 5b4028f5238f4c428648893618587a37
I20251025 08:02:23.238397 15370 raft_consensus.cc:359] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.238487 15370 raft_consensus.cc:385] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.238538 15370 raft_consensus.cc:740] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.238495 15380 raft_consensus.cc:493] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.238649 15370 consensus_queue.cc:260] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.238713 15380 raft_consensus.cc:515] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.238911 15370 ts_tablet_manager.cc:1434] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.239046 15370 tablet_bootstrap.cc:492] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.239997 15370 tablet_bootstrap.cc:654] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.240366 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet a3ce2a5793554b09a44edbfa6c315eb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b4028f5238f4c428648893618587a37) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.240877 15386 tablet_replica.cc:333] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.240999 15369 tablet_bootstrap.cc:492] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.241062 15369 ts_tablet_manager.cc:1403] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:23.241151 15386 raft_consensus.cc:2243] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.241369 15386 raft_consensus.cc:2272] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.241524 15369 raft_consensus.cc:359] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.241611 15369 raft_consensus.cc:385] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.241691 15369 raft_consensus.cc:740] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.241796 15369 consensus_queue.cc:260] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.241977 15380 leader_election.cc:290] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:23.242027 15369 ts_tablet_manager.cc:1434] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.242254 15385 tablet_replica.cc:333] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.242484 15385 raft_consensus.cc:2243] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.243127 15370 tablet_bootstrap.cc:492] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.243192 15386 ts_tablet_manager.cc:1916] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.243188 15370 ts_tablet_manager.cc:1403] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:23.243434 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet a3ce2a5793554b09a44edbfa6c315eb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b4028f5238f4c428648893618587a37) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.243719 15370 raft_consensus.cc:359] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.243803 15370 raft_consensus.cc:385] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.243829 15370 raft_consensus.cc:740] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.243943 15370 consensus_queue.cc:260] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.244303 15370 ts_tablet_manager.cc:1434] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.245100 15385 raft_consensus.cc:2272] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.245592 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3ce2a5793554b09a44edbfa6c315eb1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:23.246088 15049 leader_election.cc:343] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.246990 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet a3ce2a5793554b09a44edbfa6c315eb1 with delete_type TABLET_DATA_DELETED (replaced by tablet 5b4028f5238f4c428648893618587a37) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.247089 15372 tablet_bootstrap.cc:492] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.247166 15372 ts_tablet_manager.cc:1403] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251025 08:02:23.247611 15372 raft_consensus.cc:359] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.247720 15372 raft_consensus.cc:385] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.247752 15372 raft_consensus.cc:740] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.247861 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3ce2a5793554b09a44edbfa6c315eb1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.247865 15372 consensus_queue.cc:260] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.248051 14979 raft_consensus.cc:2468] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:23.248083 15372 ts_tablet_manager.cc:1434] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.248412 15048 leader_election.cc:304] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:23.248762 15380 raft_consensus.cc:2804] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.248833 15380 raft_consensus.cc:493] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.248872 15380 raft_consensus.cc:3060] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.249444 15372 tablet_bootstrap.cc:492] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.249811 15380 raft_consensus.cc:515] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.250285 15380 leader_election.cc:290] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:23.250545 15372 tablet_bootstrap.cc:654] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.250684 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3ce2a5793554b09a44edbfa6c315eb1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:23.250779 14979 raft_consensus.cc:3060] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.250816 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 5f9b311ee33a42d5a1c1d8b41576bb54 (DEFAULT_TABLE table=default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.251024 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9b311ee33a42d5a1c1d8b41576bb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.251708 14979 raft_consensus.cc:2468] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:23.251704 15385 ts_tablet_manager.cc:1916] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.252063 15048 leader_election.cc:304] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:23.252206 15380 raft_consensus.cc:2804] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.252283 15380 raft_consensus.cc:697] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:23.252528 15380 consensus_queue.cc:237] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.253746 15370 tablet_bootstrap.cc:492] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.254490 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 5f9b311ee33a42d5a1c1d8b41576bb54 (DEFAULT_TABLE table=default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.254667 15370 tablet_bootstrap.cc:654] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.254730 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9b311ee33a42d5a1c1d8b41576bb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.254868 15388 tablet_replica.cc:333] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.255084 15388 raft_consensus.cc:2243] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.255259 15388 raft_consensus.cc:2272] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.255501 15386 ts_tablet_manager.cc:1929] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.255587 15386 log.cc:1199] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/0653e41881de421f9d87e3030b9dbf26
I20251025 08:02:23.255841 15386 ts_tablet_manager.cc:1950] T 0653e41881de421f9d87e3030b9dbf26 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.256302 15388 ts_tablet_manager.cc:1916] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.256443 15369 tablet_bootstrap.cc:492] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.256693 15386 tablet_replica.cc:333] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.256801 15386 raft_consensus.cc:2243] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.256906 15386 raft_consensus.cc:2272] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.254539 15385 ts_tablet_manager.cc:1929] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.257110 15385 log.cc:1199] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/932a836af66e495fb57c742d3e91855a
I20251025 08:02:23.257345 15385 ts_tablet_manager.cc:1950] T 932a836af66e495fb57c742d3e91855a P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.257418 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3ce2a5793554b09a44edbfa6c315eb1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:23.257460 15369 tablet_bootstrap.cc:654] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.257731 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 5f9b311ee33a42d5a1c1d8b41576bb54 (DEFAULT_TABLE table=default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.257937 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f9b311ee33a42d5a1c1d8b41576bb54. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.258293 15385 tablet_replica.cc:333] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.258401 15385 raft_consensus.cc:2243] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.258492 15385 raft_consensus.cc:2272] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.258771 15370 tablet_bootstrap.cc:492] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.258807 15386 ts_tablet_manager.cc:1916] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.258850 15370 ts_tablet_manager.cc:1403] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:23.259044 15388 ts_tablet_manager.cc:1929] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.259150 15388 log.cc:1199] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/932a836af66e495fb57c742d3e91855a
I20251025 08:02:23.259254 15370 raft_consensus.cc:359] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.259358 15370 raft_consensus.cc:385] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.259402 15370 raft_consensus.cc:740] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.259557 15388 ts_tablet_manager.cc:1950] T 932a836af66e495fb57c742d3e91855a P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.259510 15370 consensus_queue.cc:260] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.259838 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 0653e41881de421f9d87e3030b9dbf26 (table default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]) successfully deleted
I20251025 08:02:23.260080 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 932a836af66e495fb57c742d3e91855a (table default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935]) successfully deleted
I20251025 08:02:23.260579 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 932a836af66e495fb57c742d3e91855a (table default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935]) successfully deleted
I20251025 08:02:23.260773 15385 ts_tablet_manager.cc:1916] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.260826 15370 ts_tablet_manager.cc:1434] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.260793 15388 tablet_replica.cc:333] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.261003 15388 raft_consensus.cc:2243] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.261126 15388 raft_consensus.cc:2272] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.261523 15388 ts_tablet_manager.cc:1916] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:23.261803 15049 leader_election.cc:343] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.262607 15385 ts_tablet_manager.cc:1929] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.262666 15385 log.cc:1199] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/0653e41881de421f9d87e3030b9dbf26
I20251025 08:02:23.262895 15385 ts_tablet_manager.cc:1950] T 0653e41881de421f9d87e3030b9dbf26 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.263284 15388 ts_tablet_manager.cc:1929] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.263324 15385 tablet_replica.cc:333] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.263351 15388 log.cc:1199] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/0653e41881de421f9d87e3030b9dbf26
I20251025 08:02:23.263422 15385 raft_consensus.cc:2243] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.263509 15385 raft_consensus.cc:2272] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.263486 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 0653e41881de421f9d87e3030b9dbf26 (table default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]) successfully deleted
I20251025 08:02:23.263537 15388 ts_tablet_manager.cc:1950] T 0653e41881de421f9d87e3030b9dbf26 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.264016 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 0653e41881de421f9d87e3030b9dbf26 (table default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]) successfully deleted
I20251025 08:02:23.264068 15388 tablet_replica.cc:333] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.264150 15388 raft_consensus.cc:2243] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:23.264297 15372 tablet_bootstrap.cc:492] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.264333 15388 pending_rounds.cc:70] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:23.264370 15372 ts_tablet_manager.cc:1403] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251025 08:02:23.264413 15388 pending_rounds.cc:77] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609789964906496 op_type: NO_OP noop_request { }
I20251025 08:02:23.264496 15388 raft_consensus.cc:2889] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:23.264561 15388 raft_consensus.cc:2272] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.264786 15372 raft_consensus.cc:359] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.264869 15372 raft_consensus.cc:385] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.264899 15372 raft_consensus.cc:740] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.264889 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 5b4028f5238f4c428648893618587a37 (DEFAULT_TABLE table=default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.265022 15372 consensus_queue.cc:260] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.265089 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b4028f5238f4c428648893618587a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.265153 14653 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 634a93b40b7c49c799b711bf7ac36eb2 (table default.Table_8d5d70ca9382482e848e7111f5c93aa9 [id=49b9829b389140a5b7f81f6fc6025cd8]). Expected version 1 got 0
I20251025 08:02:23.265216 15090 tablet_service.cc:1505] Processing CreateTablet for tablet af15eb3890ab43fb878d1c90ce58c4d9 (DEFAULT_TABLE table=default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.265430 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af15eb3890ab43fb878d1c90ce58c4d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.265864 14646 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (table default.Table_318ecfa0636a4258b6529554f15b63f3 [id=9af7f62b46de47af9bfae466af91660b]). Expected version 1 got 0
I20251025 08:02:23.265939 14646 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 634a93b40b7c49c799b711bf7ac36eb2 (table default.Table_8d5d70ca9382482e848e7111f5c93aa9 [id=49b9829b389140a5b7f81f6fc6025cd8]). Expected version 1 got 0
I20251025 08:02:23.266266 15372 ts_tablet_manager.cc:1434] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.267042 15370 tablet_bootstrap.cc:492] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.267051 15372 tablet_bootstrap.cc:492] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.267141 14654 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 634a93b40b7c49c799b711bf7ac36eb2 (table default.Table_8d5d70ca9382482e848e7111f5c93aa9 [id=49b9829b389140a5b7f81f6fc6025cd8]). Expected version 1 got 0
I20251025 08:02:23.268011 15372 tablet_bootstrap.cc:654] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.268302 15370 tablet_bootstrap.cc:654] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.268376 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 0653e41881de421f9d87e3030b9dbf26 with delete_type TABLET_DATA_DELETED (replaced by tablet af15eb3890ab43fb878d1c90ce58c4d9) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.268621 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 5b4028f5238f4c428648893618587a37 (DEFAULT_TABLE table=default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.268743 15386 ts_tablet_manager.cc:1929] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.268621 14959 tablet_service.cc:1505] Processing CreateTablet for tablet af15eb3890ab43fb878d1c90ce58c4d9 (DEFAULT_TABLE table=default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.268819 15386 log.cc:1199] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/a3ce2a5793554b09a44edbfa6c315eb1
I20251025 08:02:23.268860 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b4028f5238f4c428648893618587a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.269014 15386 ts_tablet_manager.cc:1950] T a3ce2a5793554b09a44edbfa6c315eb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.269191 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af15eb3890ab43fb878d1c90ce58c4d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.269878 15385 ts_tablet_manager.cc:1916] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.269912 15369 tablet_bootstrap.cc:492] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.269989 15369 ts_tablet_manager.cc:1403] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20251025 08:02:23.270382 15369 raft_consensus.cc:359] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.270462 15369 raft_consensus.cc:385] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.270485 15369 raft_consensus.cc:740] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.270591 15369 consensus_queue.cc:260] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.270845 15369 ts_tablet_manager.cc:1434] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.271009 15369 tablet_bootstrap.cc:492] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.271591 15385 ts_tablet_manager.cc:1929] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.271644 15385 log.cc:1199] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/a3ce2a5793554b09a44edbfa6c315eb1
I20251025 08:02:23.271813 15385 ts_tablet_manager.cc:1950] T a3ce2a5793554b09a44edbfa6c315eb1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.271901 15369 tablet_bootstrap.cc:654] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.272074 14646 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 5f9b311ee33a42d5a1c1d8b41576bb54 (table default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935]). Expected version 1 got 0
W20251025 08:02:23.272329 14646 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet 5f9b311ee33a42d5a1c1d8b41576bb54 (table default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5f9b311ee33a42d5a1c1d8b41576bb54 consensus state has no leader
I20251025 08:02:23.272544 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet 0653e41881de421f9d87e3030b9dbf26 with delete_type TABLET_DATA_DELETED (replaced by tablet af15eb3890ab43fb878d1c90ce58c4d9) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.272673 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 932a836af66e495fb57c742d3e91855a with delete_type TABLET_DATA_DELETED (replaced by tablet 5f9b311ee33a42d5a1c1d8b41576bb54) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.272902 15226 tablet_service.cc:1505] Processing CreateTablet for tablet af15eb3890ab43fb878d1c90ce58c4d9 (DEFAULT_TABLE table=default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.273102 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af15eb3890ab43fb878d1c90ce58c4d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.273155 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet a3ce2a5793554b09a44edbfa6c315eb1 (table default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]) successfully deleted
I20251025 08:02:23.273304 15369 tablet_bootstrap.cc:492] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
W20251025 08:02:23.273296 14640 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 0653e41881de421f9d87e3030b9dbf26 because the tablet was not found. No further retry: Not found: Tablet not found: 0653e41881de421f9d87e3030b9dbf26
I20251025 08:02:23.273371 15369 ts_tablet_manager.cc:1403] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.273713 15386 tablet_replica.cc:333] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.273733 15369 raft_consensus.cc:359] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.273808 15369 raft_consensus.cc:385] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.273815 15386 raft_consensus.cc:2243] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.273852 15369 raft_consensus.cc:740] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.273897 15386 raft_consensus.cc:2272] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.273952 15369 consensus_queue.cc:260] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.274288 15386 ts_tablet_manager.cc:1916] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.274778 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet a3ce2a5793554b09a44edbfa6c315eb1 (table default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]) successfully deleted
I20251025 08:02:23.274855 15369 ts_tablet_manager.cc:1434] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20251025 08:02:23.274895 14641 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 0653e41881de421f9d87e3030b9dbf26 because the tablet was not found. No further retry: Not found: Tablet not found: 0653e41881de421f9d87e3030b9dbf26
I20251025 08:02:23.275013 15369 tablet_bootstrap.cc:492] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.275930 15369 tablet_bootstrap.cc:654] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.276175 14654 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 5f9b311ee33a42d5a1c1d8b41576bb54 (table default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935]). Expected version 1 got 0
I20251025 08:02:23.276552 15386 ts_tablet_manager.cc:1929] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.276608 15386 log.cc:1199] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/932a836af66e495fb57c742d3e91855a
I20251025 08:02:23.276785 15386 ts_tablet_manager.cc:1950] T 932a836af66e495fb57c742d3e91855a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.277163 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 5b4028f5238f4c428648893618587a37 (DEFAULT_TABLE table=default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.277370 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b4028f5238f4c428648893618587a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.277447 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 932a836af66e495fb57c742d3e91855a (table default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935]) successfully deleted
I20251025 08:02:23.277580 15369 tablet_bootstrap.cc:492] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.277637 15369 ts_tablet_manager.cc:1403] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:23.277961 14654 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 5b4028f5238f4c428648893618587a37 (table default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]). Expected version 1 got 0
I20251025 08:02:23.277987 15369 raft_consensus.cc:359] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.278055 15369 raft_consensus.cc:385] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.278081 15369 raft_consensus.cc:740] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.278235 15369 consensus_queue.cc:260] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.278534 15369 ts_tablet_manager.cc:1434] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.279085 15388 ts_tablet_manager.cc:1916] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:23.278324 14654 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet 5b4028f5238f4c428648893618587a37 (table default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 5b4028f5238f4c428648893618587a37 consensus state has no leader
I20251025 08:02:23.280385 14654 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet af15eb3890ab43fb878d1c90ce58c4d9 (table default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]). Expected version 1 got 0
W20251025 08:02:23.280615 14654 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet af15eb3890ab43fb878d1c90ce58c4d9 (table default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet af15eb3890ab43fb878d1c90ce58c4d9 consensus state has no leader
I20251025 08:02:23.280786 15388 ts_tablet_manager.cc:1929] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:23.280853 15388 log.cc:1199] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/a3ce2a5793554b09a44edbfa6c315eb1
I20251025 08:02:23.281087 15388 ts_tablet_manager.cc:1950] T a3ce2a5793554b09a44edbfa6c315eb1 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.281631 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet a3ce2a5793554b09a44edbfa6c315eb1 (table default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]) successfully deleted
I20251025 08:02:23.281975 15372 tablet_bootstrap.cc:492] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.282053 15372 ts_tablet_manager.cc:1403] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:23.282141 15370 tablet_bootstrap.cc:492] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.282267 15370 ts_tablet_manager.cc:1403] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251025 08:02:23.282478 15372 raft_consensus.cc:359] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.282557 15372 raft_consensus.cc:385] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.282590 15372 raft_consensus.cc:740] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.282616 15370 raft_consensus.cc:359] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.282723 15370 raft_consensus.cc:385] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.282722 15372 consensus_queue.cc:260] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.282763 15370 raft_consensus.cc:740] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.282881 15370 consensus_queue.cc:260] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.282927 15372 ts_tablet_manager.cc:1434] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.283063 15372 tablet_bootstrap.cc:492] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.283915 15372 tablet_bootstrap.cc:654] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.284260 15380 raft_consensus.cc:493] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.284325 14654 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 634a93b40b7c49c799b711bf7ac36eb2 (table default.Table_8d5d70ca9382482e848e7111f5c93aa9 [id=49b9829b389140a5b7f81f6fc6025cd8]). Expected version 1 got 0
I20251025 08:02:23.284332 15380 raft_consensus.cc:515] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.284607 15380 leader_election.cc:290] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.284873 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6d9fd3a6b2d41c5881248c0960c3ee7" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.284969 14979 raft_consensus.cc:2468] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:23.285209 14646 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 5b4028f5238f4c428648893618587a37 (table default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]). Expected version 1 got 0
I20251025 08:02:23.285316 15048 leader_election.cc:304] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:23.285611 15380 raft_consensus.cc:2804] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.285667 15380 raft_consensus.cc:493] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.285666 15372 tablet_bootstrap.cc:492] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.285725 15380 raft_consensus.cc:3060] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.285755 15372 ts_tablet_manager.cc:1403] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:23.285804 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6d9fd3a6b2d41c5881248c0960c3ee7" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.285985 15249 raft_consensus.cc:2468] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:23.286170 15372 raft_consensus.cc:359] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.286317 15372 raft_consensus.cc:385] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.286355 15372 raft_consensus.cc:740] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.286466 15372 consensus_queue.cc:260] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.286586 15380 raft_consensus.cc:515] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.286708 15372 ts_tablet_manager.cc:1434] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.286841 15372 tablet_bootstrap.cc:492] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.286911 15380 leader_election.cc:290] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.287408 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6d9fd3a6b2d41c5881248c0960c3ee7" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:23.287506 14979 raft_consensus.cc:3060] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.287676 15372 tablet_bootstrap.cc:654] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.288029 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6d9fd3a6b2d41c5881248c0960c3ee7" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:23.288131 15249 raft_consensus.cc:3060] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.288339 14654 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 5f9b311ee33a42d5a1c1d8b41576bb54 (table default.Table_2e7bb7b759ef41acbc322deacbaa9c2f [id=394a1e6daa8f42f4a69517cb60a9a935]). Expected version 1 got 0
I20251025 08:02:23.288707 14979 raft_consensus.cc:2468] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:23.288959 15048 leader_election.cc:304] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:23.289072 15372 tablet_bootstrap.cc:492] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.289111 15249 raft_consensus.cc:2468] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:23.289129 15380 raft_consensus.cc:2804] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.289165 15372 ts_tablet_manager.cc:1403] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.289209 15380 raft_consensus.cc:697] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:23.289322 15380 consensus_queue.cc:237] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.289582 15372 raft_consensus.cc:359] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.289671 15372 raft_consensus.cc:385] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.289707 15372 raft_consensus.cc:740] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.289816 15372 consensus_queue.cc:260] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.290069 15372 ts_tablet_manager.cc:1434] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.290270 15372 tablet_bootstrap.cc:492] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.291056 15370 ts_tablet_manager.cc:1434] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s
I20251025 08:02:23.291247 15370 tablet_bootstrap.cc:492] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.291293 15372 tablet_bootstrap.cc:654] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.292322 14654 catalog_manager.cc:5649] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:23.292776 14654 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (table default.Table_318ecfa0636a4258b6529554f15b63f3 [id=9af7f62b46de47af9bfae466af91660b]). Expected version 1 got 0
I20251025 08:02:23.292968 15372 tablet_bootstrap.cc:492] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.293035 15372 ts_tablet_manager.cc:1403] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:23.293138 14646 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet af15eb3890ab43fb878d1c90ce58c4d9 (table default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]). Expected version 1 got 0
I20251025 08:02:23.293383 15370 tablet_bootstrap.cc:654] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.293375 15372 raft_consensus.cc:359] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.293635 15372 raft_consensus.cc:385] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.293673 15372 raft_consensus.cc:740] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.293771 15372 consensus_queue.cc:260] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.294008 15372 ts_tablet_manager.cc:1434] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.295130 14646 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 5b4028f5238f4c428648893618587a37 (table default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]). Expected version 1 got 0
I20251025 08:02:23.296123 15370 tablet_bootstrap.cc:492] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.296190 15370 ts_tablet_manager.cc:1403] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20251025 08:02:23.296607 15370 raft_consensus.cc:359] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.296693 15370 raft_consensus.cc:385] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.296733 15370 raft_consensus.cc:740] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.296849 15370 consensus_queue.cc:260] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.297083 15370 ts_tablet_manager.cc:1434] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.297446 14654 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 5b4028f5238f4c428648893618587a37 (table default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]). Expected version 1 got 0
I20251025 08:02:23.299171 14646 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 5b4028f5238f4c428648893618587a37 (table default.Table_9fc00a365ab54475a7e7dab7aa68485a [id=5f9d1d9d2f904f94b00324cca656cb17]). Expected version 1 got 0
I20251025 08:02:23.299168 14654 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet af15eb3890ab43fb878d1c90ce58c4d9 (table default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]). Expected version 1 got 0
W20251025 08:02:23.305305 15028 tablet.cc:2378] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251025 08:02:23.313793 14616 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
/tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.70.60:34453
--webserver_interface=127.14.70.60
--webserver_port=39233
--builtin_ntp_servers=127.14.70.20:37905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20251025 08:02:23.353297 15384 raft_consensus.cc:493] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.353405 15384 raft_consensus.cc:515] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.354296 15384 leader_election.cc:290] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.357849 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af15eb3890ab43fb878d1c90ce58c4d9" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.357982 14979 raft_consensus.cc:2468] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:23.358203 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af15eb3890ab43fb878d1c90ce58c4d9" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:23.358322 15183 leader_election.cc:304] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.358381 15114 raft_consensus.cc:2468] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:23.358538 15384 raft_consensus.cc:2804] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.358601 15384 raft_consensus.cc:493] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.358654 15384 raft_consensus.cc:3060] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.359340 15384 raft_consensus.cc:515] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.359614 15384 leader_election.cc:290] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.359925 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af15eb3890ab43fb878d1c90ce58c4d9" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:23.359963 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af15eb3890ab43fb878d1c90ce58c4d9" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:23.360026 14979 raft_consensus.cc:3060] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.360059 15114 raft_consensus.cc:3060] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.360666 14979 raft_consensus.cc:2468] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:23.360935 15183 leader_election.cc:304] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.361033 15114 raft_consensus.cc:2468] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:23.361088 15384 raft_consensus.cc:2804] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.361248 15384 raft_consensus.cc:697] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:23.361447 15384 consensus_queue.cc:237] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.363917 14646 catalog_manager.cc:5649] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:23.364145 14646 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet af15eb3890ab43fb878d1c90ce58c4d9 (table default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]). Expected version 1 got 0
I20251025 08:02:23.366226 14653 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_d262b76e69e04069aa2171bf575de0dd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.366464 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_85a29e7f167641f0873cc4362a498e51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.366609 14653 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d262b76e69e04069aa2171bf575de0dd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:23.366782 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85a29e7f167641f0873cc4362a498e51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.367278 14648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_91841dad53c7476e8a7abe6417dc353b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.367517 14648 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91841dad53c7476e8a7abe6417dc353b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.370175 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_64165815498b473ebf6f4232ff8e398e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.370501 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64165815498b473ebf6f4232ff8e398e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.372035 14649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_31f499a0c1a34e2897b0dc4e675ac6d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.372320 14649 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31f499a0c1a34e2897b0dc4e675ac6d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.372650 14650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_4432a7d6e8ba46c788f385420ff319d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.372694 14652 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_6c87b1a9e21b4dd8bc08c733cdd1e304"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.372967 14650 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4432a7d6e8ba46c788f385420ff319d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.372974 14651 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_c11d0b545be3442685df355dba9a8f12"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.373109 14652 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c87b1a9e21b4dd8bc08c733cdd1e304 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:23.373270 14651 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c11d0b545be3442685df355dba9a8f12 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.374024 14648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_daaba07bb09e480f8ac48910bfb55d24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.374147 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_c6730a6d2f5b41a2ad960456bb50184f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.374298 14648 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_daaba07bb09e480f8ac48910bfb55d24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:23.374389 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c6730a6d2f5b41a2ad960456bb50184f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.378227 14655 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_85a29e7f167641f0873cc4362a498e51" } new_table_name: "default.Table_ddb045f037264e75a3a270929fae8239" modify_external_catalogs: true
I20251025 08:02:23.378257 14647 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_2e7bb7b759ef41acbc322deacbaa9c2f" } new_table_name: "default.Table_54c4c19e5587477babf6db604ddc60b9" modify_external_catalogs: true
W20251025 08:02:23.378428 15298 tablet.cc:2378] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251025 08:02:23.378691 14653 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_d262b76e69e04069aa2171bf575de0dd" } new_table_name: "default.Table_c0d0d3b2524e416293ac368e8d6d4598" modify_external_catalogs: true
W20251025 08:02:23.380457 14642 catalog_manager.cc:5101] could not convert tablet's c6d9fd3a6b2d41c5881248c0960c3ee7 schema from PB: OK
I20251025 08:02:23.382141 14646 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_9fc00a365ab54475a7e7dab7aa68485a" } new_table_name: "default.Table_299767dfd96a4890bd29ca0bb43b79aa" modify_external_catalogs: true
I20251025 08:02:23.384232 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 9173c34b9e5e4bbc942f5a85cf1d6921 (DEFAULT_TABLE table=default.Table_91841dad53c7476e8a7abe6417dc353b [id=236cf2edc31b487988d3b53016611c9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.384456 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9173c34b9e5e4bbc942f5a85cf1d6921. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.386035 15369 tablet_bootstrap.cc:492] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.386164 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 9173c34b9e5e4bbc942f5a85cf1d6921 (DEFAULT_TABLE table=default.Table_91841dad53c7476e8a7abe6417dc353b [id=236cf2edc31b487988d3b53016611c9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.386379 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9173c34b9e5e4bbc942f5a85cf1d6921. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.386981 15369 tablet_bootstrap.cc:654] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.387763 15372 tablet_bootstrap.cc:492] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.388150 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 9173c34b9e5e4bbc942f5a85cf1d6921 (DEFAULT_TABLE table=default.Table_91841dad53c7476e8a7abe6417dc353b [id=236cf2edc31b487988d3b53016611c9c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.388396 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9173c34b9e5e4bbc942f5a85cf1d6921. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.388607 15372 tablet_bootstrap.cc:654] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.389227 14649 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_8d5d70ca9382482e848e7111f5c93aa9" } modify_external_catalogs: true
I20251025 08:02:23.389319 14649 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_8d5d70ca9382482e848e7111f5c93aa9" } modify_external_catalogs: true
I20251025 08:02:23.389569 14650 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a" } modify_external_catalogs: true
I20251025 08:02:23.389657 14650 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a" } modify_external_catalogs: true
I20251025 08:02:23.390292 14652 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_318ecfa0636a4258b6529554f15b63f3" } new_table_name: "default.Table_9ac23f3df59f4cc4b2584f5332b7403d" modify_external_catalogs: true
I20251025 08:02:23.391412 15369 tablet_bootstrap.cc:492] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.391502 15369 ts_tablet_manager.cc:1403] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251025 08:02:23.391921 15369 raft_consensus.cc:359] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.392009 15369 raft_consensus.cc:385] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.392043 15369 raft_consensus.cc:740] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.392017 14651 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_91841dad53c7476e8a7abe6417dc353b" } modify_external_catalogs: true
I20251025 08:02:23.392114 14651 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_91841dad53c7476e8a7abe6417dc353b" } modify_external_catalogs: true
I20251025 08:02:23.392169 15369 consensus_queue.cc:260] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.392369 15249 raft_consensus.cc:1275] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:23.392483 15369 ts_tablet_manager.cc:1434] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.391393 14979 raft_consensus.cc:1275] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:23.393388 15370 tablet_bootstrap.cc:492] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.393704 15409 raft_consensus.cc:493] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.393785 15409 raft_consensus.cc:515] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.394358 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f9b311ee33a42d5a1c1d8b41576bb54" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.394448 14979 raft_consensus.cc:2468] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:23.394476 15370 tablet_bootstrap.cc:654] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.394490 14648 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_64165815498b473ebf6f4232ff8e398e" } modify_external_catalogs: true
I20251025 08:02:23.394565 14648 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_64165815498b473ebf6f4232ff8e398e" } modify_external_catalogs: true
I20251025 08:02:23.394690 15183 leader_election.cc:304] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.394847 15384 raft_consensus.cc:2804] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.394887 15384 raft_consensus.cc:493] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.394920 15384 raft_consensus.cc:3060] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.395776 15384 raft_consensus.cc:515] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.396070 15384 leader_election.cc:290] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.396425 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f9b311ee33a42d5a1c1d8b41576bb54" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
W20251025 08:02:23.396485 14653 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7a11af785ca64f83bfd1038fb37420de has no consensus state
I20251025 08:02:23.396528 15114 raft_consensus.cc:3060] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.396646 14653 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_31f499a0c1a34e2897b0dc4e675ac6d7" } modify_external_catalogs: true
I20251025 08:02:23.396739 14653 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_31f499a0c1a34e2897b0dc4e675ac6d7" } modify_external_catalogs: true
I20251025 08:02:23.397397 15114 raft_consensus.cc:2468] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
W20251025 08:02:23.397804 14646 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5b4028f5238f4c428648893618587a37 consensus state has no leader
I20251025 08:02:23.398013 15409 leader_election.cc:290] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.398160 15185 leader_election.cc:304] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.398620 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f9b311ee33a42d5a1c1d8b41576bb54" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:23.398746 15114 raft_consensus.cc:2376] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1. Re-sending same reply.
I20251025 08:02:23.398905 15409 raft_consensus.cc:2804] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.399482 15409 raft_consensus.cc:697] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:23.399626 15409 consensus_queue.cc:237] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.401250 15090 tablet_service.cc:1505] Processing CreateTablet for tablet a8a0e61768d8417ea2d7b3d53fa6638b (DEFAULT_TABLE table=default.Table_6c87b1a9e21b4dd8bc08c733cdd1e304 [id=9922f64110ca4506bc2d3454cb7a297f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.401381 15092 tablet_service.cc:1505] Processing CreateTablet for tablet a4756dc189dc482db744ea709cd7e1ac (DEFAULT_TABLE table=default.Table_4432a7d6e8ba46c788f385420ff319d2 [id=d9086af440904392ab2cd7e0fc9a95de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.401470 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8a0e61768d8417ea2d7b3d53fa6638b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.401571 15091 tablet_service.cc:1505] Processing CreateTablet for tablet a3a42adcce494c03bcb4b4c58a82f1e6 (DEFAULT_TABLE table=default.Table_31f499a0c1a34e2897b0dc4e675ac6d7 [id=2cb49945d77046cd8c859f53e1d62707]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.401602 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4756dc189dc482db744ea709cd7e1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.401671 15380 consensus_queue.cc:1048] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:23.401778 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a42adcce494c03bcb4b4c58a82f1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.402024 15380 consensus_queue.cc:1048] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:23.402655 15372 tablet_bootstrap.cc:492] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.402721 15372 ts_tablet_manager.cc:1403] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:23.402944 15370 tablet_bootstrap.cc:492] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.403008 15370 ts_tablet_manager.cc:1403] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:23.403112 15372 raft_consensus.cc:359] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.403196 15372 raft_consensus.cc:385] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.403241 15372 raft_consensus.cc:740] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.403350 15372 consensus_queue.cc:260] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.403448 15370 raft_consensus.cc:359] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.403540 15370 raft_consensus.cc:385] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.403569 15370 raft_consensus.cc:740] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.403611 15372 ts_tablet_manager.cc:1434] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.403617 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 7a11af785ca64f83bfd1038fb37420de (DEFAULT_TABLE table=default.Table_c0d0d3b2524e416293ac368e8d6d4598 [id=29a1ac5b34e84405ad2a34bd49ea9997]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.403679 15370 consensus_queue.cc:260] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.403787 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a11af785ca64f83bfd1038fb37420de. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.403910 15370 ts_tablet_manager.cc:1434] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.404081 15370 tablet_bootstrap.cc:492] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.404588 15089 tablet_service.cc:1505] Processing CreateTablet for tablet bd9cc001437c42739ca7f9f2601b06b4 (DEFAULT_TABLE table=default.Table_64165815498b473ebf6f4232ff8e398e [id=d242b571804f4a3d8544dc85dfa3ec78]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.404779 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd9cc001437c42739ca7f9f2601b06b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.404914 15370 tablet_bootstrap.cc:654] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.405985 15370 tablet_bootstrap.cc:492] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.406059 15370 ts_tablet_manager.cc:1403] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.406687 15370 raft_consensus.cc:359] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.406776 15370 raft_consensus.cc:385] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.406811 15370 raft_consensus.cc:740] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.406944 15370 consensus_queue.cc:260] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.407233 15370 ts_tablet_manager.cc:1434] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.407392 15370 tablet_bootstrap.cc:492] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.407953 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 2d890847f8634b869d9958519c6d2b8c (DEFAULT_TABLE table=default.Table_85a29e7f167641f0873cc4362a498e51 [id=f0a305005a5140a19271b7f9ceae8dbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.408143 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d890847f8634b869d9958519c6d2b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.408257 15370 tablet_bootstrap.cc:654] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.409165 15370 tablet_bootstrap.cc:492] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.409236 15370 ts_tablet_manager.cc:1403] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.409590 15370 raft_consensus.cc:359] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.409672 15370 raft_consensus.cc:385] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251025 08:02:23.396643 14647 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f9b311ee33a42d5a1c1d8b41576bb54 consensus state has no leader
I20251025 08:02:23.409722 15370 raft_consensus.cc:740] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.409854 15370 consensus_queue.cc:260] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.410100 15370 ts_tablet_manager.cc:1434] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.410328 15370 tablet_bootstrap.cc:492] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.411185 15370 tablet_bootstrap.cc:654] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.413157 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 7a11af785ca64f83bfd1038fb37420de (DEFAULT_TABLE table=default.Table_c0d0d3b2524e416293ac368e8d6d4598 [id=29a1ac5b34e84405ad2a34bd49ea9997]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.413210 14957 tablet_service.cc:1505] Processing CreateTablet for tablet a8a0e61768d8417ea2d7b3d53fa6638b (DEFAULT_TABLE table=default.Table_6c87b1a9e21b4dd8bc08c733cdd1e304 [id=9922f64110ca4506bc2d3454cb7a297f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.413424 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8a0e61768d8417ea2d7b3d53fa6638b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.413496 14954 tablet_service.cc:1505] Processing CreateTablet for tablet bd9cc001437c42739ca7f9f2601b06b4 (DEFAULT_TABLE table=default.Table_64165815498b473ebf6f4232ff8e398e [id=d242b571804f4a3d8544dc85dfa3ec78]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.413674 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd9cc001437c42739ca7f9f2601b06b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.415288 14959 tablet_service.cc:1505] Processing CreateTablet for tablet a3a42adcce494c03bcb4b4c58a82f1e6 (DEFAULT_TABLE table=default.Table_31f499a0c1a34e2897b0dc4e675ac6d7 [id=2cb49945d77046cd8c859f53e1d62707]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.415351 15369 tablet_bootstrap.cc:492] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.415477 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a42adcce494c03bcb4b4c58a82f1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.416343 15369 tablet_bootstrap.cc:654] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.417413 15369 tablet_bootstrap.cc:492] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.417484 15369 ts_tablet_manager.cc:1403] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:23.417462 14958 tablet_service.cc:1505] Processing CreateTablet for tablet a4756dc189dc482db744ea709cd7e1ac (DEFAULT_TABLE table=default.Table_4432a7d6e8ba46c788f385420ff319d2 [id=d9086af440904392ab2cd7e0fc9a95de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.417650 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4756dc189dc482db744ea709cd7e1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.417886 15369 raft_consensus.cc:359] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.417965 15369 raft_consensus.cc:385] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.417994 15369 raft_consensus.cc:740] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.418077 15369 consensus_queue.cc:260] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.418344 15369 ts_tablet_manager.cc:1434] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.418525 15369 tablet_bootstrap.cc:492] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.419402 15369 tablet_bootstrap.cc:654] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.419607 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 2d890847f8634b869d9958519c6d2b8c (DEFAULT_TABLE table=default.Table_85a29e7f167641f0873cc4362a498e51 [id=f0a305005a5140a19271b7f9ceae8dbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.419838 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d890847f8634b869d9958519c6d2b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.420430 15369 tablet_bootstrap.cc:492] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.420503 15369 ts_tablet_manager.cc:1403] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.420919 15369 raft_consensus.cc:359] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.420993 15369 raft_consensus.cc:385] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.421020 15369 raft_consensus.cc:740] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.421121 15369 consensus_queue.cc:260] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.421384 15369 ts_tablet_manager.cc:1434] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.421528 15369 tablet_bootstrap.cc:492] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.421670 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5f9b311ee33a42d5a1c1d8b41576bb54" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:23.421747 14979 raft_consensus.cc:3060] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.422358 15369 tablet_bootstrap.cc:654] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.422590 14979 raft_consensus.cc:2468] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:23.422727 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a11af785ca64f83bfd1038fb37420de. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.423720 15369 tablet_bootstrap.cc:492] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.423770 15369 ts_tablet_manager.cc:1403] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.424036 15369 raft_consensus.cc:359] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.424094 15369 raft_consensus.cc:385] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.424113 15369 raft_consensus.cc:740] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.424209 15369 consensus_queue.cc:260] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.424423 15369 ts_tablet_manager.cc:1434] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.424577 15369 tablet_bootstrap.cc:492] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.425806 15369 tablet_bootstrap.cc:654] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.426746 15369 tablet_bootstrap.cc:492] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.426822 15369 ts_tablet_manager.cc:1403] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.427121 15369 raft_consensus.cc:359] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.427181 15369 raft_consensus.cc:385] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.427199 15369 raft_consensus.cc:740] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.427310 15369 consensus_queue.cc:260] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:23.429275 14655 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2d890847f8634b869d9958519c6d2b8c consensus state has no leader
I20251025 08:02:23.429735 15226 tablet_service.cc:1505] Processing CreateTablet for tablet a3a42adcce494c03bcb4b4c58a82f1e6 (DEFAULT_TABLE table=default.Table_31f499a0c1a34e2897b0dc4e675ac6d7 [id=2cb49945d77046cd8c859f53e1d62707]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.429994 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a42adcce494c03bcb4b4c58a82f1e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.432078 15229 tablet_service.cc:1505] Processing CreateTablet for tablet a4756dc189dc482db744ea709cd7e1ac (DEFAULT_TABLE table=default.Table_4432a7d6e8ba46c788f385420ff319d2 [id=d9086af440904392ab2cd7e0fc9a95de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.432312 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4756dc189dc482db744ea709cd7e1ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.432541 15370 tablet_bootstrap.cc:492] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.432610 15370 ts_tablet_manager.cc:1403] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20251025 08:02:23.432669 15225 tablet_service.cc:1505] Processing CreateTablet for tablet a8a0e61768d8417ea2d7b3d53fa6638b (DEFAULT_TABLE table=default.Table_6c87b1a9e21b4dd8bc08c733cdd1e304 [id=9922f64110ca4506bc2d3454cb7a297f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.432864 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8a0e61768d8417ea2d7b3d53fa6638b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.433009 15370 raft_consensus.cc:359] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.433094 15370 raft_consensus.cc:385] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.433122 15370 raft_consensus.cc:740] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.433234 15370 consensus_queue.cc:260] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.433457 15370 ts_tablet_manager.cc:1434] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.433604 15370 tablet_bootstrap.cc:492] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.434497 15370 tablet_bootstrap.cc:654] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.434165 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 7a11af785ca64f83bfd1038fb37420de (DEFAULT_TABLE table=default.Table_c0d0d3b2524e416293ac368e8d6d4598 [id=29a1ac5b34e84405ad2a34bd49ea9997]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.436975 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a11af785ca64f83bfd1038fb37420de. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.434823 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 2d890847f8634b869d9958519c6d2b8c (DEFAULT_TABLE table=default.Table_85a29e7f167641f0873cc4362a498e51 [id=f0a305005a5140a19271b7f9ceae8dbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.434998 15224 tablet_service.cc:1505] Processing CreateTablet for tablet bd9cc001437c42739ca7f9f2601b06b4 (DEFAULT_TABLE table=default.Table_64165815498b473ebf6f4232ff8e398e [id=d242b571804f4a3d8544dc85dfa3ec78]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.439168 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d890847f8634b869d9958519c6d2b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.435308 15372 tablet_bootstrap.cc:492] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.440183 15372 tablet_bootstrap.cc:654] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.441174 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd9cc001437c42739ca7f9f2601b06b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.443048 14655 master_service.cc:954] ReplaceTablet: received request to replace tablet a8a0e61768d8417ea2d7b3d53fa6638b from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.443075 15370 tablet_bootstrap.cc:492] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.443137 15370 ts_tablet_manager.cc:1403] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:23.443573 15370 raft_consensus.cc:359] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.443657 15370 raft_consensus.cc:385] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.443693 15370 raft_consensus.cc:740] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.443784 15370 consensus_queue.cc:260] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.444025 15370 ts_tablet_manager.cc:1434] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.444185 15370 tablet_bootstrap.cc:492] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.444916 15372 tablet_bootstrap.cc:492] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.444999 15372 ts_tablet_manager.cc:1403] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:23.445066 15370 tablet_bootstrap.cc:654] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.445308 15114 raft_consensus.cc:1275] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer f0f2f8ce3e9f4d9ba3f3f02813397c31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:23.445467 15372 raft_consensus.cc:359] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.445567 15372 raft_consensus.cc:385] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.445597 15372 raft_consensus.cc:740] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.445695 15372 consensus_queue.cc:260] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.445901 15372 ts_tablet_manager.cc:1434] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.446039 15372 tablet_bootstrap.cc:492] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
W20251025 08:02:23.446314 15407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251025 08:02:23.446558 15407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251025 08:02:23.446617 15407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20251025 08:02:23.447190 15372 tablet_bootstrap.cc:654] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.447508 14653 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet a3a42adcce494c03bcb4b4c58a82f1e6
I20251025 08:02:23.447893 14653 master_service.cc:954] ReplaceTablet: received request to replace tablet a4756dc189dc482db744ea709cd7e1ac from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.448110 15372 tablet_bootstrap.cc:492] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.448184 15372 ts_tablet_manager.cc:1403] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:23.448623 14652 master_service.cc:954] ReplaceTablet: received request to replace tablet a8a0e61768d8417ea2d7b3d53fa6638b from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.448804 14650 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet af15eb3890ab43fb878d1c90ce58c4d9
I20251025 08:02:23.449308 14648 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet bd9cc001437c42739ca7f9f2601b06b4
I20251025 08:02:23.449687 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet af15eb3890ab43fb878d1c90ce58c4d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.450228 15412 mvcc.cc:204] Tried to move back new op lower bound from 7214609790524915712 to 7214609790114230272. Current Snapshot: MvccSnapshot[applied={T|T < 7214609790524915712}]
I20251025 08:02:23.450460 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet a3a42adcce494c03bcb4b4c58a82f1e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:23.451057 15407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251025 08:02:23.451115 15407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251025 08:02:23.451143 15407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251025 08:02:23.451165 15407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251025 08:02:23.451673 15388 tablet_replica.cc:333] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.451781 15388 raft_consensus.cc:2243] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.451864 15388 raft_consensus.cc:2272] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.452370 15388 ts_tablet_manager.cc:1916] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.452647 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet a3a42adcce494c03bcb4b4c58a82f1e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.452770 15386 tablet_replica.cc:333] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.452863 15386 raft_consensus.cc:2243] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.452936 15386 raft_consensus.cc:2272] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.453246 15384 consensus_queue.cc:1048] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:23.454258 15372 raft_consensus.cc:359] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.454401 15372 raft_consensus.cc:385] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.454438 15372 raft_consensus.cc:740] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.454532 15388 ts_tablet_manager.cc:1929] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.454594 15388 log.cc:1199] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/af15eb3890ab43fb878d1c90ce58c4d9
I20251025 08:02:23.454571 15372 consensus_queue.cc:260] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.454623 14648 master_service.cc:954] ReplaceTablet: received request to replace tablet a4756dc189dc482db744ea709cd7e1ac from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.454804 15388 ts_tablet_manager.cc:1950] T af15eb3890ab43fb878d1c90ce58c4d9 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.454949 15372 ts_tablet_manager.cc:1434] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20251025 08:02:23.455108 15372 tablet_bootstrap.cc:492] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.455729 15388 tablet_replica.cc:333] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.455828 15388 raft_consensus.cc:2243] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.455919 15388 raft_consensus.cc:2272] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.456189 15372 tablet_bootstrap.cc:654] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.456265 15407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.70.20:37905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.70.60:34453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.14.70.60
--webserver_port=39233
--never_fsync=true
--heap_profile_path=/tmp/kudu.15407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d0cb013a5aad754f2ed06c25f5ec3d8a1873622
build type DEBUG
built by None at 25 Oct 2025 07:43:14 UTC on 24a791456cd2
build id 8706
W20251025 08:02:23.456651 15185 consensus_peers.cc:597] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af15eb3890ab43fb878d1c90ce58c4d9. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:23.456712 15429 mvcc.cc:204] Tried to move back new op lower bound from 7214609790524915712 to 7214609790114230272. Current Snapshot: MvccSnapshot[applied={T|T < 7214609790524915712}]
I20251025 08:02:23.457060 15436 tablet.cc:1722] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:23.457444 15407 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251025 08:02:23.457444 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet af15eb3890ab43fb878d1c90ce58c4d9 (table default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]) successfully deleted
I20251025 08:02:23.457618 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet bd9cc001437c42739ca7f9f2601b06b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.457595 15437 tablet.cc:1722] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:23.458109 14650 master_service.cc:954] ReplaceTablet: received request to replace tablet 5f9b311ee33a42d5a1c1d8b41576bb54 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.458776 15407 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251025 08:02:23.458938 14655 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet a8a0e61768d8417ea2d7b3d53fa6638b
I20251025 08:02:23.459170 14655 catalog_manager.cc:6719] ReplaceTablet: tablet a8a0e61768d8417ea2d7b3d53fa6638b deleted and replaced by tablet cd03eb08d0e54427a4709a4de4c4796c
I20251025 08:02:23.460019 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet bd9cc001437c42739ca7f9f2601b06b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.460342 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet a8a0e61768d8417ea2d7b3d53fa6638b with delete_type TABLET_DATA_DELETED (replaced by tablet cd03eb08d0e54427a4709a4de4c4796c) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:23.460655 15163 tablet.cc:2378] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20251025 08:02:23.461721 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet af15eb3890ab43fb878d1c90ce58c4d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.461750 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet a8a0e61768d8417ea2d7b3d53fa6638b with delete_type TABLET_DATA_DELETED (replaced by tablet cd03eb08d0e54427a4709a4de4c4796c) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.461993 15388 ts_tablet_manager.cc:1916] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.462998 14653 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet a4756dc189dc482db744ea709cd7e1ac
I20251025 08:02:23.463238 14653 catalog_manager.cc:6719] ReplaceTablet: tablet a4756dc189dc482db744ea709cd7e1ac deleted and replaced by tablet 36d07fdd83204e01933862285ce4a539
I20251025 08:02:23.464885 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet a4756dc189dc482db744ea709cd7e1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 36d07fdd83204e01933862285ce4a539) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:23.465265 15443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:23.465303 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet a4756dc189dc482db744ea709cd7e1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 36d07fdd83204e01933862285ce4a539) from {username='slave'} at 127.0.0.1:36846
W20251025 08:02:23.466054 15441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:23.428090 15369 ts_tablet_manager.cc:1434] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.438184 15374 raft_consensus.cc:493] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.450623 14956 tablet_service.cc:1552] Processing DeleteTablet for tablet a3a42adcce494c03bcb4b4c58a82f1e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.466521 15374 raft_consensus.cc:515] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.454929 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet bd9cc001437c42739ca7f9f2601b06b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.455655 14978 raft_consensus.cc:1275] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer f0f2f8ce3e9f4d9ba3f3f02813397c31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:23.467093 15385 tablet_replica.cc:333] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.467232 15385 raft_consensus.cc:2243] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.467322 15385 raft_consensus.cc:2272] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.462257 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet a8a0e61768d8417ea2d7b3d53fa6638b with delete_type TABLET_DATA_DELETED (replaced by tablet cd03eb08d0e54427a4709a4de4c4796c) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.467504 15370 tablet_bootstrap.cc:492] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.467571 15370 ts_tablet_manager.cc:1403] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.000s
I20251025 08:02:23.464437 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet a4756dc189dc482db744ea709cd7e1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 36d07fdd83204e01933862285ce4a539) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.467582 15374 leader_election.cc:290] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.467657 15374 raft_consensus.cc:493] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.467708 15374 raft_consensus.cc:515] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.467897 15386 ts_tablet_manager.cc:1916] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.467922 15374 leader_election.cc:290] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.450798 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet af15eb3890ab43fb878d1c90ce58c4d9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.468004 15370 raft_consensus.cc:359] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.468092 15370 raft_consensus.cc:385] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.468122 15370 raft_consensus.cc:740] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.468118 15409 consensus_queue.cc:1048] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:23.468227 15370 consensus_queue.cc:260] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.468442 15370 ts_tablet_manager.cc:1434] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.468581 15370 tablet_bootstrap.cc:492] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.469516 15370 tablet_bootstrap.cc:654] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.469789 15386 ts_tablet_manager.cc:1929] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.469852 15386 log.cc:1199] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/a3a42adcce494c03bcb4b4c58a82f1e6
I20251025 08:02:23.470068 15386 ts_tablet_manager.cc:1950] T a3a42adcce494c03bcb4b4c58a82f1e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.470697 15386 tablet_replica.cc:333] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.470809 15386 raft_consensus.cc:2243] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:23.470885 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet a3a42adcce494c03bcb4b4c58a82f1e6 (table default.Table_31f499a0c1a34e2897b0dc4e675ac6d7 [id=2cb49945d77046cd8c859f53e1d62707]) successfully deleted
I20251025 08:02:23.471014 15386 pending_rounds.cc:70] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 2 pending ops.
W20251025 08:02:23.471050 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet bd9cc001437c42739ca7f9f2601b06b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bd9cc001437c42739ca7f9f2601b06b4 already in progress: creating tablet
I20251025 08:02:23.471076 15386 pending_rounds.cc:77] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7214609790743244800 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "af15eb3890ab43fb878d1c90ce58c4d9" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a" dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" new_extra_config { } }
I20251025 08:02:23.471118 15407 server_base.cc:1047] running on GCE node
W20251025 08:02:23.471372 15386 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36846: Aborted: Op aborted
I20251025 08:02:23.471534 15385 ts_tablet_manager.cc:1916] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.471683 15424 mvcc.cc:204] Tried to move back new op lower bound from 7214609790524915712 to 7214609790114230272. Current Snapshot: MvccSnapshot[applied={T|T < 7214609790524915712}]
I20251025 08:02:23.471693 15386 pending_rounds.cc:77] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609790410387456 op_type: NO_OP noop_request { }
I20251025 08:02:23.471760 15386 raft_consensus.cc:2889] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:23.471808 15386 raft_consensus.cc:2272] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.472638 15386 ts_tablet_manager.cc:1916] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.473547 15385 ts_tablet_manager.cc:1929] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.473611 15385 log.cc:1199] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/a3a42adcce494c03bcb4b4c58a82f1e6
I20251025 08:02:23.473794 15385 ts_tablet_manager.cc:1950] T a3a42adcce494c03bcb4b4c58a82f1e6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.474426 15386 ts_tablet_manager.cc:1929] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:23.474480 15386 log.cc:1199] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/af15eb3890ab43fb878d1c90ce58c4d9
I20251025 08:02:23.474692 15386 ts_tablet_manager.cc:1950] T af15eb3890ab43fb878d1c90ce58c4d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.475554 15386 tablet_replica.cc:333] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.475677 15386 raft_consensus.cc:2243] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.475798 15386 raft_consensus.cc:2272] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.476245 15386 ts_tablet_manager.cc:1916] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.476720 14646 catalog_manager.cc:5649] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:23.476946 14646 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 5f9b311ee33a42d5a1c1d8b41576bb54 (table default.Table_54c4c19e5587477babf6db604ddc60b9 [id=394a1e6daa8f42f4a69517cb60a9a935]). Expected version 2 got 0
I20251025 08:02:23.477519 15372 tablet_bootstrap.cc:492] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.477588 15372 ts_tablet_manager.cc:1403] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.000s
I20251025 08:02:23.477805 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet af15eb3890ab43fb878d1c90ce58c4d9 (table default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]) successfully deleted
W20251025 08:02:23.477927 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet a8a0e61768d8417ea2d7b3d53fa6638b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a8a0e61768d8417ea2d7b3d53fa6638b already in progress: creating tablet
I20251025 08:02:23.478009 15372 raft_consensus.cc:359] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.478088 15372 raft_consensus.cc:385] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.478120 15372 raft_consensus.cc:740] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.478245 15372 consensus_queue.cc:260] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.478371 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 1f7a26c306f748aea3ccd888b95ebc67 (DEFAULT_TABLE table=default.Table_daaba07bb09e480f8ac48910bfb55d24 [id=7e4c09fa093f415c99aed131b156bd2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.478569 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7a26c306f748aea3ccd888b95ebc67. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.479490 14955 tablet_service.cc:1505] Processing CreateTablet for tablet abd8c09e1e884d3cbd36801d6b7f9a98 (DEFAULT_TABLE table=default.Table_c11d0b545be3442685df355dba9a8f12 [id=9f02c9df85ba446cbe85aa321eb93c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.479547 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 1f7a26c306f748aea3ccd888b95ebc67 (DEFAULT_TABLE table=default.Table_daaba07bb09e480f8ac48910bfb55d24 [id=7e4c09fa093f415c99aed131b156bd2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.479700 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd8c09e1e884d3cbd36801d6b7f9a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.479833 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7a26c306f748aea3ccd888b95ebc67. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.481566 15093 tablet_service.cc:1505] Processing CreateTablet for tablet abd8c09e1e884d3cbd36801d6b7f9a98 (DEFAULT_TABLE table=default.Table_c11d0b545be3442685df355dba9a8f12 [id=9f02c9df85ba446cbe85aa321eb93c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.481779 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd8c09e1e884d3cbd36801d6b7f9a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.482103 15385 tablet_replica.cc:333] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.482226 15385 raft_consensus.cc:2243] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.482321 15385 raft_consensus.cc:2272] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.482316 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 1f7a26c306f748aea3ccd888b95ebc67 (DEFAULT_TABLE table=default.Table_daaba07bb09e480f8ac48910bfb55d24 [id=7e4c09fa093f415c99aed131b156bd2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.482540 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f7a26c306f748aea3ccd888b95ebc67. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.482837 15388 ts_tablet_manager.cc:1929] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.482896 15388 log.cc:1199] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/a3a42adcce494c03bcb4b4c58a82f1e6
I20251025 08:02:23.483127 15388 ts_tablet_manager.cc:1950] T a3a42adcce494c03bcb4b4c58a82f1e6 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.483644 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet a3a42adcce494c03bcb4b4c58a82f1e6 (table default.Table_31f499a0c1a34e2897b0dc4e675ac6d7 [id=2cb49945d77046cd8c859f53e1d62707]) successfully deleted
I20251025 08:02:23.466440 15369 tablet_bootstrap.cc:492] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.484603 15385 ts_tablet_manager.cc:1916] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.484670 15369 tablet_bootstrap.cc:654] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.485436 15388 tablet_replica.cc:333] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.485554 15388 raft_consensus.cc:2243] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.485636 15388 raft_consensus.cc:2272] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.486299 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet a3a42adcce494c03bcb4b4c58a82f1e6 (table default.Table_31f499a0c1a34e2897b0dc4e675ac6d7 [id=2cb49945d77046cd8c859f53e1d62707]) successfully deleted
I20251025 08:02:23.486596 15388 ts_tablet_manager.cc:1916] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:23.486639 15440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:23.487288 15407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251025 08:02:23.487982 14649 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 634a93b40b7c49c799b711bf7ac36eb2
I20251025 08:02:23.488391 14651 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 9173c34b9e5e4bbc942f5a85cf1d6921
I20251025 08:02:23.488410 15407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251025 08:02:23.488824 15374 raft_consensus.cc:493] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.488895 15374 raft_consensus.cc:515] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.489262 15374 leader_election.cc:290] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.489264 15388 ts_tablet_manager.cc:1929] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.489336 15388 log.cc:1199] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/bd9cc001437c42739ca7f9f2601b06b4
I20251025 08:02:23.490264 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4756dc189dc482db744ea709cd7e1ac" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:23.490384 15113 raft_consensus.cc:2468] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:23.490466 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 9173c34b9e5e4bbc942f5a85cf1d6921 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.491150 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 9173c34b9e5e4bbc942f5a85cf1d6921 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.491324 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8a0e61768d8417ea2d7b3d53fa6638b" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:23.491415 15114 raft_consensus.cc:2468] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:23.491798 15436 tablet.cc:1722] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:23.491992 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet 634a93b40b7c49c799b711bf7ac36eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.492058 15388 ts_tablet_manager.cc:1950] T bd9cc001437c42739ca7f9f2601b06b4 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.492103 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 634a93b40b7c49c799b711bf7ac36eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.492493 14647 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (table default.Table_9ac23f3df59f4cc4b2584f5332b7403d [id=9af7f62b46de47af9bfae466af91660b]). Expected version 2 got 0
I20251025 08:02:23.492666 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet bd9cc001437c42739ca7f9f2601b06b4 (table default.Table_64165815498b473ebf6f4232ff8e398e [id=d242b571804f4a3d8544dc85dfa3ec78]) successfully deleted
I20251025 08:02:23.493534 15228 tablet_service.cc:1505] Processing CreateTablet for tablet abd8c09e1e884d3cbd36801d6b7f9a98 (DEFAULT_TABLE table=default.Table_c11d0b545be3442685df355dba9a8f12 [id=9f02c9df85ba446cbe85aa321eb93c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.493752 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abd8c09e1e884d3cbd36801d6b7f9a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.493824 15388 tablet_replica.cc:333] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.493918 15388 raft_consensus.cc:2243] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.494019 15388 raft_consensus.cc:2272] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.494112 14915 leader_election.cc:304] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:23.494318 15437 tablet.cc:1722] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:23.494374 14915 leader_election.cc:304] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:23.494426 15388 ts_tablet_manager.cc:1916] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.494513 15374 raft_consensus.cc:2804] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.494554 15374 raft_consensus.cc:493] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.494596 15374 raft_consensus.cc:3060] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.494796 15409 raft_consensus.cc:493] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.494864 15409 raft_consensus.cc:515] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.495167 15409 leader_election.cc:290] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.495446 15374 raft_consensus.cc:515] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.495751 15374 leader_election.cc:290] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.495851 15374 raft_consensus.cc:2804] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.495893 15374 raft_consensus.cc:493] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.495927 15374 raft_consensus.cc:3060] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.496187 15388 ts_tablet_manager.cc:1929] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.496243 15388 log.cc:1199] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/a8a0e61768d8417ea2d7b3d53fa6638b
I20251025 08:02:23.496425 15388 ts_tablet_manager.cc:1950] T a8a0e61768d8417ea2d7b3d53fa6638b P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.496753 15374 raft_consensus.cc:515] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.496790 15451 tablet.cc:1722] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:23.497026 15374 leader_election.cc:290] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.497594 15388 tablet_replica.cc:333] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.497690 15388 raft_consensus.cc:2243] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.497766 15388 raft_consensus.cc:2272] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.498495 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet a8a0e61768d8417ea2d7b3d53fa6638b (table default.Table_6c87b1a9e21b4dd8bc08c733cdd1e304 [id=9922f64110ca4506bc2d3454cb7a297f]) successfully deleted
I20251025 08:02:23.498579 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b4028f5238f4c428648893618587a37" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:23.498643 15369 tablet_bootstrap.cc:492] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.498677 15114 raft_consensus.cc:2468] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:23.498716 15369 ts_tablet_manager.cc:1403] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
W20251025 08:02:23.499166 15185 leader_election.cc:343] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: a8a0e61768d8417ea2d7b3d53fa6638b
I20251025 08:02:23.499152 15369 raft_consensus.cc:359] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.499236 15369 raft_consensus.cc:385] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.499266 15369 raft_consensus.cc:740] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.499348 15369 consensus_queue.cc:260] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.499594 15369 ts_tablet_manager.cc:1434] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.478570 15372 ts_tablet_manager.cc:1434] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.500757 15369 tablet_bootstrap.cc:492] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.501353 15372 tablet_bootstrap.cc:492] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.501694 15369 tablet_bootstrap.cc:654] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.502341 15372 tablet_bootstrap.cc:654] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.502588 15388 ts_tablet_manager.cc:1916] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.502815 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 634a93b40b7c49c799b711bf7ac36eb2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.502853 14915 leader_election.cc:304] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:23.503198 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8a0e61768d8417ea2d7b3d53fa6638b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.503336 14979 raft_consensus.cc:2393] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:23.504280 15388 ts_tablet_manager.cc:1929] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.504303 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4756dc189dc482db744ea709cd7e1ac" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:23.504345 15388 log.cc:1199] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/a4756dc189dc482db744ea709cd7e1ac
I20251025 08:02:23.504534 15388 ts_tablet_manager.cc:1950] T a4756dc189dc482db744ea709cd7e1ac P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.505010 15388 tablet_replica.cc:333] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.505107 15388 raft_consensus.cc:2243] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.505112 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8a0e61768d8417ea2d7b3d53fa6638b" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.505190 15388 raft_consensus.cc:2272] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.505203 15249 raft_consensus.cc:2468] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:23.505414 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4756dc189dc482db744ea709cd7e1ac" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.505666 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b4028f5238f4c428648893618587a37" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.505767 15370 tablet_bootstrap.cc:492] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.505753 15247 raft_consensus.cc:2468] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:23.505842 15370 ts_tablet_manager.cc:1403] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.000s
I20251025 08:02:23.505949 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a4756dc189dc482db744ea709cd7e1ac" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:23.506131 15245 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8a0e61768d8417ea2d7b3d53fa6638b" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:23.506235 15245 raft_consensus.cc:3060] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.506289 15370 raft_consensus.cc:359] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.506383 15370 raft_consensus.cc:385] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.506420 15370 raft_consensus.cc:740] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.506520 15370 consensus_queue.cc:260] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.506753 15370 ts_tablet_manager.cc:1434] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.506902 15370 tablet_bootstrap.cc:492] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.507119 15245 raft_consensus.cc:2468] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:23.507707 15370 tablet_bootstrap.cc:654] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.507709 15372 tablet_bootstrap.cc:492] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.507769 15372 ts_tablet_manager.cc:1403] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20251025 08:02:23.508111 15372 raft_consensus.cc:359] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.508188 15372 raft_consensus.cc:385] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.508288 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet a4756dc189dc482db744ea709cd7e1ac (table default.Table_4432a7d6e8ba46c788f385420ff319d2 [id=d9086af440904392ab2cd7e0fc9a95de]) successfully deleted
I20251025 08:02:23.508587 15451 tablet.cc:1722] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:23.509147 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 9173c34b9e5e4bbc942f5a85cf1d6921 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.508212 15372 raft_consensus.cc:740] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.509290 15372 consensus_queue.cc:260] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.509384 15388 ts_tablet_manager.cc:1916] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.510260 15372 ts_tablet_manager.cc:1434] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:23.510404 15372 tablet_bootstrap.cc:492] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.510896 15370 tablet_bootstrap.cc:492] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.511092 15370 ts_tablet_manager.cc:1403] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:23.511345 15372 tablet_bootstrap.cc:654] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.511454 15370 raft_consensus.cc:359] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.511536 15370 raft_consensus.cc:385] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.511574 15370 raft_consensus.cc:740] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.511678 15370 consensus_queue.cc:260] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.511889 15370 ts_tablet_manager.cc:1434] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.512045 15370 tablet_bootstrap.cc:492] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.512863 15370 tablet_bootstrap.cc:654] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.512934 14646 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (table default.Table_9ac23f3df59f4cc4b2584f5332b7403d [id=9af7f62b46de47af9bfae466af91660b]). Expected version 2 got 1
I20251025 08:02:23.513072 14646 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 2d890847f8634b869d9958519c6d2b8c (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]). Expected version 1 got 0
I20251025 08:02:23.513760 14647 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 2d890847f8634b869d9958519c6d2b8c (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]). Expected version 1 got 0
I20251025 08:02:23.514412 14654 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (table default.Table_9ac23f3df59f4cc4b2584f5332b7403d [id=9af7f62b46de47af9bfae466af91660b]). Expected version 2 got 1
I20251025 08:02:23.514858 15227 tablet_service.cc:1505] Processing CreateTablet for tablet cd03eb08d0e54427a4709a4de4c4796c (DEFAULT_TABLE table=default.Table_6c87b1a9e21b4dd8bc08c733cdd1e304 [id=9922f64110ca4506bc2d3454cb7a297f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.515045 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd03eb08d0e54427a4709a4de4c4796c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.515515 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 36d07fdd83204e01933862285ce4a539 (DEFAULT_TABLE table=default.Table_4432a7d6e8ba46c788f385420ff319d2 [id=d9086af440904392ab2cd7e0fc9a95de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.515713 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d07fdd83204e01933862285ce4a539. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.516019 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet bd9cc001437c42739ca7f9f2601b06b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.516160 15094 tablet_service.cc:1505] Processing CreateTablet for tablet cd03eb08d0e54427a4709a4de4c4796c (DEFAULT_TABLE table=default.Table_6c87b1a9e21b4dd8bc08c733cdd1e304 [id=9922f64110ca4506bc2d3454cb7a297f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.516347 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd03eb08d0e54427a4709a4de4c4796c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.516746 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 297960b7d4dc4af181c05e79ad62a941 (DEFAULT_TABLE table=default.Table_c6730a6d2f5b41a2ad960456bb50184f [id=955fa2dc29344ad39456c6996cc6948a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.516913 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 297960b7d4dc4af181c05e79ad62a941. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.516899 14654 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 7a11af785ca64f83bfd1038fb37420de (table default.Table_c0d0d3b2524e416293ac368e8d6d4598 [id=29a1ac5b34e84405ad2a34bd49ea9997]). Expected version 1 got 0
I20251025 08:02:23.518059 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet a8a0e61768d8417ea2d7b3d53fa6638b with delete_type TABLET_DATA_DELETED (replaced by tablet cd03eb08d0e54427a4709a4de4c4796c) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.518158 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet a4756dc189dc482db744ea709cd7e1ac with delete_type TABLET_DATA_DELETED (replaced by tablet 36d07fdd83204e01933862285ce4a539) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.518824 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 36d07fdd83204e01933862285ce4a539 (DEFAULT_TABLE table=default.Table_4432a7d6e8ba46c788f385420ff319d2 [id=d9086af440904392ab2cd7e0fc9a95de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.518983 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d07fdd83204e01933862285ce4a539. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.519194 14646 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 7a11af785ca64f83bfd1038fb37420de (table default.Table_c0d0d3b2524e416293ac368e8d6d4598 [id=29a1ac5b34e84405ad2a34bd49ea9997]). Expected version 1 got 0
I20251025 08:02:23.519362 15388 ts_tablet_manager.cc:1929] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.519434 15388 log.cc:1199] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/9173c34b9e5e4bbc942f5a85cf1d6921
I20251025 08:02:23.519629 15388 ts_tablet_manager.cc:1950] T 9173c34b9e5e4bbc942f5a85cf1d6921 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.519614 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet a8a0e61768d8417ea2d7b3d53fa6638b with delete_type TABLET_DATA_DELETED (replaced by tablet cd03eb08d0e54427a4709a4de4c4796c) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.520061 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 9173c34b9e5e4bbc942f5a85cf1d6921 (table default.Table_91841dad53c7476e8a7abe6417dc353b [id=236cf2edc31b487988d3b53016611c9c]) successfully deleted
I20251025 08:02:23.520115 15388 tablet_replica.cc:333] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.520206 15388 raft_consensus.cc:2243] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.520268 15388 raft_consensus.cc:2272] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.521085 15388 ts_tablet_manager.cc:1916] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.522188 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 297960b7d4dc4af181c05e79ad62a941 (DEFAULT_TABLE table=default.Table_c6730a6d2f5b41a2ad960456bb50184f [id=955fa2dc29344ad39456c6996cc6948a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.522392 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 297960b7d4dc4af181c05e79ad62a941. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.523149 15370 tablet_bootstrap.cc:492] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.523209 15370 ts_tablet_manager.cc:1403] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20251025 08:02:23.523617 15370 raft_consensus.cc:359] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.523689 15388 ts_tablet_manager.cc:1929] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.523697 15370 raft_consensus.cc:385] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.523756 15370 raft_consensus.cc:740] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.523756 15388 log.cc:1199] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/634a93b40b7c49c799b711bf7ac36eb2
I20251025 08:02:23.523888 15370 consensus_queue.cc:260] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.524071 15388 ts_tablet_manager.cc:1950] T 634a93b40b7c49c799b711bf7ac36eb2 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.524173 15370 ts_tablet_manager.cc:1434] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.524340 15370 tablet_bootstrap.cc:492] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.524665 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 634a93b40b7c49c799b711bf7ac36eb2 (table default.Table_8d5d70ca9382482e848e7111f5c93aa9 [id=49b9829b389140a5b7f81f6fc6025cd8]) successfully deleted
W20251025 08:02:23.524806 14642 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet bd9cc001437c42739ca7f9f2601b06b4 because the tablet was not found. No further retry: Not found: Tablet not found: bd9cc001437c42739ca7f9f2601b06b4
W20251025 08:02:23.524959 14642 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet a8a0e61768d8417ea2d7b3d53fa6638b because the tablet was not found. No further retry: Not found: Tablet not found: a8a0e61768d8417ea2d7b3d53fa6638b
W20251025 08:02:23.525079 14642 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet a4756dc189dc482db744ea709cd7e1ac because the tablet was not found. No further retry: Not found: Tablet not found: a4756dc189dc482db744ea709cd7e1ac
I20251025 08:02:23.525120 15370 tablet_bootstrap.cc:654] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.525678 15372 tablet_bootstrap.cc:492] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.525836 15372 ts_tablet_manager.cc:1403] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:23.526111 15370 tablet_bootstrap.cc:492] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.526221 15370 ts_tablet_manager.cc:1403] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:23.526237 15372 raft_consensus.cc:359] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.526309 15372 raft_consensus.cc:385] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.526340 15372 raft_consensus.cc:740] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.526481 15372 consensus_queue.cc:260] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.526625 15370 raft_consensus.cc:359] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.526708 15370 raft_consensus.cc:385] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.526743 15370 raft_consensus.cc:740] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.526804 15372 ts_tablet_manager.cc:1434] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.526846 15370 consensus_queue.cc:260] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.527071 15370 ts_tablet_manager.cc:1434] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.527220 15370 tablet_bootstrap.cc:492] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:23.527554 14914 leader_election.cc:343] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: Tablet not RUNNING: STOPPED
W20251025 08:02:23.527815 14914 leader_election.cc:343] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: Tablet not RUNNING: STOPPED
I20251025 08:02:23.527894 14914 leader_election.cc:304] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.528049 15445 raft_consensus.cc:2804] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.528092 15445 raft_consensus.cc:493] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.528131 15445 raft_consensus.cc:3060] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.528322 15372 tablet_bootstrap.cc:492] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.528589 15370 tablet_bootstrap.cc:654] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.529016 15372 tablet_bootstrap.cc:654] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.528956 15445 raft_consensus.cc:515] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.529280 15445 leader_election.cc:290] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.529366 15445 raft_consensus.cc:2804] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.529420 15445 raft_consensus.cc:697] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:23.529525 15370 tablet_bootstrap.cc:492] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.529582 15370 ts_tablet_manager.cc:1403] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.529613 15445 consensus_queue.cc:237] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.529758 15245 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b4028f5238f4c428648893618587a37" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:23.529847 15245 raft_consensus.cc:3060] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.529927 15370 raft_consensus.cc:359] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.530027 15370 raft_consensus.cc:385] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.530055 15370 raft_consensus.cc:740] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.530144 15370 consensus_queue.cc:260] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.530412 15370 ts_tablet_manager.cc:1434] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.530601 15370 tablet_bootstrap.cc:492] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.531030 15245 raft_consensus.cc:2468] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:23.531432 15370 tablet_bootstrap.cc:654] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.531620 14914 leader_election.cc:304] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.532155 14654 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_9ac23f3df59f4cc4b2584f5332b7403d [id=9af7f62b46de47af9bfae466af91660b] alter complete (version 2)
I20251025 08:02:23.532281 15445 raft_consensus.cc:2804] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.532351 15445 raft_consensus.cc:697] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:23.532461 15445 consensus_queue.cc:237] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.532879 14650 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 5f9b311ee33a42d5a1c1d8b41576bb54
I20251025 08:02:23.533154 14650 catalog_manager.cc:6719] ReplaceTablet: tablet 5f9b311ee33a42d5a1c1d8b41576bb54 deleted and replaced by tablet 962889388a40485bb61b3b47e3ad3d43
W20251025 08:02:23.534358 14915 leader_election.cc:343] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: a8a0e61768d8417ea2d7b3d53fa6638b
I20251025 08:02:23.534389 15372 tablet_bootstrap.cc:492] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.534482 15372 ts_tablet_manager.cc:1403] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
W20251025 08:02:23.534570 14915 leader_election.cc:343] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: Tablet not RUNNING: STOPPED
I20251025 08:02:23.534592 15183 leader_election.cc:304] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:23.534639 14915 leader_election.cc:304] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:23.535131 15464 raft_consensus.cc:2749] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251025 08:02:23.535328 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 5f9b311ee33a42d5a1c1d8b41576bb54 with delete_type TABLET_DATA_DELETED (replaced by tablet 962889388a40485bb61b3b47e3ad3d43) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.535491 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b4028f5238f4c428648893618587a37" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:23.535586 15114 raft_consensus.cc:3060] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.535578 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 297960b7d4dc4af181c05e79ad62a941 (DEFAULT_TABLE table=default.Table_c6730a6d2f5b41a2ad960456bb50184f [id=955fa2dc29344ad39456c6996cc6948a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.535840 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 297960b7d4dc4af181c05e79ad62a941. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.536448 15114 raft_consensus.cc:2468] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:23.536705 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 36d07fdd83204e01933862285ce4a539 (DEFAULT_TABLE table=default.Table_4432a7d6e8ba46c788f385420ff319d2 [id=d9086af440904392ab2cd7e0fc9a95de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.536895 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36d07fdd83204e01933862285ce4a539. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.537590 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 5f9b311ee33a42d5a1c1d8b41576bb54 with delete_type TABLET_DATA_DELETED (replaced by tablet 962889388a40485bb61b3b47e3ad3d43) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.537775 14955 tablet_service.cc:1505] Processing CreateTablet for tablet cd03eb08d0e54427a4709a4de4c4796c (DEFAULT_TABLE table=default.Table_6c87b1a9e21b4dd8bc08c733cdd1e304 [id=9922f64110ca4506bc2d3454cb7a297f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.537822 15388 tablet_replica.cc:333] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.537909 15388 raft_consensus.cc:2243] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.537982 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd03eb08d0e54427a4709a4de4c4796c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.538002 15388 raft_consensus.cc:2272] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.538640 15388 ts_tablet_manager.cc:1916] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.538669 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 5f9b311ee33a42d5a1c1d8b41576bb54 with delete_type TABLET_DATA_DELETED (replaced by tablet 962889388a40485bb61b3b47e3ad3d43) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.540385 15388 ts_tablet_manager.cc:1929] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.540449 15388 log.cc:1199] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/5f9b311ee33a42d5a1c1d8b41576bb54
I20251025 08:02:23.540647 15388 ts_tablet_manager.cc:1950] T 5f9b311ee33a42d5a1c1d8b41576bb54 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.541222 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 5f9b311ee33a42d5a1c1d8b41576bb54 (table default.Table_54c4c19e5587477babf6db604ddc60b9 [id=394a1e6daa8f42f4a69517cb60a9a935]) successfully deleted
I20251025 08:02:23.541352 15370 tablet_bootstrap.cc:492] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.541424 15370 ts_tablet_manager.cc:1403] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251025 08:02:23.541759 15376 raft_consensus.cc:493] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.541836 15376 raft_consensus.cc:515] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.541859 15370 raft_consensus.cc:359] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.541944 15370 raft_consensus.cc:385] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.541971 15370 raft_consensus.cc:740] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.542208 15376 leader_election.cc:290] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.542315 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 962889388a40485bb61b3b47e3ad3d43 (DEFAULT_TABLE table=default.Table_54c4c19e5587477babf6db604ddc60b9 [id=394a1e6daa8f42f4a69517cb60a9a935]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.542496 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 962889388a40485bb61b3b47e3ad3d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.542426 14646 catalog_manager.cc:5649] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:23.542616 14646 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 5b4028f5238f4c428648893618587a37 (table default.Table_299767dfd96a4890bd29ca0bb43b79aa [id=5f9d1d9d2f904f94b00324cca656cb17]). Expected version 2 got 0
I20251025 08:02:23.542601 15245 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f7a26c306f748aea3ccd888b95ebc67" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:23.543058 15049 leader_election.cc:343] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.543407 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 962889388a40485bb61b3b47e3ad3d43 (DEFAULT_TABLE table=default.Table_54c4c19e5587477babf6db604ddc60b9 [id=394a1e6daa8f42f4a69517cb60a9a935]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.543644 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 962889388a40485bb61b3b47e3ad3d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.544049 14647 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 2d890847f8634b869d9958519c6d2b8c (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]). Expected version 1 got 0
I20251025 08:02:23.544450 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f7a26c306f748aea3ccd888b95ebc67" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.545068 15372 raft_consensus.cc:359] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.545162 15409 raft_consensus.cc:2749] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:23.545161 15372 raft_consensus.cc:385] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.542057 15370 consensus_queue.cc:260] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.545320 15372 raft_consensus.cc:740] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.545531 15372 consensus_queue.cc:260] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.545647 15370 ts_tablet_manager.cc:1434] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:23.546581 15372 ts_tablet_manager.cc:1434] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.012s user 0.001s sys 0.000s
I20251025 08:02:23.546743 15372 tablet_bootstrap.cc:492] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.547647 15372 tablet_bootstrap.cc:654] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.547852 15385 ts_tablet_manager.cc:1929] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.547986 15385 log.cc:1199] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/bd9cc001437c42739ca7f9f2601b06b4
I20251025 08:02:23.548264 15385 ts_tablet_manager.cc:1950] T bd9cc001437c42739ca7f9f2601b06b4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.549142 15385 tablet_replica.cc:333] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.549304 15385 raft_consensus.cc:2243] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:23.549556 15385 pending_rounds.cc:70] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:23.549558 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet bd9cc001437c42739ca7f9f2601b06b4 (table default.Table_64165815498b473ebf6f4232ff8e398e [id=d242b571804f4a3d8544dc85dfa3ec78]) successfully deleted
I20251025 08:02:23.549690 15385 pending_rounds.cc:77] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609791100018688 op_type: NO_OP noop_request { }
I20251025 08:02:23.549777 15385 raft_consensus.cc:2889] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:23.549854 15385 raft_consensus.cc:2272] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.551009 15386 ts_tablet_manager.cc:1929] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.552062 15385 ts_tablet_manager.cc:1916] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.552112 14978 raft_consensus.cc:1275] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer f0f2f8ce3e9f4d9ba3f3f02813397c31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:23.554929 15385 ts_tablet_manager.cc:1929] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:23.555080 15385 log.cc:1199] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/a8a0e61768d8417ea2d7b3d53fa6638b
W20251025 08:02:23.556115 15048 leader_election.cc:343] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.556186 15048 leader_election.cc:304] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:23.551725 15185 consensus_peers.cc:597] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f9b311ee33a42d5a1c1d8b41576bb54. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:23.556442 15376 raft_consensus.cc:2749] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:23.552538 15409 consensus_queue.cc:1048] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:23.554839 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet bd9cc001437c42739ca7f9f2601b06b4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.557472 15386 log.cc:1199] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/a4756dc189dc482db744ea709cd7e1ac
I20251025 08:02:23.557667 15385 ts_tablet_manager.cc:1950] T a8a0e61768d8417ea2d7b3d53fa6638b P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.557881 15386 ts_tablet_manager.cc:1950] T a4756dc189dc482db744ea709cd7e1ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.557687 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 962889388a40485bb61b3b47e3ad3d43 (DEFAULT_TABLE table=default.Table_54c4c19e5587477babf6db604ddc60b9 [id=394a1e6daa8f42f4a69517cb60a9a935]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.558144 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 962889388a40485bb61b3b47e3ad3d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.558437 15385 tablet_replica.cc:333] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.558514 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet a8a0e61768d8417ea2d7b3d53fa6638b (table default.Table_6c87b1a9e21b4dd8bc08c733cdd1e304 [id=9922f64110ca4506bc2d3454cb7a297f]) successfully deleted
I20251025 08:02:23.558542 15385 raft_consensus.cc:2243] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.558620 15385 raft_consensus.cc:2272] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.559231 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet a4756dc189dc482db744ea709cd7e1ac (table default.Table_4432a7d6e8ba46c788f385420ff319d2 [id=d9086af440904392ab2cd7e0fc9a95de]) successfully deleted
I20251025 08:02:23.559516 15386 tablet_replica.cc:333] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.559616 15386 raft_consensus.cc:2243] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.559695 15386 raft_consensus.cc:2272] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.560093 15386 ts_tablet_manager.cc:1916] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.560612 15385 ts_tablet_manager.cc:1916] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.561504 15386 ts_tablet_manager.cc:1929] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.561568 15386 log.cc:1199] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/9173c34b9e5e4bbc942f5a85cf1d6921
I20251025 08:02:23.561733 15386 ts_tablet_manager.cc:1950] T 9173c34b9e5e4bbc942f5a85cf1d6921 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.562119 15385 ts_tablet_manager.cc:1929] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.562296 15385 log.cc:1199] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/a4756dc189dc482db744ea709cd7e1ac
I20251025 08:02:23.562369 15369 tablet_bootstrap.cc:492] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.562451 15369 ts_tablet_manager.cc:1403] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.062s user 0.000s sys 0.002s
I20251025 08:02:23.562462 15386 tablet_replica.cc:333] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.562506 15385 ts_tablet_manager.cc:1950] T a4756dc189dc482db744ea709cd7e1ac P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.562640 15386 raft_consensus.cc:2243] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.562765 15386 raft_consensus.cc:2272] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.562882 15369 raft_consensus.cc:359] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.562994 15369 raft_consensus.cc:385] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.563033 15369 raft_consensus.cc:740] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.563043 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet a4756dc189dc482db744ea709cd7e1ac (table default.Table_4432a7d6e8ba46c788f385420ff319d2 [id=d9086af440904392ab2cd7e0fc9a95de]) successfully deleted
I20251025 08:02:23.563146 15369 consensus_queue.cc:260] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.563371 15369 ts_tablet_manager.cc:1434] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:23.563374 15386 ts_tablet_manager.cc:1916] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.563470 15370 tablet_bootstrap.cc:492] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.563550 15369 tablet_bootstrap.cc:492] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.564441 15369 tablet_bootstrap.cc:654] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.564440 15370 tablet_bootstrap.cc:654] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.564566 15385 tablet_replica.cc:333] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.564670 15385 raft_consensus.cc:2243] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.564754 15385 pending_rounds.cc:70] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 2 pending ops.
I20251025 08:02:23.564786 15385 pending_rounds.cc:77] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7214609790743244800 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "af15eb3890ab43fb878d1c90ce58c4d9" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a" dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" new_extra_config { } }
I20251025 08:02:23.564973 15385 pending_rounds.cc:77] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609790410387456 op_type: NO_OP noop_request { }
I20251025 08:02:23.565028 15385 raft_consensus.cc:2889] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:23.565075 15385 raft_consensus.cc:2272] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.565737 15386 ts_tablet_manager.cc:1929] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.565850 15386 log.cc:1199] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/634a93b40b7c49c799b711bf7ac36eb2
I20251025 08:02:23.565891 15385 ts_tablet_manager.cc:1916] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.566226 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 9173c34b9e5e4bbc942f5a85cf1d6921 (table default.Table_91841dad53c7476e8a7abe6417dc353b [id=236cf2edc31b487988d3b53016611c9c]) successfully deleted
I20251025 08:02:23.566417 15376 raft_consensus.cc:493] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.566485 15376 raft_consensus.cc:515] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.566824 15376 leader_election.cc:290] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.567148 15445 raft_consensus.cc:493] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.567178 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd03eb08d0e54427a4709a4de4c4796c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.567222 15445 raft_consensus.cc:515] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.567510 15445 leader_election.cc:290] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:23.567512 15048 leader_election.cc:343] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.567590 15385 ts_tablet_manager.cc:1929] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:23.567653 15385 log.cc:1199] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/af15eb3890ab43fb878d1c90ce58c4d9
I20251025 08:02:23.567812 15245 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "634a93b40b7c49c799b711bf7ac36eb2" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.567875 15385 ts_tablet_manager.cc:1950] T af15eb3890ab43fb878d1c90ce58c4d9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
W20251025 08:02:23.568010 14915 leader_election.cc:343] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 634a93b40b7c49c799b711bf7ac36eb2
I20251025 08:02:23.567821 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd03eb08d0e54427a4709a4de4c4796c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:23.568229 14914 leader_election.cc:343] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: Tablet not RUNNING: STOPPED
I20251025 08:02:23.568284 14914 leader_election.cc:304] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:23.568357 14650 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 7a11af785ca64f83bfd1038fb37420de (table default.Table_c0d0d3b2524e416293ac368e8d6d4598 [id=29a1ac5b34e84405ad2a34bd49ea9997]). Expected version 1 got 0
I20251025 08:02:23.568408 15385 tablet_replica.cc:333] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.568459 15445 raft_consensus.cc:2749] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:23.568476 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet af15eb3890ab43fb878d1c90ce58c4d9 (table default.Table_f61e6237a71d467ab5a0cdb0a07aaa4a [id=aaba8249763b4fd4a98cdcc11d05ad19]) successfully deleted
I20251025 08:02:23.568516 15385 raft_consensus.cc:2243] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.568599 15385 raft_consensus.cc:2272] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.567862 15386 ts_tablet_manager.cc:1950] T 634a93b40b7c49c799b711bf7ac36eb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:23.568831 15049 leader_election.cc:343] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.568902 15049 leader_election.cc:304] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:23.568956 15385 ts_tablet_manager.cc:1916] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.569192 15376 raft_consensus.cc:2749] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:23.569514 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 634a93b40b7c49c799b711bf7ac36eb2 (table default.Table_8d5d70ca9382482e848e7111f5c93aa9 [id=49b9829b389140a5b7f81f6fc6025cd8]) successfully deleted
I20251025 08:02:23.569792 15386 tablet_replica.cc:333] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.569929 15386 raft_consensus.cc:2243] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.570093 15386 raft_consensus.cc:2272] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.570381 15370 tablet_bootstrap.cc:492] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.570464 15370 ts_tablet_manager.cc:1403] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251025 08:02:23.570583 15386 ts_tablet_manager.cc:1916] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.570668 15385 ts_tablet_manager.cc:1929] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.570734 15385 log.cc:1199] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/634a93b40b7c49c799b711bf7ac36eb2
I20251025 08:02:23.570919 15385 ts_tablet_manager.cc:1950] T 634a93b40b7c49c799b711bf7ac36eb2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.570953 15370 raft_consensus.cc:359] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.571072 15370 raft_consensus.cc:385] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.571115 15370 raft_consensus.cc:740] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.571265 15370 consensus_queue.cc:260] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.571285 15437 tablet.cc:1722] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:23.572489 15370 ts_tablet_manager.cc:1434] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.572605 15386 ts_tablet_manager.cc:1929] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.572706 15386 log.cc:1199] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/a8a0e61768d8417ea2d7b3d53fa6638b
I20251025 08:02:23.572940 15386 ts_tablet_manager.cc:1950] T a8a0e61768d8417ea2d7b3d53fa6638b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.573343 15376 raft_consensus.cc:493] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.573421 15376 raft_consensus.cc:515] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.573485 15386 tablet_replica.cc:333] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.573561 14646 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 962889388a40485bb61b3b47e3ad3d43 (table default.Table_54c4c19e5587477babf6db604ddc60b9 [id=394a1e6daa8f42f4a69517cb60a9a935]). Expected version 2 got 0
I20251025 08:02:23.573662 15386 raft_consensus.cc:2243] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:23.573755 15376 leader_election.cc:290] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.573802 15386 raft_consensus.cc:2272] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:23.573833 14646 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet 962889388a40485bb61b3b47e3ad3d43 (table default.Table_54c4c19e5587477babf6db604ddc60b9 [id=394a1e6daa8f42f4a69517cb60a9a935], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 962889388a40485bb61b3b47e3ad3d43 consensus state has no leader
I20251025 08:02:23.573942 15451 tablet.cc:1722] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:23.574920 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet a8a0e61768d8417ea2d7b3d53fa6638b (table default.Table_6c87b1a9e21b4dd8bc08c733cdd1e304 [id=9922f64110ca4506bc2d3454cb7a297f]) successfully deleted
I20251025 08:02:23.575137 14647 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_72984ef4c9b74b0984cf6243e4c63305"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.575367 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_379cbae6c8254ecbbfeed7293dc9dd89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.575505 14647 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72984ef4c9b74b0984cf6243e4c63305 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.575517 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 634a93b40b7c49c799b711bf7ac36eb2 (table default.Table_8d5d70ca9382482e848e7111f5c93aa9 [id=49b9829b389140a5b7f81f6fc6025cd8]) successfully deleted
W20251025 08:02:23.575659 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_379cbae6c8254ecbbfeed7293dc9dd89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.576234 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d890847f8634b869d9958519c6d2b8c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.576344 15246 raft_consensus.cc:2468] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:23.576655 15049 leader_election.cc:304] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.576788 15376 raft_consensus.cc:2804] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.576826 15376 raft_consensus.cc:493] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.576860 15376 raft_consensus.cc:3060] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.577800 15376 raft_consensus.cc:515] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.578069 15376 leader_election.cc:290] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.578998 14651 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 962889388a40485bb61b3b47e3ad3d43 (table default.Table_54c4c19e5587477babf6db604ddc60b9 [id=394a1e6daa8f42f4a69517cb60a9a935]). Expected version 2 got 0
I20251025 08:02:23.579531 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d890847f8634b869d9958519c6d2b8c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:23.579629 14979 raft_consensus.cc:3060] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.580442 14979 raft_consensus.cc:2468] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:23.580945 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d890847f8634b869d9958519c6d2b8c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:23.581044 15246 raft_consensus.cc:3060] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.581933 15246 raft_consensus.cc:2468] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:23.582232 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d890847f8634b869d9958519c6d2b8c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.582171 14651 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_8184815f748f4644ae04b4927d72b27b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.582320 14978 raft_consensus.cc:2376] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1. Re-sending same reply.
W20251025 08:02:23.582530 14651 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8184815f748f4644ae04b4927d72b27b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.582952 15048 leader_election.cc:304] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:23.583210 15376 raft_consensus.cc:2804] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.583303 15376 raft_consensus.cc:697] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:23.583426 15376 consensus_queue.cc:237] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.585131 15372 tablet_bootstrap.cc:492] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.585208 15372 ts_tablet_manager.cc:1403] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.038s user 0.001s sys 0.000s
I20251025 08:02:23.585527 14650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_61b65da9fa07408e88597c52bf6358d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.585662 15372 raft_consensus.cc:359] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.585749 15372 raft_consensus.cc:385] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.585779 15372 raft_consensus.cc:740] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
W20251025 08:02:23.585835 14650 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61b65da9fa07408e88597c52bf6358d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.585881 15372 consensus_queue.cc:260] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.586146 15372 ts_tablet_manager.cc:1434] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.586336 15372 tablet_bootstrap.cc:492] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.587280 15372 tablet_bootstrap.cc:654] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.587750 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 6dbf9c53df494216865ac4631fd48af4 (DEFAULT_TABLE table=default.Table_379cbae6c8254ecbbfeed7293dc9dd89 [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.588025 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dbf9c53df494216865ac4631fd48af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.589558 15369 tablet_bootstrap.cc:492] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.589625 15369 ts_tablet_manager.cc:1403] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.001s
I20251025 08:02:23.589615 15386 ts_tablet_manager.cc:1916] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.590044 15369 raft_consensus.cc:359] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.590129 15369 raft_consensus.cc:385] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.590158 15369 raft_consensus.cc:740] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.590283 15369 consensus_queue.cc:260] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.590528 15369 ts_tablet_manager.cc:1434] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.590541 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 6dbf9c53df494216865ac4631fd48af4 (DEFAULT_TABLE table=default.Table_379cbae6c8254ecbbfeed7293dc9dd89 [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.590678 15369 tablet_bootstrap.cc:492] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.590761 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dbf9c53df494216865ac4631fd48af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.591590 15369 tablet_bootstrap.cc:654] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.592464 15386 ts_tablet_manager.cc:1929] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:23.592525 15386 log.cc:1199] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/5f9b311ee33a42d5a1c1d8b41576bb54
I20251025 08:02:23.592772 15370 tablet_bootstrap.cc:492] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.593153 15384 raft_consensus.cc:493] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.593255 15385 tablet_replica.cc:333] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.593240 15384 raft_consensus.cc:515] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.593508 15386 ts_tablet_manager.cc:1950] T 5f9b311ee33a42d5a1c1d8b41576bb54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.593544 15384 leader_election.cc:290] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.593724 15370 tablet_bootstrap.cc:654] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:23.594489 15185 leader_election.cc:343] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: bd9cc001437c42739ca7f9f2601b06b4
I20251025 08:02:23.594758 14649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_df35e9b11c6c43859e7b3511585c665b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.595037 14649 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df35e9b11c6c43859e7b3511585c665b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.595050 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 6dbf9c53df494216865ac4631fd48af4 (DEFAULT_TABLE table=default.Table_379cbae6c8254ecbbfeed7293dc9dd89 [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.595297 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dbf9c53df494216865ac4631fd48af4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.595256 14647 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_d29e190e7c9b4da8b3f4d850a916123c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.595526 14647 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d29e190e7c9b4da8b3f4d850a916123c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:23.596441 15183 leader_election.cc:343] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: bd9cc001437c42739ca7f9f2601b06b4
I20251025 08:02:23.596495 15183 leader_election.cc:304] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:23.597011 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_6bcd200b1a5d4638b8d996bd7f3c35cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.597105 15384 raft_consensus.cc:2749] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:23.597088 14641 catalog_manager.cc:5058] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): alter failed for tablet 5f9b311ee33a42d5a1c1d8b41576bb54 (table default.Table_54c4c19e5587477babf6db604ddc60b9 [id=394a1e6daa8f42f4a69517cb60a9a935]),no further retry: Not found: Tablet not found: 5f9b311ee33a42d5a1c1d8b41576bb54
W20251025 08:02:23.597307 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6bcd200b1a5d4638b8d996bd7f3c35cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.597842 15372 tablet_bootstrap.cc:492] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.597911 15372 ts_tablet_manager.cc:1403] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20251025 08:02:23.598114 15386 tablet_replica.cc:333] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.598546 15386 raft_consensus.cc:2243] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.598635 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 5f9b311ee33a42d5a1c1d8b41576bb54 (table default.Table_54c4c19e5587477babf6db604ddc60b9 [id=394a1e6daa8f42f4a69517cb60a9a935]) successfully deleted
I20251025 08:02:23.598675 15386 raft_consensus.cc:2272] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.598346 15372 raft_consensus.cc:359] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.598814 15372 raft_consensus.cc:385] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.598856 15372 raft_consensus.cc:740] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.598980 15372 consensus_queue.cc:260] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.599098 14646 catalog_manager.cc:5649] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:23.599251 15372 ts_tablet_manager.cc:1434] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.599288 14646 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 2d890847f8634b869d9958519c6d2b8c (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]). Expected version 1 got 0
I20251025 08:02:23.599327 15386 ts_tablet_manager.cc:1916] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.599408 15372 tablet_bootstrap.cc:492] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.599478 15370 tablet_bootstrap.cc:492] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.599538 15370 ts_tablet_manager.cc:1403] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20251025 08:02:23.599897 15092 tablet_service.cc:1505] Processing CreateTablet for tablet ce9455c9180c457394725dcf277fb4a2 (DEFAULT_TABLE table=default.Table_8184815f748f4644ae04b4927d72b27b [id=215b7ed86cf7422b826890834307b839]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.599941 15370 raft_consensus.cc:359] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.600039 15370 raft_consensus.cc:385] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.600069 15370 raft_consensus.cc:740] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.600131 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9455c9180c457394725dcf277fb4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.600181 15370 consensus_queue.cc:260] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.600431 15370 ts_tablet_manager.cc:1434] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:23.600498 15372 tablet_bootstrap.cc:654] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.601868 15228 tablet_service.cc:1505] Processing CreateTablet for tablet ce9455c9180c457394725dcf277fb4a2 (DEFAULT_TABLE table=default.Table_8184815f748f4644ae04b4927d72b27b [id=215b7ed86cf7422b826890834307b839]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.602105 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9455c9180c457394725dcf277fb4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.602383 15092 tablet_service.cc:1505] Processing CreateTablet for tablet c9da5f06aa7d41be80cb9571635f367b (DEFAULT_TABLE table=default.Table_72984ef4c9b74b0984cf6243e4c63305 [id=587ddc6547de445bb8a4ef96e02c3108]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.602581 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9da5f06aa7d41be80cb9571635f367b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.603850 15224 tablet_service.cc:1505] Processing CreateTablet for tablet c9da5f06aa7d41be80cb9571635f367b (DEFAULT_TABLE table=default.Table_72984ef4c9b74b0984cf6243e4c63305 [id=587ddc6547de445bb8a4ef96e02c3108]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.604025 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9da5f06aa7d41be80cb9571635f367b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.593367 15385 raft_consensus.cc:2243] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.604096 15445 raft_consensus.cc:493] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.604158 15445 raft_consensus.cc:515] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.602634 14955 tablet_service.cc:1505] Processing CreateTablet for tablet ce9455c9180c457394725dcf277fb4a2 (DEFAULT_TABLE table=default.Table_8184815f748f4644ae04b4927d72b27b [id=215b7ed86cf7422b826890834307b839]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.604426 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce9455c9180c457394725dcf277fb4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.604516 15445 leader_election.cc:290] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.603107 14958 tablet_service.cc:1505] Processing CreateTablet for tablet c9da5f06aa7d41be80cb9571635f367b (DEFAULT_TABLE table=default.Table_72984ef4c9b74b0984cf6243e4c63305 [id=587ddc6547de445bb8a4ef96e02c3108]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.605010 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9da5f06aa7d41be80cb9571635f367b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.604142 15385 raft_consensus.cc:2272] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.606585 15385 ts_tablet_manager.cc:1916] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.606683 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f7a26c306f748aea3ccd888b95ebc67" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.606781 15246 raft_consensus.cc:2468] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:23.607036 14914 leader_election.cc:304] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.607287 15445 raft_consensus.cc:2804] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.607342 15445 raft_consensus.cc:493] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.607376 15445 raft_consensus.cc:3060] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.607758 15370 tablet_bootstrap.cc:492] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.608441 15445 raft_consensus.cc:515] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.608807 15445 leader_election.cc:290] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.608912 15385 ts_tablet_manager.cc:1929] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.608973 15385 log.cc:1199] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/9173c34b9e5e4bbc942f5a85cf1d6921
I20251025 08:02:23.608955 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f7a26c306f748aea3ccd888b95ebc67" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:23.609066 15114 raft_consensus.cc:2468] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:23.609126 15370 tablet_bootstrap.cc:654] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.609169 15385 ts_tablet_manager.cc:1950] T 9173c34b9e5e4bbc942f5a85cf1d6921 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.609719 15385 tablet_replica.cc:333] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.609814 15385 raft_consensus.cc:2243] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.609894 15385 raft_consensus.cc:2272] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.610023 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f7a26c306f748aea3ccd888b95ebc67" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:23.610122 15114 raft_consensus.cc:3060] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.610558 15385 ts_tablet_manager.cc:1916] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.610576 15370 tablet_bootstrap.cc:492] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.610656 15370 ts_tablet_manager.cc:1403] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20251025 08:02:23.610965 15114 raft_consensus.cc:2468] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:23.611131 15370 raft_consensus.cc:359] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.611224 15370 raft_consensus.cc:385] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.611263 15370 raft_consensus.cc:740] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.598778 15369 tablet_bootstrap.cc:492] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.611380 15369 ts_tablet_manager.cc:1403] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20251025 08:02:23.611374 15370 consensus_queue.cc:260] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.611565 15386 ts_tablet_manager.cc:1929] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.611613 15370 ts_tablet_manager.cc:1434] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.611631 15386 log.cc:1199] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/bd9cc001437c42739ca7f9f2601b06b4
I20251025 08:02:23.611761 15370 tablet_bootstrap.cc:492] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.611824 15386 ts_tablet_manager.cc:1950] T bd9cc001437c42739ca7f9f2601b06b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.611816 15369 raft_consensus.cc:359] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.611914 15369 raft_consensus.cc:385] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.611953 15369 raft_consensus.cc:740] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.612053 15369 consensus_queue.cc:260] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.612303 15369 ts_tablet_manager.cc:1434] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.612486 15369 tablet_bootstrap.cc:492] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.612648 15370 tablet_bootstrap.cc:654] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.612939 15385 ts_tablet_manager.cc:1929] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:23.612998 15385 log.cc:1199] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/5f9b311ee33a42d5a1c1d8b41576bb54
I20251025 08:02:23.613227 15385 ts_tablet_manager.cc:1950] T 5f9b311ee33a42d5a1c1d8b41576bb54 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.613312 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f7a26c306f748aea3ccd888b95ebc67" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:23.613408 15246 raft_consensus.cc:3060] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.613565 15369 tablet_bootstrap.cc:654] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.614217 15246 raft_consensus.cc:2468] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:23.614439 15369 tablet_bootstrap.cc:492] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.614502 15369 ts_tablet_manager.cc:1403] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.614557 14915 leader_election.cc:304] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:23.614722 15374 raft_consensus.cc:2804] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.614801 15374 raft_consensus.cc:697] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:23.614851 15369 raft_consensus.cc:359] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.614926 15369 raft_consensus.cc:385] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.614903 15374 consensus_queue.cc:237] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.614951 15369 raft_consensus.cc:740] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.615065 15369 consensus_queue.cc:260] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.615281 15369 ts_tablet_manager.cc:1434] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.615422 15369 tablet_bootstrap.cc:492] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.615590 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 9173c34b9e5e4bbc942f5a85cf1d6921 (table default.Table_91841dad53c7476e8a7abe6417dc353b [id=236cf2edc31b487988d3b53016611c9c]) successfully deleted
I20251025 08:02:23.615617 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet bd9cc001437c42739ca7f9f2601b06b4 (table default.Table_64165815498b473ebf6f4232ff8e398e [id=d242b571804f4a3d8544dc85dfa3ec78]) successfully deleted
I20251025 08:02:23.615710 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 5f9b311ee33a42d5a1c1d8b41576bb54 (table default.Table_54c4c19e5587477babf6db604ddc60b9 [id=394a1e6daa8f42f4a69517cb60a9a935]) successfully deleted
I20251025 08:02:23.615927 15370 tablet_bootstrap.cc:492] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.615990 15370 ts_tablet_manager.cc:1403] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:23.616266 15369 tablet_bootstrap.cc:654] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.616353 15370 raft_consensus.cc:359] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.616434 15370 raft_consensus.cc:385] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.616462 15370 raft_consensus.cc:740] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.617125 15370 consensus_queue.cc:260] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.617419 15370 ts_tablet_manager.cc:1434] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.617837 15407 hybrid_clock.cc:648] HybridClock initialized: now 1761379343597859 us; error 20017 us; skew 500 ppm
I20251025 08:02:23.618297 15372 tablet_bootstrap.cc:492] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.618369 15372 ts_tablet_manager.cc:1403] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20251025 08:02:23.619112 15114 raft_consensus.cc:1275] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:23.620409 15407 webserver.cc:492] Webserver started at http://127.14.70.60:39233/ using document root <none> and password file <none>
I20251025 08:02:23.621155 15407 fs_manager.cc:362] Metadata directory not provided
I20251025 08:02:23.621239 15407 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251025 08:02:23.622035 15246 raft_consensus.cc:1275] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:23.622249 15445 consensus_queue.cc:1048] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:23.623488 15445 consensus_queue.cc:1048] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:23.624090 14654 catalog_manager.cc:5649] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:23.624684 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 80518db725264459a5d56b32f61ff9f8 (DEFAULT_TABLE table=default.Table_61b65da9fa07408e88597c52bf6358d6 [id=2421416ff90d4fe4977a03bce3048815]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.624886 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80518db725264459a5d56b32f61ff9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.627812 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 80518db725264459a5d56b32f61ff9f8 (DEFAULT_TABLE table=default.Table_61b65da9fa07408e88597c52bf6358d6 [id=2421416ff90d4fe4977a03bce3048815]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.628068 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80518db725264459a5d56b32f61ff9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.630664 15451 tablet.cc:1722] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:23.630703 14646 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 5b4028f5238f4c428648893618587a37 (table default.Table_299767dfd96a4890bd29ca0bb43b79aa [id=5f9d1d9d2f904f94b00324cca656cb17]). Expected version 2 got 0
I20251025 08:02:23.630955 15370 tablet_bootstrap.cc:492] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.631194 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 80518db725264459a5d56b32f61ff9f8 (DEFAULT_TABLE table=default.Table_61b65da9fa07408e88597c52bf6358d6 [id=2421416ff90d4fe4977a03bce3048815]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.631402 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80518db725264459a5d56b32f61ff9f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.631668 14647 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 5b4028f5238f4c428648893618587a37 (table default.Table_299767dfd96a4890bd29ca0bb43b79aa [id=5f9d1d9d2f904f94b00324cca656cb17]). Expected version 2 got 0
I20251025 08:02:23.632249 15370 tablet_bootstrap.cc:654] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.632601 15372 raft_consensus.cc:359] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.632685 15372 raft_consensus.cc:385] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.632714 15372 raft_consensus.cc:740] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.632803 15372 consensus_queue.cc:260] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.635201 14647 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_9ac23f3df59f4cc4b2584f5332b7403d" } new_table_name: "default.Table_0046658bb1c6486da44cf4f7da540d34" modify_external_catalogs: true
I20251025 08:02:23.636384 15370 tablet_bootstrap.cc:492] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.636461 15370 ts_tablet_manager.cc:1403] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251025 08:02:23.636773 14649 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_c0d0d3b2524e416293ac368e8d6d4598" } new_table_name: "default.Table_4e764c9b1b9d4238b6df2a23c9c3ef34" modify_external_catalogs: true
I20251025 08:02:23.636868 15370 raft_consensus.cc:359] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.636966 15370 raft_consensus.cc:385] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.636997 15370 raft_consensus.cc:740] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.636958 14650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_beb1f6ec236e4f3b96df6b5201581c79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.637125 15370 consensus_queue.cc:260] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:23.637226 14650 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_beb1f6ec236e4f3b96df6b5201581c79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.637428 15370 ts_tablet_manager.cc:1434] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.637843 14653 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_c29917b4373041a286808bfe8836b9cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.638177 14653 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c29917b4373041a286808bfe8836b9cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.638231 14648 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_6bcd200b1a5d4638b8d996bd7f3c35cb" } new_table_name: "default.Table_2bc36ab5489746d9a1ed6e69965a4e17" modify_external_catalogs: true
I20251025 08:02:23.638438 15369 tablet_bootstrap.cc:492] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.638505 15369 ts_tablet_manager.cc:1403] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.001s
I20251025 08:02:23.638890 14651 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_6c87b1a9e21b4dd8bc08c733cdd1e304" } new_table_name: "default.Table_bc4af92ab72c4a9a92d850a89056986c" modify_external_catalogs: true
I20251025 08:02:23.638917 15369 raft_consensus.cc:359] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.638996 15369 raft_consensus.cc:385] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.639021 15369 raft_consensus.cc:740] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.639019 15436 tablet.cc:1722] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:23.639119 15369 consensus_queue.cc:260] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.638859 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_f34d90f304ae4c5091f5a1bed946bf11"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.639381 15369 ts_tablet_manager.cc:1434] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20251025 08:02:23.639423 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f34d90f304ae4c5091f5a1bed946bf11 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.639535 15369 tablet_bootstrap.cc:492] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.640378 15369 tablet_bootstrap.cc:654] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.642019 15407 fs_manager.cc:714] Time spent opening directory manager: real 0.018s user 0.003s sys 0.000s
I20251025 08:02:23.643352 14652 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 5b4028f5238f4c428648893618587a37 (table default.Table_299767dfd96a4890bd29ca0bb43b79aa [id=5f9d1d9d2f904f94b00324cca656cb17]). Expected version 2 got 0
I20251025 08:02:23.644825 15372 ts_tablet_manager.cc:1434] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.026s user 0.001s sys 0.000s
I20251025 08:02:23.645119 15372 tablet_bootstrap.cc:492] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.646111 15487 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
W20251025 08:02:23.646916 14649 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7a11af785ca64f83bfd1038fb37420de consensus state has no leader
I20251025 08:02:23.646951 15372 tablet_bootstrap.cc:654] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.647421 15407 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20251025 08:02:23.647521 15407 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data,/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/wal
uuid: "7109d31951574de3bf05a86c94c11d21"
format_stamp: "Formatted at 2025-10-25 08:02:21 on dist-test-slave-2g2p"
I20251025 08:02:23.647909 15372 tablet_bootstrap.cc:492] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.647979 15372 ts_tablet_manager.cc:1403] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:23.647962 15407 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251025 08:02:23.648394 15372 raft_consensus.cc:359] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.648475 15372 raft_consensus.cc:385] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.648504 15372 raft_consensus.cc:740] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.648598 15372 consensus_queue.cc:260] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.648908 15437 tablet.cc:1722] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:23.649276 15372 ts_tablet_manager.cc:1434] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.649449 15372 tablet_bootstrap.cc:492] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.650503 15372 tablet_bootstrap.cc:654] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.651551 14652 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_72984ef4c9b74b0984cf6243e4c63305" } modify_external_catalogs: true
I20251025 08:02:23.651649 14652 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_72984ef4c9b74b0984cf6243e4c63305" } modify_external_catalogs: true
I20251025 08:02:23.651665 14647 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_c6730a6d2f5b41a2ad960456bb50184f" } modify_external_catalogs: true
I20251025 08:02:23.651754 14647 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_c6730a6d2f5b41a2ad960456bb50184f" } modify_external_catalogs: true
I20251025 08:02:23.651252 14654 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_299767dfd96a4890bd29ca0bb43b79aa [id=5f9d1d9d2f904f94b00324cca656cb17] alter complete (version 2)
I20251025 08:02:23.651913 14649 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_54c4c19e5587477babf6db604ddc60b9" } new_table_name: "default.Table_9b93bef6a94b445180bc909f9a07cdb4" modify_external_catalogs: true
I20251025 08:02:23.652086 14654 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_4432a7d6e8ba46c788f385420ff319d2" } modify_external_catalogs: true
I20251025 08:02:23.652155 14654 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_4432a7d6e8ba46c788f385420ff319d2" } modify_external_catalogs: true
I20251025 08:02:23.653790 15451 tablet.cc:1717] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2: Skipping requested alter to schema version 2, tablet already version 2
I20251025 08:02:23.654965 15369 tablet_bootstrap.cc:492] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.655037 15369 ts_tablet_manager.cc:1403] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20251025 08:02:23.655436 15369 raft_consensus.cc:359] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.655517 15369 raft_consensus.cc:385] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.655545 15369 raft_consensus.cc:740] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.655634 15369 consensus_queue.cc:260] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.655853 15369 ts_tablet_manager.cc:1434] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.655997 15369 tablet_bootstrap.cc:492] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.656424 15437 tablet.cc:1717] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Skipping requested alter to schema version 2, tablet already version 2
I20251025 08:02:23.656970 15369 tablet_bootstrap.cc:654] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.659754 15436 tablet.cc:1722] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:23.659922 15437 tablet.cc:1722] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:23.659989 15451 tablet.cc:1722] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
W20251025 08:02:23.666081 14651 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cd03eb08d0e54427a4709a4de4c4796c consensus state has no leader
I20251025 08:02:23.667428 14655 master_service.cc:954] ReplaceTablet: received request to replace tablet 7a11af785ca64f83bfd1038fb37420de from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.667424 14651 master_service.cc:954] ReplaceTablet: received request to replace tablet ce9455c9180c457394725dcf277fb4a2 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.668798 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 (DEFAULT_TABLE table=default.Table_df35e9b11c6c43859e7b3511585c665b [id=e8f1b9d591bb4f8fbbb05ee960280cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.669018 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.668975 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 289e3ff2a6be4daaadcac6fe492117c9 (DEFAULT_TABLE table=default.Table_d29e190e7c9b4da8b3f4d850a916123c [id=69c97a171f1e480ba9faf62bacc1ec38]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.668819 15224 tablet_service.cc:1505] Processing CreateTablet for tablet f637313389174f729f784974fc2f94b9 (DEFAULT_TABLE table=default.Table_6bcd200b1a5d4638b8d996bd7f3c35cb [id=943ad581ce2d43b39ecafee069537b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.669207 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289e3ff2a6be4daaadcac6fe492117c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.669406 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 (DEFAULT_TABLE table=default.Table_df35e9b11c6c43859e7b3511585c665b [id=e8f1b9d591bb4f8fbbb05ee960280cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.669605 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 289e3ff2a6be4daaadcac6fe492117c9 (DEFAULT_TABLE table=default.Table_d29e190e7c9b4da8b3f4d850a916123c [id=69c97a171f1e480ba9faf62bacc1ec38]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.669839 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f637313389174f729f784974fc2f94b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.671236 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 (DEFAULT_TABLE table=default.Table_df35e9b11c6c43859e7b3511585c665b [id=e8f1b9d591bb4f8fbbb05ee960280cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.671443 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.669615 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.673277 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289e3ff2a6be4daaadcac6fe492117c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.673331 15370 tablet_bootstrap.cc:492] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.673452 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 289e3ff2a6be4daaadcac6fe492117c9 (DEFAULT_TABLE table=default.Table_d29e190e7c9b4da8b3f4d850a916123c [id=69c97a171f1e480ba9faf62bacc1ec38]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.673668 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 289e3ff2a6be4daaadcac6fe492117c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.674153 15370 tablet_bootstrap.cc:654] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.674346 15369 tablet_bootstrap.cc:492] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.674417 15369 ts_tablet_manager.cc:1403] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20251025 08:02:23.674654 15376 raft_consensus.cc:493] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.674719 15376 raft_consensus.cc:515] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.674852 15369 raft_consensus.cc:359] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.674930 15369 raft_consensus.cc:385] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.674955 15369 raft_consensus.cc:740] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.675033 15376 leader_election.cc:290] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.675659 15369 consensus_queue.cc:260] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.675778 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "80518db725264459a5d56b32f61ff9f8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.676156 14955 tablet_service.cc:1505] Processing CreateTablet for tablet f637313389174f729f784974fc2f94b9 (DEFAULT_TABLE table=default.Table_6bcd200b1a5d4638b8d996bd7f3c35cb [id=943ad581ce2d43b39ecafee069537b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.676373 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f637313389174f729f784974fc2f94b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.676384 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "80518db725264459a5d56b32f61ff9f8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:23.676420 15048 leader_election.cc:343] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:23.676666 15049 leader_election.cc:343] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.676731 15049 leader_election.cc:304] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:23.676731 15369 ts_tablet_manager.cc:1434] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.676895 15376 raft_consensus.cc:2749] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:23.677008 15369 tablet_bootstrap.cc:492] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:23.678073 14648 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f637313389174f729f784974fc2f94b9 consensus state has no leader
I20251025 08:02:23.678234 15376 raft_consensus.cc:493] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.678297 15376 raft_consensus.cc:515] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.678471 15092 tablet_service.cc:1505] Processing CreateTablet for tablet f637313389174f729f784974fc2f94b9 (DEFAULT_TABLE table=default.Table_6bcd200b1a5d4638b8d996bd7f3c35cb [id=943ad581ce2d43b39ecafee069537b6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.678598 15376 leader_election.cc:290] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:23.678661 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f637313389174f729f784974fc2f94b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.679160 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9da5f06aa7d41be80cb9571635f367b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:23.679437 15048 leader_election.cc:343] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.679826 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9da5f06aa7d41be80cb9571635f367b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:23.680210 15049 leader_election.cc:343] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.680279 15049 leader_election.cc:304] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:23.680392 15376 raft_consensus.cc:2749] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:23.680581 14649 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 962889388a40485bb61b3b47e3ad3d43 consensus state has no leader
I20251025 08:02:23.680733 14649 master_service.cc:954] ReplaceTablet: received request to replace tablet c9da5f06aa7d41be80cb9571635f367b from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.681166 14646 master_service.cc:954] ReplaceTablet: received request to replace tablet 36d07fdd83204e01933862285ce4a539 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.681288 14648 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet cd03eb08d0e54427a4709a4de4c4796c (table default.Table_bc4af92ab72c4a9a92d850a89056986c [id=9922f64110ca4506bc2d3454cb7a297f]). Expected version 1 got 0
I20251025 08:02:23.681507 14654 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 36d07fdd83204e01933862285ce4a539
I20251025 08:02:23.682034 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 36d07fdd83204e01933862285ce4a539 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.682166 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 36d07fdd83204e01933862285ce4a539 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.682293 15385 tablet_replica.cc:333] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.682309 15388 tablet_replica.cc:333] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.682387 15385 raft_consensus.cc:2243] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.682400 15388 raft_consensus.cc:2243] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.682468 15388 raft_consensus.cc:2272] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.682468 15385 raft_consensus.cc:2272] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.682770 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 36d07fdd83204e01933862285ce4a539 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.682825 15385 ts_tablet_manager.cc:1916] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.682825 15388 ts_tablet_manager.cc:1916] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.683099 15386 tablet_replica.cc:333] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.683212 15386 raft_consensus.cc:2243] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.683341 15386 raft_consensus.cc:2272] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.683456 15369 tablet_bootstrap.cc:654] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.683794 14654 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 962889388a40485bb61b3b47e3ad3d43 (table default.Table_9b93bef6a94b445180bc909f9a07cdb4 [id=394a1e6daa8f42f4a69517cb60a9a935]). Expected version 3 got 0
I20251025 08:02:23.683895 14654 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet cd03eb08d0e54427a4709a4de4c4796c (table default.Table_bc4af92ab72c4a9a92d850a89056986c [id=9922f64110ca4506bc2d3454cb7a297f]). Expected version 1 got 0
I20251025 08:02:23.684835 15385 ts_tablet_manager.cc:1929] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.684897 15385 log.cc:1199] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/36d07fdd83204e01933862285ce4a539
I20251025 08:02:23.685050 15388 ts_tablet_manager.cc:1929] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.685106 15385 ts_tablet_manager.cc:1950] T 36d07fdd83204e01933862285ce4a539 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.685108 15388 log.cc:1199] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/36d07fdd83204e01933862285ce4a539
I20251025 08:02:23.685284 15388 ts_tablet_manager.cc:1950] T 36d07fdd83204e01933862285ce4a539 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.685730 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 36d07fdd83204e01933862285ce4a539 (table default.Table_4432a7d6e8ba46c788f385420ff319d2 [id=d9086af440904392ab2cd7e0fc9a95de]) successfully deleted
I20251025 08:02:23.685874 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 36d07fdd83204e01933862285ce4a539 (table default.Table_4432a7d6e8ba46c788f385420ff319d2 [id=d9086af440904392ab2cd7e0fc9a95de]) successfully deleted
I20251025 08:02:23.686082 15386 ts_tablet_manager.cc:1916] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.686390 14647 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 297960b7d4dc4af181c05e79ad62a941
I20251025 08:02:23.687908 15386 ts_tablet_manager.cc:1929] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.687983 15386 log.cc:1199] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/36d07fdd83204e01933862285ce4a539
I20251025 08:02:23.688148 15386 ts_tablet_manager.cc:1950] T 36d07fdd83204e01933862285ce4a539 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.688170 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 297960b7d4dc4af181c05e79ad62a941 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.688673 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 36d07fdd83204e01933862285ce4a539 (table default.Table_4432a7d6e8ba46c788f385420ff319d2 [id=d9086af440904392ab2cd7e0fc9a95de]) successfully deleted
I20251025 08:02:23.688741 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 297960b7d4dc4af181c05e79ad62a941 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.688872 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 297960b7d4dc4af181c05e79ad62a941 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.689002 15388 tablet_replica.cc:333] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.689088 15388 raft_consensus.cc:2243] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.689167 15388 raft_consensus.cc:2272] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:23.689587 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 297960b7d4dc4af181c05e79ad62a941 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 297960b7d4dc4af181c05e79ad62a941 already in progress: creating tablet
I20251025 08:02:23.689760 14651 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet ce9455c9180c457394725dcf277fb4a2
I20251025 08:02:23.689882 14655 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 7a11af785ca64f83bfd1038fb37420de
I20251025 08:02:23.689975 14651 catalog_manager.cc:6719] ReplaceTablet: tablet ce9455c9180c457394725dcf277fb4a2 deleted and replaced by tablet f2d7e4ad8c2f4915b721b77846cfc3cb
I20251025 08:02:23.690079 14655 catalog_manager.cc:6719] ReplaceTablet: tablet 7a11af785ca64f83bfd1038fb37420de deleted and replaced by tablet 0e09fa674c21442cbecdbe1ecbe24359
I20251025 08:02:23.690486 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet ce9455c9180c457394725dcf277fb4a2 with delete_type TABLET_DATA_DELETED (replaced by tablet f2d7e4ad8c2f4915b721b77846cfc3cb) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.690518 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 7a11af785ca64f83bfd1038fb37420de with delete_type TABLET_DATA_DELETED (replaced by tablet 0e09fa674c21442cbecdbe1ecbe24359) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.690613 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet ce9455c9180c457394725dcf277fb4a2 with delete_type TABLET_DATA_DELETED (replaced by tablet f2d7e4ad8c2f4915b721b77846cfc3cb) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.690711 14652 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet c9da5f06aa7d41be80cb9571635f367b
I20251025 08:02:23.690734 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 7a11af785ca64f83bfd1038fb37420de with delete_type TABLET_DATA_DELETED (replaced by tablet 0e09fa674c21442cbecdbe1ecbe24359) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.690869 14653 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_0046658bb1c6486da44cf4f7da540d34 [id=9af7f62b46de47af9bfae466af91660b] alter complete (version 3)
I20251025 08:02:23.691335 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet c9da5f06aa7d41be80cb9571635f367b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.691787 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet c9da5f06aa7d41be80cb9571635f367b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.691962 14649 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_c29917b4373041a286808bfe8836b9cb" } modify_external_catalogs: true
I20251025 08:02:23.692058 14649 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_c29917b4373041a286808bfe8836b9cb" } modify_external_catalogs: true
I20251025 08:02:23.692198 15388 ts_tablet_manager.cc:1916] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.692234 15436 tablet.cc:1717] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e: Skipping requested alter to schema version 2, tablet already version 2
I20251025 08:02:23.693253 15376 raft_consensus.cc:493] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.693332 15376 raft_consensus.cc:515] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.693509 14648 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_2bc36ab5489746d9a1ed6e69965a4e17" } modify_external_catalogs: true
I20251025 08:02:23.693591 14648 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_2bc36ab5489746d9a1ed6e69965a4e17" } modify_external_catalogs: true
I20251025 08:02:23.693660 15376 leader_election.cc:290] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.694198 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a11af785ca64f83bfd1038fb37420de" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.694291 14978 raft_consensus.cc:2468] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:23.694566 15048 leader_election.cc:304] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:23.694741 15376 raft_consensus.cc:2804] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.694775 15376 raft_consensus.cc:493] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.694806 15376 raft_consensus.cc:3060] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.695456 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet c9da5f06aa7d41be80cb9571635f367b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.695641 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 36d07fdd83204e01933862285ce4a539 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.695616 15376 raft_consensus.cc:515] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.695783 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a11af785ca64f83bfd1038fb37420de" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.695868 15246 raft_consensus.cc:2468] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:23.696065 15372 tablet_bootstrap.cc:492] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.696085 15385 tablet_replica.cc:333] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.696138 15372 ts_tablet_manager.cc:1403] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.000s
I20251025 08:02:23.696175 15385 raft_consensus.cc:2243] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.696223 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet ce9455c9180c457394725dcf277fb4a2 with delete_type TABLET_DATA_DELETED (replaced by tablet f2d7e4ad8c2f4915b721b77846cfc3cb) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.696259 15385 raft_consensus.cc:2272] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.696566 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a11af785ca64f83bfd1038fb37420de" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:23.696661 15246 raft_consensus.cc:3060] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.696774 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7a11af785ca64f83bfd1038fb37420de" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:23.696856 14978 raft_consensus.cc:3060] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.697616 15246 raft_consensus.cc:2468] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:23.697690 14978 raft_consensus.cc:2468] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:23.696579 15372 raft_consensus.cc:359] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.697813 15372 raft_consensus.cc:385] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.697839 15372 raft_consensus.cc:740] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.697949 15372 consensus_queue.cc:260] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.698055 15048 leader_election.cc:304] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:23.698169 15372 ts_tablet_manager.cc:1434] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.698365 15372 tablet_bootstrap.cc:492] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.698419 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet 7a11af785ca64f83bfd1038fb37420de with delete_type TABLET_DATA_DELETED (replaced by tablet 0e09fa674c21442cbecdbe1ecbe24359) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.698916 15380 raft_consensus.cc:2804] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.699061 15380 raft_consensus.cc:697] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:23.699144 15386 tablet_replica.cc:333] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.699163 15380 consensus_queue.cc:237] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.699259 15386 raft_consensus.cc:2243] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.699354 15386 raft_consensus.cc:2272] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.699739 15386 ts_tablet_manager.cc:1916] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.700584 15385 ts_tablet_manager.cc:1916] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:23.700956 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet c9da5f06aa7d41be80cb9571635f367b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9da5f06aa7d41be80cb9571635f367b already in progress: creating tablet
W20251025 08:02:23.701093 14641 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 36d07fdd83204e01933862285ce4a539 because the tablet was not found. No further retry: Not found: Tablet not found: 36d07fdd83204e01933862285ce4a539
W20251025 08:02:23.701185 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet ce9455c9180c457394725dcf277fb4a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce9455c9180c457394725dcf277fb4a2 already in progress: creating tablet
I20251025 08:02:23.701406 15386 ts_tablet_manager.cc:1929] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.701475 15386 log.cc:1199] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/7a11af785ca64f83bfd1038fb37420de
I20251025 08:02:23.701659 15386 ts_tablet_manager.cc:1950] T 7a11af785ca64f83bfd1038fb37420de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.702083 15376 leader_election.cc:290] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.699262 15372 tablet_bootstrap.cc:654] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.702715 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 7a11af785ca64f83bfd1038fb37420de (table default.Table_4e764c9b1b9d4238b6df2a23c9c3ef34 [id=29a1ac5b34e84405ad2a34bd49ea9997]) successfully deleted
I20251025 08:02:23.703370 15385 ts_tablet_manager.cc:1929] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.703444 15385 log.cc:1199] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/297960b7d4dc4af181c05e79ad62a941
I20251025 08:02:23.703456 15388 ts_tablet_manager.cc:1929] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.703511 15388 log.cc:1199] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/297960b7d4dc4af181c05e79ad62a941
I20251025 08:02:23.703635 15385 ts_tablet_manager.cc:1950] T 297960b7d4dc4af181c05e79ad62a941 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.703701 15388 ts_tablet_manager.cc:1950] T 297960b7d4dc4af181c05e79ad62a941 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.704160 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 297960b7d4dc4af181c05e79ad62a941 (table default.Table_c6730a6d2f5b41a2ad960456bb50184f [id=955fa2dc29344ad39456c6996cc6948a]) successfully deleted
I20251025 08:02:23.704205 15385 tablet_replica.cc:333] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.704299 15385 raft_consensus.cc:2243] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.704367 15385 raft_consensus.cc:2272] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:23.704392 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet ce9455c9180c457394725dcf277fb4a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ce9455c9180c457394725dcf277fb4a2 already in progress: creating tablet
I20251025 08:02:23.705420 15385 ts_tablet_manager.cc:1916] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.706869 15388 tablet_replica.cc:333] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.707067 15385 ts_tablet_manager.cc:1929] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.707090 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 297960b7d4dc4af181c05e79ad62a941 (table default.Table_c6730a6d2f5b41a2ad960456bb50184f [id=955fa2dc29344ad39456c6996cc6948a]) successfully deleted
I20251025 08:02:23.707127 15385 log.cc:1199] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/7a11af785ca64f83bfd1038fb37420de
I20251025 08:02:23.707304 15385 ts_tablet_manager.cc:1950] T 7a11af785ca64f83bfd1038fb37420de P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.707758 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 7a11af785ca64f83bfd1038fb37420de (table default.Table_4e764c9b1b9d4238b6df2a23c9c3ef34 [id=29a1ac5b34e84405ad2a34bd49ea9997]) successfully deleted
W20251025 08:02:23.707969 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet c9da5f06aa7d41be80cb9571635f367b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c9da5f06aa7d41be80cb9571635f367b already in progress: creating tablet
I20251025 08:02:23.708658 14649 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet ef0bbbbd53c94b86a69f112ddadc963f
I20251025 08:02:23.709317 15388 raft_consensus.cc:2243] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.709360 14648 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet f637313389174f729f784974fc2f94b9
I20251025 08:02:23.709440 15388 raft_consensus.cc:2272] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.709858 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet f637313389174f729f784974fc2f94b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.710083 15388 ts_tablet_manager.cc:1916] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.711573 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet f637313389174f729f784974fc2f94b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.711668 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet f637313389174f729f784974fc2f94b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
W20251025 08:02:23.711936 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet f637313389174f729f784974fc2f94b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f637313389174f729f784974fc2f94b9 already in progress: creating tablet
W20251025 08:02:23.712057 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet f637313389174f729f784974fc2f94b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f637313389174f729f784974fc2f94b9 already in progress: creating tablet
I20251025 08:02:23.712893 15388 ts_tablet_manager.cc:1929] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.712960 15388 log.cc:1199] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/ce9455c9180c457394725dcf277fb4a2
I20251025 08:02:23.713145 15388 ts_tablet_manager.cc:1950] T ce9455c9180c457394725dcf277fb4a2 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.713619 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet ce9455c9180c457394725dcf277fb4a2 (table default.Table_8184815f748f4644ae04b4927d72b27b [id=215b7ed86cf7422b826890834307b839]) successfully deleted
I20251025 08:02:23.713876 15388 tablet_replica.cc:333] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.713966 15388 raft_consensus.cc:2243] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:23.714069 15388 pending_rounds.cc:70] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:23.714090 15388 pending_rounds.cc:77] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609791792717824 op_type: NO_OP noop_request { }
I20251025 08:02:23.714129 15388 raft_consensus.cc:2889] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:23.714166 15388 raft_consensus.cc:2272] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.715061 15227 tablet_service.cc:1505] Processing CreateTablet for tablet e53e89d1f67840bbbf515e75f8438e87 (DEFAULT_TABLE table=default.Table_beb1f6ec236e4f3b96df6b5201581c79 [id=cead87820a99412e936796998d2150dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.715286 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e53e89d1f67840bbbf515e75f8438e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.715749 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 297960b7d4dc4af181c05e79ad62a941 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.715858 15386 tablet_replica.cc:333] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.715929 15386 raft_consensus.cc:2243] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.715997 15386 raft_consensus.cc:2272] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.716343 15386 ts_tablet_manager.cc:1916] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.717234 15093 tablet_service.cc:1505] Processing CreateTablet for tablet e53e89d1f67840bbbf515e75f8438e87 (DEFAULT_TABLE table=default.Table_beb1f6ec236e4f3b96df6b5201581c79 [id=cead87820a99412e936796998d2150dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.717487 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e53e89d1f67840bbbf515e75f8438e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.717450 14959 tablet_service.cc:1505] Processing CreateTablet for tablet e53e89d1f67840bbbf515e75f8438e87 (DEFAULT_TABLE table=default.Table_beb1f6ec236e4f3b96df6b5201581c79 [id=cead87820a99412e936796998d2150dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.717665 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e53e89d1f67840bbbf515e75f8438e87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.717890 15386 ts_tablet_manager.cc:1929] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.717947 15386 log.cc:1199] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/297960b7d4dc4af181c05e79ad62a941
I20251025 08:02:23.718129 15386 ts_tablet_manager.cc:1950] T 297960b7d4dc4af181c05e79ad62a941 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.718806 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 297960b7d4dc4af181c05e79ad62a941 (table default.Table_c6730a6d2f5b41a2ad960456bb50184f [id=955fa2dc29344ad39456c6996cc6948a]) successfully deleted
W20251025 08:02:23.721844 15498 consensus_queue.cc:1175] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e51a2be794f04642b89386067ecbc77e" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20251025 08:02:23.721987 14959 tablet_service.cc:1505] Processing CreateTablet for tablet f2d7e4ad8c2f4915b721b77846cfc3cb (DEFAULT_TABLE table=default.Table_8184815f748f4644ae04b4927d72b27b [id=215b7ed86cf7422b826890834307b839]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.722179 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d7e4ad8c2f4915b721b77846cfc3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.722234 15227 tablet_service.cc:1505] Processing CreateTablet for tablet f2d7e4ad8c2f4915b721b77846cfc3cb (DEFAULT_TABLE table=default.Table_8184815f748f4644ae04b4927d72b27b [id=215b7ed86cf7422b826890834307b839]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.722447 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d7e4ad8c2f4915b721b77846cfc3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.723122 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 0e09fa674c21442cbecdbe1ecbe24359 (DEFAULT_TABLE table=default.Table_4e764c9b1b9d4238b6df2a23c9c3ef34 [id=29a1ac5b34e84405ad2a34bd49ea9997]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.723326 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e09fa674c21442cbecdbe1ecbe24359. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.723371 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 0e09fa674c21442cbecdbe1ecbe24359 (DEFAULT_TABLE table=default.Table_4e764c9b1b9d4238b6df2a23c9c3ef34 [id=29a1ac5b34e84405ad2a34bd49ea9997]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.723557 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e09fa674c21442cbecdbe1ecbe24359. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.723522 15223 tablet_service.cc:1505] Processing CreateTablet for tablet ff155cb1c7e44986bb999bb0177f8f75 (DEFAULT_TABLE table=default.Table_f34d90f304ae4c5091f5a1bed946bf11 [id=1ee33ee129d749d0bd7f26dc49fca0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.723721 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff155cb1c7e44986bb999bb0177f8f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.725204 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 0e09fa674c21442cbecdbe1ecbe24359 (DEFAULT_TABLE table=default.Table_4e764c9b1b9d4238b6df2a23c9c3ef34 [id=29a1ac5b34e84405ad2a34bd49ea9997]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.725422 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e09fa674c21442cbecdbe1ecbe24359. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.726102 14959 tablet_service.cc:1505] Processing CreateTablet for tablet ff155cb1c7e44986bb999bb0177f8f75 (DEFAULT_TABLE table=default.Table_f34d90f304ae4c5091f5a1bed946bf11 [id=1ee33ee129d749d0bd7f26dc49fca0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.726323 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff155cb1c7e44986bb999bb0177f8f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.726328 15092 tablet_service.cc:1505] Processing CreateTablet for tablet ff155cb1c7e44986bb999bb0177f8f75 (DEFAULT_TABLE table=default.Table_f34d90f304ae4c5091f5a1bed946bf11 [id=1ee33ee129d749d0bd7f26dc49fca0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.726459 15093 tablet_service.cc:1505] Processing CreateTablet for tablet f2d7e4ad8c2f4915b721b77846cfc3cb (DEFAULT_TABLE table=default.Table_8184815f748f4644ae04b4927d72b27b [id=215b7ed86cf7422b826890834307b839]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.726521 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff155cb1c7e44986bb999bb0177f8f75. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.726647 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2d7e4ad8c2f4915b721b77846cfc3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.729758 15388 ts_tablet_manager.cc:1916] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.730712 15372 tablet_bootstrap.cc:492] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.730783 15372 ts_tablet_manager.cc:1403] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.032s user 0.000s sys 0.002s
I20251025 08:02:23.730840 15370 tablet_bootstrap.cc:492] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.730902 15370 ts_tablet_manager.cc:1403] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.058s user 0.001s sys 0.000s
I20251025 08:02:23.731174 15372 raft_consensus.cc:359] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.731281 15372 raft_consensus.cc:385] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.731308 15372 raft_consensus.cc:740] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.731406 15372 consensus_queue.cc:260] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.731434 15388 ts_tablet_manager.cc:1929] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:23.731408 15370 raft_consensus.cc:359] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.731482 15388 log.cc:1199] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/7a11af785ca64f83bfd1038fb37420de
I20251025 08:02:23.731498 15370 raft_consensus.cc:385] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.731540 15370 raft_consensus.cc:740] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.731622 15372 ts_tablet_manager.cc:1434] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.731663 15370 consensus_queue.cc:260] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.731791 15372 tablet_bootstrap.cc:492] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.731840 15388 ts_tablet_manager.cc:1950] T 7a11af785ca64f83bfd1038fb37420de P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.731978 15370 ts_tablet_manager.cc:1434] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.732143 15370 tablet_bootstrap.cc:492] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.732717 15388 tablet_replica.cc:333] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.732750 15372 tablet_bootstrap.cc:654] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.732805 15388 raft_consensus.cc:2243] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.732882 15388 raft_consensus.cc:2272] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.732980 15370 tablet_bootstrap.cc:654] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.733254 15388 ts_tablet_manager.cc:1916] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.734803 14654 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 962889388a40485bb61b3b47e3ad3d43 (table default.Table_9b93bef6a94b445180bc909f9a07cdb4 [id=394a1e6daa8f42f4a69517cb60a9a935]). Expected version 3 got 0
I20251025 08:02:23.735131 15388 ts_tablet_manager.cc:1929] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.735200 15388 log.cc:1199] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/c9da5f06aa7d41be80cb9571635f367b
I20251025 08:02:23.735378 15388 ts_tablet_manager.cc:1950] T c9da5f06aa7d41be80cb9571635f367b P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.737363 14653 master_service.cc:954] ReplaceTablet: received request to replace tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.738220 15369 tablet_bootstrap.cc:492] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.738304 15369 ts_tablet_manager.cc:1403] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.000s
I20251025 08:02:23.738699 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 7a11af785ca64f83bfd1038fb37420de (table default.Table_4e764c9b1b9d4238b6df2a23c9c3ef34 [id=29a1ac5b34e84405ad2a34bd49ea9997]) successfully deleted
I20251025 08:02:23.738691 15369 raft_consensus.cc:359] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.738780 15369 raft_consensus.cc:385] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.738817 15369 raft_consensus.cc:740] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.738916 15369 consensus_queue.cc:260] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.739051 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet c9da5f06aa7d41be80cb9571635f367b (table default.Table_72984ef4c9b74b0984cf6243e4c63305 [id=587ddc6547de445bb8a4ef96e02c3108]) successfully deleted
I20251025 08:02:23.739137 15369 ts_tablet_manager.cc:1434] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.739320 15369 tablet_bootstrap.cc:492] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:23.739333 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet f637313389174f729f784974fc2f94b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f637313389174f729f784974fc2f94b9 already in progress: creating tablet
I20251025 08:02:23.740098 15370 tablet_bootstrap.cc:492] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.740150 15369 tablet_bootstrap.cc:654] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.740155 15370 ts_tablet_manager.cc:1403] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251025 08:02:23.740479 15370 raft_consensus.cc:359] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.740548 15370 raft_consensus.cc:385] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.740571 15370 raft_consensus.cc:740] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.740651 15370 consensus_queue.cc:260] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.740828 15370 ts_tablet_manager.cc:1434] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.740954 15370 tablet_bootstrap.cc:492] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.741691 15370 tablet_bootstrap.cc:654] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.743103 14653 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9
I20251025 08:02:23.743314 14653 catalog_manager.cc:6719] ReplaceTablet: tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 deleted and replaced by tablet 58b14a04ff6a4e18b9daa8c22f6e7307
I20251025 08:02:23.743330 15369 tablet_bootstrap.cc:492] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.743398 15369 ts_tablet_manager.cc:1403] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:23.743752 15369 raft_consensus.cc:359] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.743813 15369 raft_consensus.cc:385] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.743831 15369 raft_consensus.cc:740] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.743917 15369 consensus_queue.cc:260] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.744125 15369 ts_tablet_manager.cc:1434] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.744233 15369 tablet_bootstrap.cc:492] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.744908 15369 tablet_bootstrap.cc:654] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.745244 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 with delete_type TABLET_DATA_DELETED (replaced by tablet 58b14a04ff6a4e18b9daa8c22f6e7307) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.745705 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 with delete_type TABLET_DATA_DELETED (replaced by tablet 58b14a04ff6a4e18b9daa8c22f6e7307) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:23.745930 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 already in progress: creating tablet
I20251025 08:02:23.746601 15369 tablet_bootstrap.cc:492] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.746665 15369 ts_tablet_manager.cc:1403] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.746789 15372 tablet_bootstrap.cc:492] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.746850 15372 ts_tablet_manager.cc:1403] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251025 08:02:23.747040 15369 raft_consensus.cc:359] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.747116 15369 raft_consensus.cc:385] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.747143 15369 raft_consensus.cc:740] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.747157 15372 raft_consensus.cc:359] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.747228 15372 raft_consensus.cc:385] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.747252 15372 raft_consensus.cc:740] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.747232 15369 consensus_queue.cc:260] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.747339 15372 consensus_queue.cc:260] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.747516 15369 ts_tablet_manager.cc:1434] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.747540 15372 ts_tablet_manager.cc:1434] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.747663 15369 tablet_bootstrap.cc:492] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.747675 15372 tablet_bootstrap.cc:492] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.748390 15372 tablet_bootstrap.cc:654] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.748569 15369 tablet_bootstrap.cc:654] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.749490 15497 raft_consensus.cc:493] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.749559 15497 raft_consensus.cc:515] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.749876 15497 leader_election.cc:290] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.750269 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet ce9455c9180c457394725dcf277fb4a2 with delete_type TABLET_DATA_DELETED (replaced by tablet f2d7e4ad8c2f4915b721b77846cfc3cb) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.750389 15385 tablet_replica.cc:333] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.750463 15385 raft_consensus.cc:2243] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.750526 15385 raft_consensus.cc:2272] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.750801 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 with delete_type TABLET_DATA_DELETED (replaced by tablet 58b14a04ff6a4e18b9daa8c22f6e7307) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.750983 15370 tablet_bootstrap.cc:492] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.751050 15370 ts_tablet_manager.cc:1403] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:23.751366 15370 raft_consensus.cc:359] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.751433 15370 raft_consensus.cc:385] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.751454 15370 raft_consensus.cc:740] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.751534 15370 consensus_queue.cc:260] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.751709 15370 ts_tablet_manager.cc:1434] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.751710 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "962889388a40485bb61b3b47e3ad3d43" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.751798 15246 raft_consensus.cc:2468] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:23.751848 15370 tablet_bootstrap.cc:492] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.752578 15370 tablet_bootstrap.cc:654] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.753127 15049 leader_election.cc:304] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.753691 15370 tablet_bootstrap.cc:492] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.753746 15370 ts_tablet_manager.cc:1403] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.754072 15370 raft_consensus.cc:359] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.754153 15370 raft_consensus.cc:385] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.754200 15370 raft_consensus.cc:740] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.754297 15370 consensus_queue.cc:260] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.754503 15370 ts_tablet_manager.cc:1434] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.754616 15370 tablet_bootstrap.cc:492] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.754699 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet c9da5f06aa7d41be80cb9571635f367b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.755010 15388 tablet_replica.cc:333] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.755189 15388 raft_consensus.cc:2243] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.755322 15388 raft_consensus.cc:2272] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.755345 15370 tablet_bootstrap.cc:654] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.756400 15388 ts_tablet_manager.cc:1916] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.757210 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "962889388a40485bb61b3b47e3ad3d43" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.757334 14978 raft_consensus.cc:2468] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:23.754069 15497 raft_consensus.cc:2804] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.757504 15497 raft_consensus.cc:493] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.757510 15374 raft_consensus.cc:493] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.757539 15497 raft_consensus.cc:3060] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.757572 15374 raft_consensus.cc:515] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.757907 15374 leader_election.cc:290] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.758702 15497 raft_consensus.cc:515] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.758791 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c9da5f06aa7d41be80cb9571635f367b" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.758937 15388 ts_tablet_manager.cc:1929] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.758994 15388 log.cc:1199] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/05f0f22c06ed45ae9c3433cc0cd7ffb9
I20251025 08:02:23.759006 15497 leader_election.cc:290] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:23.759078 14914 leader_election.cc:343] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.759181 15388 ts_tablet_manager.cc:1950] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.759379 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "962889388a40485bb61b3b47e3ad3d43" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:23.759459 15246 raft_consensus.cc:3060] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.760170 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 58b14a04ff6a4e18b9daa8c22f6e7307 (DEFAULT_TABLE table=default.Table_df35e9b11c6c43859e7b3511585c665b [id=e8f1b9d591bb4f8fbbb05ee960280cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.760382 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b14a04ff6a4e18b9daa8c22f6e7307. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.760478 15246 raft_consensus.cc:2468] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:23.760752 15385 ts_tablet_manager.cc:1916] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.762318 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 58b14a04ff6a4e18b9daa8c22f6e7307 (DEFAULT_TABLE table=default.Table_df35e9b11c6c43859e7b3511585c665b [id=e8f1b9d591bb4f8fbbb05ee960280cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.762537 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b14a04ff6a4e18b9daa8c22f6e7307. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.762773 15385 ts_tablet_manager.cc:1929] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.762831 15385 log.cc:1199] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/ce9455c9180c457394725dcf277fb4a2
I20251025 08:02:23.763022 15385 ts_tablet_manager.cc:1950] T ce9455c9180c457394725dcf277fb4a2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.763587 15385 tablet_replica.cc:333] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.763630 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "962889388a40485bb61b3b47e3ad3d43" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:23.763695 15385 raft_consensus.cc:2243] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.763723 14978 raft_consensus.cc:3060] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.763772 15385 raft_consensus.cc:2272] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.763993 15049 leader_election.cc:304] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.764483 14978 raft_consensus.cc:2468] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:23.764554 15385 ts_tablet_manager.cc:1916] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.764961 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet f637313389174f729f784974fc2f94b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.765276 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet ce9455c9180c457394725dcf277fb4a2 (table default.Table_8184815f748f4644ae04b4927d72b27b [id=215b7ed86cf7422b826890834307b839]) successfully deleted
W20251025 08:02:23.765399 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 already in progress: creating tablet
I20251025 08:02:23.765388 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 58b14a04ff6a4e18b9daa8c22f6e7307 (DEFAULT_TABLE table=default.Table_df35e9b11c6c43859e7b3511585c665b [id=e8f1b9d591bb4f8fbbb05ee960280cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.765559 15376 raft_consensus.cc:2804] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.765616 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58b14a04ff6a4e18b9daa8c22f6e7307. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.765635 15376 raft_consensus.cc:697] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:23.765736 15376 consensus_queue.cc:237] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.765985 15246 raft_consensus.cc:1275] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:23.766059 14978 raft_consensus.cc:1275] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:23.766410 15380 consensus_queue.cc:1048] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:23.766525 14915 leader_election.cc:343] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: c9da5f06aa7d41be80cb9571635f367b
I20251025 08:02:23.766579 14915 leader_election.cc:304] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:23.766655 14915 raft_consensus.cc:2686] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251025 08:02:23.766665 15380 consensus_queue.cc:1048] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:23.768343 14654 catalog_manager.cc:5649] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:23.768522 14654 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 962889388a40485bb61b3b47e3ad3d43 (table default.Table_9b93bef6a94b445180bc909f9a07cdb4 [id=394a1e6daa8f42f4a69517cb60a9a935]). Expected version 3 got 0
I20251025 08:02:23.770138 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 (table default.Table_df35e9b11c6c43859e7b3511585c665b [id=e8f1b9d591bb4f8fbbb05ee960280cc6]) successfully deleted
I20251025 08:02:23.770169 14648 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 2d890847f8634b869d9958519c6d2b8c (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]). Expected version 1 got 0
I20251025 08:02:23.770401 15388 tablet_replica.cc:333] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.770532 15388 raft_consensus.cc:2243] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.770684 15388 raft_consensus.cc:2272] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.771114 14653 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 2d890847f8634b869d9958519c6d2b8c (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]). Expected version 1 got 0
I20251025 08:02:23.772163 15385 ts_tablet_manager.cc:1929] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.772226 15385 log.cc:1199] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/c9da5f06aa7d41be80cb9571635f367b
I20251025 08:02:23.772429 15385 ts_tablet_manager.cc:1950] T c9da5f06aa7d41be80cb9571635f367b P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.772970 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet c9da5f06aa7d41be80cb9571635f367b (table default.Table_72984ef4c9b74b0984cf6243e4c63305 [id=587ddc6547de445bb8a4ef96e02c3108]) successfully deleted
I20251025 08:02:23.773414 15388 ts_tablet_manager.cc:1916] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.773957 15372 tablet_bootstrap.cc:492] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.773957 15369 tablet_bootstrap.cc:492] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.774034 15372 ts_tablet_manager.cc:1403] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.000s
I20251025 08:02:23.774040 15369 ts_tablet_manager.cc:1403] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20251025 08:02:23.774452 15369 raft_consensus.cc:359] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.774452 15372 raft_consensus.cc:359] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.774531 15369 raft_consensus.cc:385] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.774531 15372 raft_consensus.cc:385] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.774561 15369 raft_consensus.cc:740] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.774561 15372 raft_consensus.cc:740] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.774667 15369 consensus_queue.cc:260] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.774667 15372 consensus_queue.cc:260] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.774894 15369 ts_tablet_manager.cc:1434] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.774919 15372 ts_tablet_manager.cc:1434] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.775053 15372 tablet_bootstrap.cc:492] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.775053 15369 tablet_bootstrap.cc:492] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.775944 15369 tablet_bootstrap.cc:654] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.775944 15372 tablet_bootstrap.cc:654] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.776816 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet ce9455c9180c457394725dcf277fb4a2 with delete_type TABLET_DATA_DELETED (replaced by tablet f2d7e4ad8c2f4915b721b77846cfc3cb) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.776942 15386 tablet_replica.cc:333] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.777036 15386 raft_consensus.cc:2243] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.777110 15386 raft_consensus.cc:2272] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.777823 15436 tablet.cc:1722] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:23.779596 15386 ts_tablet_manager.cc:1916] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.780081 15407 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251025 08:02:23.780364 15388 ts_tablet_manager.cc:1929] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.780422 15388 log.cc:1199] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/f637313389174f729f784974fc2f94b9
I20251025 08:02:23.780601 15388 ts_tablet_manager.cc:1950] T f637313389174f729f784974fc2f94b9 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.780972 15407 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251025 08:02:23.781001 15451 tablet.cc:1722] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:23.781100 15407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251025 08:02:23.781427 15386 ts_tablet_manager.cc:1929] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.781512 15386 log.cc:1199] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/ce9455c9180c457394725dcf277fb4a2
I20251025 08:02:23.781694 15386 ts_tablet_manager.cc:1950] T ce9455c9180c457394725dcf277fb4a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.782310 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet f637313389174f729f784974fc2f94b9 (table default.Table_2bc36ab5489746d9a1ed6e69965a4e17 [id=943ad581ce2d43b39ecafee069537b6f]) successfully deleted
I20251025 08:02:23.782441 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet ce9455c9180c457394725dcf277fb4a2 (table default.Table_8184815f748f4644ae04b4927d72b27b [id=215b7ed86cf7422b826890834307b839]) successfully deleted
I20251025 08:02:23.782784 15437 tablet.cc:1722] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:23.784232 14648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_f398b0ec52b14af5889821d6f4bc881d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.784544 14648 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f398b0ec52b14af5889821d6f4bc881d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.787000 14652 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_254086ab62b448c7a5fbc8b8c2589716"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.787251 14978 raft_consensus.cc:1275] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251025 08:02:23.787302 14652 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_254086ab62b448c7a5fbc8b8c2589716 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.788079 15246 raft_consensus.cc:1275] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:23.788206 14654 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb] alter complete (version 1)
I20251025 08:02:23.789582 14649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_d9f70d3fb7f64a8b85b2f0536b3c45f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.789609 15497 consensus_queue.cc:1048] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:23.789866 14649 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9f70d3fb7f64a8b85b2f0536b3c45f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.790520 15372 tablet_bootstrap.cc:492] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.790588 15372 ts_tablet_manager.cc:1403] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20251025 08:02:23.790970 15372 raft_consensus.cc:359] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.791122 15372 raft_consensus.cc:385] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.791153 15372 raft_consensus.cc:740] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.791304 15372 consensus_queue.cc:260] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.792122 15372 ts_tablet_manager.cc:1434] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.792285 15372 tablet_bootstrap.cc:492] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.794250 15372 tablet_bootstrap.cc:654] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.794813 15370 tablet_bootstrap.cc:492] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.794893 15370 ts_tablet_manager.cc:1403] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.000s
I20251025 08:02:23.795313 15370 raft_consensus.cc:359] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.795359 15436 tablet.cc:1722] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:23.795403 15370 raft_consensus.cc:385] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.795431 15370 raft_consensus.cc:740] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.795527 15370 consensus_queue.cc:260] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.795751 15370 ts_tablet_manager.cc:1434] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.796749 15370 tablet_bootstrap.cc:492] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.797581 15370 tablet_bootstrap.cc:654] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.797770 15437 tablet.cc:1722] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:23.797919 14648 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 962889388a40485bb61b3b47e3ad3d43 (table default.Table_9b93bef6a94b445180bc909f9a07cdb4 [id=394a1e6daa8f42f4a69517cb60a9a935]). Expected version 3 got 0
I20251025 08:02:23.798126 15407 rpc_server.cc:307] RPC server started. Bound to: 127.14.70.60:34453
I20251025 08:02:23.798558 15370 tablet_bootstrap.cc:492] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.798627 15370 ts_tablet_manager.cc:1403] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.799698 15380 consensus_queue.cc:1048] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:23.800056 15407 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-2/data/info.pb
I20251025 08:02:23.800073 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet c9da5f06aa7d41be80cb9571635f367b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.800452 15386 tablet_replica.cc:333] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.800555 15386 raft_consensus.cc:2243] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.800631 15386 raft_consensus.cc:2272] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.801060 15386 ts_tablet_manager.cc:1916] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.802134 14616 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu as pid 15407
I20251025 08:02:23.802785 15451 tablet.cc:1722] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:23.803500 15370 raft_consensus.cc:359] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.803606 15370 raft_consensus.cc:385] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.803632 15386 ts_tablet_manager.cc:1929] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.803638 15370 raft_consensus.cc:740] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.803689 15386 log.cc:1199] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/c9da5f06aa7d41be80cb9571635f367b
I20251025 08:02:23.803858 15370 consensus_queue.cc:260] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.804062 15566 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.70.60:34453 every 8 connection(s)
I20251025 08:02:23.804152 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_d2bfcc6e6bb74e7497332d03e2764c24"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.804260 15370 ts_tablet_manager.cc:1434] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
W20251025 08:02:23.804481 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2bfcc6e6bb74e7497332d03e2764c24 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.804668 14655 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 962889388a40485bb61b3b47e3ad3d43 (table default.Table_9b93bef6a94b445180bc909f9a07cdb4 [id=394a1e6daa8f42f4a69517cb60a9a935]). Expected version 3 got 0
I20251025 08:02:23.805362 15370 tablet_bootstrap.cc:492] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.805591 15386 ts_tablet_manager.cc:1950] T c9da5f06aa7d41be80cb9571635f367b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.806514 15370 tablet_bootstrap.cc:654] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.807221 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet c9da5f06aa7d41be80cb9571635f367b (table default.Table_72984ef4c9b74b0984cf6243e4c63305 [id=587ddc6547de445bb8a4ef96e02c3108]) successfully deleted
I20251025 08:02:23.807936 14651 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_5d5bb27ab054422ea0354231c50d1ccf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.808243 14651 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5d5bb27ab054422ea0354231c50d1ccf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.807952 14647 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_742a7811d8054888be95298c1febef0d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.809141 14647 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_742a7811d8054888be95298c1febef0d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.811286 15369 tablet_bootstrap.cc:492] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.811362 15369 ts_tablet_manager.cc:1403] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20251025 08:02:23.811741 15369 raft_consensus.cc:359] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.811827 15369 raft_consensus.cc:385] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.811854 15369 raft_consensus.cc:740] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.811952 15369 consensus_queue.cc:260] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.812170 15369 ts_tablet_manager.cc:1434] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.812304 15369 tablet_bootstrap.cc:492] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.812731 15227 tablet_service.cc:1505] Processing CreateTablet for tablet f52aa4230f7847f6a5effda6c06063a5 (DEFAULT_TABLE table=default.Table_f398b0ec52b14af5889821d6f4bc881d [id=680b8d6772bf4a08a5102bba9a48f34d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.812884 14653 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 0e09fa674c21442cbecdbe1ecbe24359 (table default.Table_4e764c9b1b9d4238b6df2a23c9c3ef34 [id=29a1ac5b34e84405ad2a34bd49ea9997]). Expected version 2 got 0
I20251025 08:02:23.812955 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52aa4230f7847f6a5effda6c06063a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.813187 15369 tablet_bootstrap.cc:654] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.813779 15568 sys_catalog.cc:263] Verifying existing consensus state
I20251025 08:02:23.813858 14959 tablet_service.cc:1505] Processing CreateTablet for tablet f52aa4230f7847f6a5effda6c06063a5 (DEFAULT_TABLE table=default.Table_f398b0ec52b14af5889821d6f4bc881d [id=680b8d6772bf4a08a5102bba9a48f34d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.814074 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52aa4230f7847f6a5effda6c06063a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.814594 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_fc9c7434bd43470c9134da3d60417d99"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.814853 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc9c7434bd43470c9134da3d60417d99 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.815006 15093 tablet_service.cc:1505] Processing CreateTablet for tablet f52aa4230f7847f6a5effda6c06063a5 (DEFAULT_TABLE table=default.Table_f398b0ec52b14af5889821d6f4bc881d [id=680b8d6772bf4a08a5102bba9a48f34d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.815227 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f52aa4230f7847f6a5effda6c06063a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.816272 15372 tablet_bootstrap.cc:492] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.816373 15372 ts_tablet_manager.cc:1403] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.001s
I20251025 08:02:23.816812 15372 raft_consensus.cc:359] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.816908 15372 raft_consensus.cc:385] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.816946 15372 raft_consensus.cc:740] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.817065 15372 consensus_queue.cc:260] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.817512 15369 tablet_bootstrap.cc:492] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.817600 15369 ts_tablet_manager.cc:1403] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:23.817752 15372 ts_tablet_manager.cc:1434] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:23.817915 15372 tablet_bootstrap.cc:492] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.818027 15370 tablet_bootstrap.cc:492] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.818068 15369 raft_consensus.cc:359] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.818161 15369 raft_consensus.cc:385] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.818213 15369 raft_consensus.cc:740] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.818316 15369 consensus_queue.cc:260] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.818535 15370 ts_tablet_manager.cc:1403] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20251025 08:02:23.818571 15369 ts_tablet_manager.cc:1434] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:23.818733 15369 tablet_bootstrap.cc:492] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.818809 15372 tablet_bootstrap.cc:654] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.819120 15370 raft_consensus.cc:359] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.819262 15370 raft_consensus.cc:385] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.819356 15370 raft_consensus.cc:740] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.819518 15370 consensus_queue.cc:260] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.819901 15369 tablet_bootstrap.cc:654] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.819962 15372 tablet_bootstrap.cc:492] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.820026 15372 ts_tablet_manager.cc:1403] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251025 08:02:23.820362 15370 ts_tablet_manager.cc:1434] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.820426 15372 raft_consensus.cc:359] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.820515 15372 raft_consensus.cc:385] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.820544 15372 raft_consensus.cc:740] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.820648 15372 consensus_queue.cc:260] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.820921 15370 tablet_bootstrap.cc:492] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.820940 15372 ts_tablet_manager.cc:1434] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.821115 15372 tablet_bootstrap.cc:492] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.821971 15370 tablet_bootstrap.cc:654] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.822036 15372 tablet_bootstrap.cc:654] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.822490 14648 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_9b93bef6a94b445180bc909f9a07cdb4 [id=394a1e6daa8f42f4a69517cb60a9a935] alter complete (version 3)
I20251025 08:02:23.823529 15370 tablet_bootstrap.cc:492] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.823599 15370 ts_tablet_manager.cc:1403] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
W20251025 08:02:23.823725 14653 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet 0e09fa674c21442cbecdbe1ecbe24359 (table default.Table_4e764c9b1b9d4238b6df2a23c9c3ef34 [id=29a1ac5b34e84405ad2a34bd49ea9997], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 0e09fa674c21442cbecdbe1ecbe24359 consensus state has no leader
I20251025 08:02:23.823971 15370 raft_consensus.cc:359] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.824059 15370 raft_consensus.cc:385] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.824090 15370 raft_consensus.cc:740] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.824189 15370 consensus_queue.cc:260] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.824416 15370 ts_tablet_manager.cc:1434] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.825769 15370 tablet_bootstrap.cc:492] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.828717 15370 tablet_bootstrap.cc:654] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.832585 15374 raft_consensus.cc:493] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.832675 15369 tablet_bootstrap.cc:492] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.832665 15374 raft_consensus.cc:515] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.832759 15369 ts_tablet_manager.cc:1403] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20251025 08:02:23.832998 15374 leader_election.cc:290] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.833325 15369 raft_consensus.cc:359] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.833416 15369 raft_consensus.cc:385] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.833443 15369 raft_consensus.cc:740] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.833496 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "289e3ff2a6be4daaadcac6fe492117c9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.833534 15369 consensus_queue.cc:260] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:23.833827 14914 leader_election.cc:343] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.833845 15369 ts_tablet_manager.cc:1434] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:23.834050 15369 tablet_bootstrap.cc:492] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.834443 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "289e3ff2a6be4daaadcac6fe492117c9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:23.834507 15025 heartbeater.cc:344] Connected to a master server at 127.14.70.60:34453
I20251025 08:02:23.834559 15114 raft_consensus.cc:2468] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:23.834604 15025 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.834833 14915 leader_election.cc:304] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:23.834972 15369 tablet_bootstrap.cc:654] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.835054 15374 raft_consensus.cc:2804] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.835110 15374 raft_consensus.cc:493] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.835150 15374 raft_consensus.cc:3060] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.835867 15370 tablet_bootstrap.cc:492] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.835932 15370 ts_tablet_manager.cc:1403] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:23.836030 15374 raft_consensus.cc:515] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.836333 15374 leader_election.cc:290] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.836335 15370 raft_consensus.cc:359] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.836431 15370 raft_consensus.cc:385] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.836462 15370 raft_consensus.cc:740] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.836555 15370 consensus_queue.cc:260] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.836802 15370 ts_tablet_manager.cc:1434] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:23.836984 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "289e3ff2a6be4daaadcac6fe492117c9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:23.837286 14914 leader_election.cc:343] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.837965 15160 heartbeater.cc:344] Connected to a master server at 127.14.70.60:34453
I20251025 08:02:23.838073 15160 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.838766 15374 raft_consensus.cc:493] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.838822 15025 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.838848 15374 raft_consensus.cc:515] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.839176 15374 leader_election.cc:290] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.839545 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "abd8c09e1e884d3cbd36801d6b7f9a98" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.839628 15369 tablet_bootstrap.cc:492] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.839676 15246 raft_consensus.cc:2468] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:23.839708 15369 ts_tablet_manager.cc:1403] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:23.840071 15369 raft_consensus.cc:359] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.840157 15369 raft_consensus.cc:385] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.840188 15369 raft_consensus.cc:740] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.840297 15369 consensus_queue.cc:260] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.840543 15369 ts_tablet_manager.cc:1434] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.840674 14914 leader_election.cc:304] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.840860 15160 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.840906 15445 raft_consensus.cc:2804] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.840967 15445 raft_consensus.cc:493] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.841012 15445 raft_consensus.cc:3060] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.840690 15369 tablet_bootstrap.cc:492] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.841955 15445 raft_consensus.cc:515] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.842286 15445 leader_election.cc:290] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.842427 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "289e3ff2a6be4daaadcac6fe492117c9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:23.842512 15114 raft_consensus.cc:3060] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.842542 15369 tablet_bootstrap.cc:654] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.842808 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "abd8c09e1e884d3cbd36801d6b7f9a98" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:23.842887 15246 raft_consensus.cc:3060] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.843382 15114 raft_consensus.cc:2468] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:23.843771 15246 raft_consensus.cc:2468] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:23.843783 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "abd8c09e1e884d3cbd36801d6b7f9a98" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:23.843861 15114 raft_consensus.cc:2468] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:23.843861 15025 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.844046 14914 leader_election.cc:304] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.844213 15445 raft_consensus.cc:2804] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.844278 15445 raft_consensus.cc:697] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:23.844369 15445 consensus_queue.cc:237] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.844439 15568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21: Bootstrap starting.
I20251025 08:02:23.845570 15384 raft_consensus.cc:493] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.845640 15384 raft_consensus.cc:515] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.845885 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 3dc4e2f330ed47369b8ed63b1bcf134b (DEFAULT_TABLE table=default.Table_254086ab62b448c7a5fbc8b8c2589716 [id=f08621eb6d0e46cda20a72e487a1c2da]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.845937 15384 leader_election.cc:290] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.845893 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 7922e71ecb4546dcb5c196b57ef5d3de (DEFAULT_TABLE table=default.Table_d9f70d3fb7f64a8b85b2f0536b3c45f1 [id=a5a019b836864161a3da06f611e4272e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.846127 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7922e71ecb4546dcb5c196b57ef5d3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.846129 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc4e2f330ed47369b8ed63b1bcf134b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.846199 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 7922e71ecb4546dcb5c196b57ef5d3de (DEFAULT_TABLE table=default.Table_d9f70d3fb7f64a8b85b2f0536b3c45f1 [id=a5a019b836864161a3da06f611e4272e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.846334 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 3dc4e2f330ed47369b8ed63b1bcf134b (DEFAULT_TABLE table=default.Table_254086ab62b448c7a5fbc8b8c2589716 [id=f08621eb6d0e46cda20a72e487a1c2da]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.846400 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7922e71ecb4546dcb5c196b57ef5d3de. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.846522 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc4e2f330ed47369b8ed63b1bcf134b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.848361 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd03eb08d0e54427a4709a4de4c4796c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.848466 14978 raft_consensus.cc:2468] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:23.848732 15025 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.848713 15183 leader_election.cc:304] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.848886 15384 raft_consensus.cc:2804] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.848954 15384 raft_consensus.cc:493] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.848996 15384 raft_consensus.cc:3060] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.849334 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "abd8c09e1e884d3cbd36801d6b7f9a98" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:23.849360 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd03eb08d0e54427a4709a4de4c4796c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:23.849435 15113 raft_consensus.cc:3060] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.849463 15114 raft_consensus.cc:2468] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:23.849802 15384 raft_consensus.cc:515] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.850160 15384 leader_election.cc:290] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.850414 15113 raft_consensus.cc:2468] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:23.850910 15369 tablet_bootstrap.cc:492] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.850977 15369 ts_tablet_manager.cc:1403] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:23.850952 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd03eb08d0e54427a4709a4de4c4796c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:23.850997 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cd03eb08d0e54427a4709a4de4c4796c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:23.851044 15113 raft_consensus.cc:3060] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.851085 14978 raft_consensus.cc:3060] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.851369 15369 raft_consensus.cc:359] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.851438 15369 raft_consensus.cc:385] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.851464 15369 raft_consensus.cc:740] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.851552 15369 consensus_queue.cc:260] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.851752 15113 raft_consensus.cc:2468] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:23.851817 15369 ts_tablet_manager.cc:1434] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.851881 14978 raft_consensus.cc:2468] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:23.851962 15369 tablet_bootstrap.cc:492] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.852011 15185 leader_election.cc:304] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.852010 15464 raft_consensus.cc:493] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.851998 14646 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_379cbae6c8254ecbbfeed7293dc9dd89" } new_table_name: "default.Table_6b8cc455bb574b30bdb9bca2ac803ae0" modify_external_catalogs: true
I20251025 08:02:23.852074 15464 raft_consensus.cc:515] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.852144 15384 raft_consensus.cc:2804] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.852238 15384 raft_consensus.cc:697] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:23.852342 15384 consensus_queue.cc:237] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.852380 15464 leader_election.cc:290] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.852939 15380 raft_consensus.cc:493] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.853020 15380 raft_consensus.cc:515] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.853107 15369 tablet_bootstrap.cc:654] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.853122 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e53e89d1f67840bbbf515e75f8438e87" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.853329 15380 leader_election.cc:290] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
W20251025 08:02:23.853399 14914 leader_election.cc:343] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.853700 15025 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.853732 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e53e89d1f67840bbbf515e75f8438e87" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.853983 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 3dc4e2f330ed47369b8ed63b1bcf134b (DEFAULT_TABLE table=default.Table_254086ab62b448c7a5fbc8b8c2589716 [id=f08621eb6d0e46cda20a72e487a1c2da]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.854053 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 7922e71ecb4546dcb5c196b57ef5d3de (DEFAULT_TABLE table=default.Table_d9f70d3fb7f64a8b85b2f0536b3c45f1 [id=a5a019b836864161a3da06f611e4272e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.854228 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc4e2f330ed47369b8ed63b1bcf134b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.854348 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7922e71ecb4546dcb5c196b57ef5d3de. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:23.854889 15049 leader_election.cc:343] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.855376 14915 leader_election.cc:304] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:23.855475 14655 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_d2bfcc6e6bb74e7497332d03e2764c24" } new_table_name: "default.Table_0f289526bf514ddc90a5622136145bff" modify_external_catalogs: true
I20251025 08:02:23.856498 15445 raft_consensus.cc:2804] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.856559 15445 raft_consensus.cc:697] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:23.856647 15445 consensus_queue.cc:237] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.856735 15370 tablet_bootstrap.cc:492] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.857084 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e53e89d1f67840bbbf515e75f8438e87" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:23.857228 15113 raft_consensus.cc:2468] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:23.857632 15370 tablet_bootstrap.cc:654] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.857690 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e53e89d1f67840bbbf515e75f8438e87" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.857780 14978 raft_consensus.cc:2468] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:23.858031 14653 catalog_manager.cc:5649] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:23.858332 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 with delete_type TABLET_DATA_DELETED (replaced by tablet 58b14a04ff6a4e18b9daa8c22f6e7307) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.858345 14653 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet cd03eb08d0e54427a4709a4de4c4796c (table default.Table_bc4af92ab72c4a9a92d850a89056986c [id=9922f64110ca4506bc2d3454cb7a297f]). Expected version 1 got 0
I20251025 08:02:23.858491 15386 tablet_replica.cc:333] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.858584 15386 raft_consensus.cc:2243] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.858661 15386 raft_consensus.cc:2272] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.858721 15025 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.858820 15295 heartbeater.cc:344] Connected to a master server at 127.14.70.60:34453
I20251025 08:02:23.858901 15295 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.859377 15048 leader_election.cc:304] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:23.859496 15380 raft_consensus.cc:2804] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.859529 15380 raft_consensus.cc:493] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.859560 15380 raft_consensus.cc:3060] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.859848 15386 ts_tablet_manager.cc:1916] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.860458 15380 raft_consensus.cc:515] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.860769 15380 leader_election.cc:290] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:23.860914 15295 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.861151 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e53e89d1f67840bbbf515e75f8438e87" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:23.861507 15049 leader_election.cc:343] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.861662 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e53e89d1f67840bbbf515e75f8438e87" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:23.861761 14978 raft_consensus.cc:3060] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.861759 15386 ts_tablet_manager.cc:1929] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.861821 15386 log.cc:1199] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/05f0f22c06ed45ae9c3433cc0cd7ffb9
I20251025 08:02:23.862040 15386 ts_tablet_manager.cc:1950] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.862453 15369 tablet_bootstrap.cc:492] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.862521 15369 ts_tablet_manager.cc:1403] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251025 08:02:23.862618 15370 tablet_bootstrap.cc:492] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.862618 14978 raft_consensus.cc:2468] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:23.862689 15370 ts_tablet_manager.cc:1403] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20251025 08:02:23.862835 15369 raft_consensus.cc:359] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.862926 15369 raft_consensus.cc:385] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.862960 15369 raft_consensus.cc:740] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.863055 15369 consensus_queue.cc:260] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.863119 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 (table default.Table_df35e9b11c6c43859e7b3511585c665b [id=e8f1b9d591bb4f8fbbb05ee960280cc6]) successfully deleted
I20251025 08:02:23.863144 15370 raft_consensus.cc:359] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.863245 15370 raft_consensus.cc:385] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.863286 15370 raft_consensus.cc:740] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.863338 15369 ts_tablet_manager.cc:1434] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.863415 14915 leader_election.cc:304] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:23.863415 15370 consensus_queue.cc:260] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.863512 15369 tablet_bootstrap.cc:492] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.863660 15370 ts_tablet_manager.cc:1434] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:23.863763 15374 raft_consensus.cc:2764] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251025 08:02:23.863831 15370 tablet_bootstrap.cc:492] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.863921 15048 leader_election.cc:304] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:23.864193 15376 raft_consensus.cc:2804] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.864277 15376 raft_consensus.cc:697] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:23.864310 15369 tablet_bootstrap.cc:654] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.864385 15376 consensus_queue.cc:237] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.864676 15370 tablet_bootstrap.cc:654] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.864813 15160 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.866525 15025 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.867257 15568 log.cc:826] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21: Log is configured to *not* fsync() on all Append() calls
W20251025 08:02:23.868283 14646 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6dbf9c53df494216865ac4631fd48af4 consensus state has no leader
I20251025 08:02:23.868454 15370 tablet_bootstrap.cc:492] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.868525 15370 ts_tablet_manager.cc:1403] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20251025 08:02:23.868522 15369 tablet_bootstrap.cc:492] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.868587 15369 ts_tablet_manager.cc:1403] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:23.868834 15160 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.868948 15370 raft_consensus.cc:359] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.869043 15370 raft_consensus.cc:385] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.868988 15369 raft_consensus.cc:359] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.869076 15370 raft_consensus.cc:740] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.869094 15369 raft_consensus.cc:385] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.869128 15369 raft_consensus.cc:740] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.869184 15370 consensus_queue.cc:260] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.869261 15369 consensus_queue.cc:260] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.869458 15370 ts_tablet_manager.cc:1434] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:23.869467 15025 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.871590 15369 ts_tablet_manager.cc:1434] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:23.871765 15369 tablet_bootstrap.cc:492] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.872205 15025 heartbeater.cc:344] Connected to a master server at 127.14.70.60:34453
I20251025 08:02:23.872273 15025 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.872709 15160 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.872690 14651 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_9cd0b4b3548a46f3a5cd27fb5e3b9672"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:23.872999 14651 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9cd0b4b3548a46f3a5cd27fb5e3b9672 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.873968 15369 tablet_bootstrap.cc:654] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.874536 14646 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_df35e9b11c6c43859e7b3511585c665b" } new_table_name: "default.Table_af01f40543814889943b631a351a302e" modify_external_catalogs: true
I20251025 08:02:23.875309 15369 tablet_bootstrap.cc:492] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.875384 15369 ts_tablet_manager.cc:1403] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:23.875766 15369 raft_consensus.cc:359] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.875849 15369 raft_consensus.cc:385] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.875876 15369 raft_consensus.cc:740] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.875982 15568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251025 08:02:23.875963 15369 consensus_queue.cc:260] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.876194 15369 ts_tablet_manager.cc:1434] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.876313 15025 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.876332 15568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21: Bootstrap complete.
I20251025 08:02:23.876364 15369 tablet_bootstrap.cc:492] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.877339 15369 tablet_bootstrap.cc:654] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.878803 15025 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
W20251025 08:02:23.879882 14655 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 24a584d6039d4041941f7c53bfcd9f2f has no consensus state
I20251025 08:02:23.880542 15372 tablet_bootstrap.cc:492] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.880625 15372 ts_tablet_manager.cc:1403] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.060s user 0.000s sys 0.002s
I20251025 08:02:23.880662 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_cccb10034b9549bc84a9019610866553"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.880594 15568 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:23.880959 15568 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7109d31951574de3bf05a86c94c11d21, State: Initialized, Role: FOLLOWER
W20251025 08:02:23.880995 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cccb10034b9549bc84a9019610866553 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.881042 15372 raft_consensus.cc:359] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.881124 15372 raft_consensus.cc:385] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.881160 15372 raft_consensus.cc:740] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.881273 15372 consensus_queue.cc:260] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.881479 15372 ts_tablet_manager.cc:1434] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:23.881461 15568 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:23.881645 15372 tablet_bootstrap.cc:492] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.882233 14649 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_5d5bb27ab054422ea0354231c50d1ccf" } new_table_name: "default.Table_3871f03720f24effbbcfc45b952843fd" modify_external_catalogs: true
I20251025 08:02:23.882287 14652 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_bb2712f0481c486fa9db6d0113289be2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.882479 15372 tablet_bootstrap.cc:654] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.882586 15568 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: configured and running, proceeding with master startup.
W20251025 08:02:23.882619 14652 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb2712f0481c486fa9db6d0113289be2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.883085 15295 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.883098 14655 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_f34d90f304ae4c5091f5a1bed946bf11" } new_table_name: "default.Table_eb789fed3e81408b8b688461884e9c5a" modify_external_catalogs: true
I20251025 08:02:23.884104 14650 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_254086ab62b448c7a5fbc8b8c2589716" } modify_external_catalogs: true
I20251025 08:02:23.884196 14650 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_254086ab62b448c7a5fbc8b8c2589716" } modify_external_catalogs: true
I20251025 08:02:23.886212 15369 tablet_bootstrap.cc:492] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.886297 15369 ts_tablet_manager.cc:1403] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:23.886729 15369 raft_consensus.cc:359] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.886834 15369 raft_consensus.cc:385] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.886871 15369 raft_consensus.cc:740] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.886986 15369 consensus_queue.cc:260] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.887255 15369 ts_tablet_manager.cc:1434] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.887421 15369 tablet_bootstrap.cc:492] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.887236 15025 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.888285 15369 tablet_bootstrap.cc:654] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.889262 15519 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" instance_seqno: 1761379342300428) as {username='slave'} at 127.14.70.1:41073; Asking this server to re-register.
I20251025 08:02:23.889992 15372 tablet_bootstrap.cc:492] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.890075 15372 ts_tablet_manager.cc:1403] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251025 08:02:23.890452 15025 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:23.890527 15372 raft_consensus.cc:359] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.890612 15372 raft_consensus.cc:385] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.890647 15372 raft_consensus.cc:740] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.890749 15372 consensus_queue.cc:260] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.890995 15372 ts_tablet_manager.cc:1434] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.891170 15372 tablet_bootstrap.cc:492] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.892046 15608 catalog_manager.cc:1269] Loaded cluster ID: f2d8b893da824042af3b8623826039ce
I20251025 08:02:23.892064 15372 tablet_bootstrap.cc:654] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.892089 15608 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21: loading cluster ID for follower catalog manager: success
I20251025 08:02:23.892927 15519 ts_manager.cc:194] Registered new tserver with Master: ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:23.893014 15295 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.894397 15596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:23.894496 15596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:23.894603 15519 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" instance_seqno: 1761379342623763) as {username='slave'} at 127.14.70.3:42191; Asking this server to re-register.
I20251025 08:02:23.894675 15608 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21: acquiring CA information for follower catalog manager: success
I20251025 08:02:23.895049 15295 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:23.895808 15519 ts_manager.cc:194] Registered new tserver with Master: f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:23.896170 15608 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251025 08:02:23.896711 15372 tablet_bootstrap.cc:492] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.896780 15372 ts_tablet_manager.cc:1403] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:23.896803 15464 raft_consensus.cc:493] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.896867 15464 raft_consensus.cc:515] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.897243 15464 leader_election.cc:290] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.897184 15372 raft_consensus.cc:359] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.897289 15372 raft_consensus.cc:385] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.897323 15372 raft_consensus.cc:740] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.897428 15372 consensus_queue.cc:260] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.897473 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58b14a04ff6a4e18b9daa8c22f6e7307" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.897686 15372 ts_tablet_manager.cc:1434] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20251025 08:02:23.897794 14914 leader_election.cc:343] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.898141 15372 tablet_bootstrap.cc:492] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.898507 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58b14a04ff6a4e18b9daa8c22f6e7307" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:23.898636 15113 raft_consensus.cc:2468] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:23.899039 15372 tablet_bootstrap.cc:654] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.899092 14915 leader_election.cc:304] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:23.899296 15464 raft_consensus.cc:2804] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.899349 15464 raft_consensus.cc:493] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.899406 15464 raft_consensus.cc:3060] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.900321 15372 tablet_bootstrap.cc:492] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.900321 15464 raft_consensus.cc:515] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.900386 15372 ts_tablet_manager.cc:1403] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251025 08:02:23.900641 15464 leader_election.cc:290] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.900775 15372 raft_consensus.cc:359] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:23.900876 15372 raft_consensus.cc:385] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.900878 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58b14a04ff6a4e18b9daa8c22f6e7307" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:23.900930 15372 raft_consensus.cc:740] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.901118 15372 consensus_queue.cc:260] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:23.901242 14914 leader_election.cc:343] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:23.901448 15372 ts_tablet_manager.cc:1434] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:23.901607 15372 tablet_bootstrap.cc:492] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.902540 15372 tablet_bootstrap.cc:654] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.904286 14652 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_4e764c9b1b9d4238b6df2a23c9c3ef34" } modify_external_catalogs: true
I20251025 08:02:23.904392 14652 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_4e764c9b1b9d4238b6df2a23c9c3ef34" } modify_external_catalogs: true
I20251025 08:02:23.904958 14654 master_service.cc:954] ReplaceTablet: received request to replace tablet f52aa4230f7847f6a5effda6c06063a5 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.905242 15372 tablet_bootstrap.cc:492] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.905306 15372 ts_tablet_manager.cc:1403] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:23.905695 15372 raft_consensus.cc:359] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.905777 15372 raft_consensus.cc:385] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.905807 15372 raft_consensus.cc:740] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.905913 15372 consensus_queue.cc:260] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.906414 14651 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_61b65da9fa07408e88597c52bf6358d6" } modify_external_catalogs: true
I20251025 08:02:23.906498 14651 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_61b65da9fa07408e88597c52bf6358d6" } modify_external_catalogs: true
I20251025 08:02:23.906721 15372 ts_tablet_manager.cc:1434] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20251025 08:02:23.907104 14649 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 182d711eb2d547cb91f9624ea17eb4ad has no consensus state
I20251025 08:02:23.907261 14649 master_service.cc:954] ReplaceTablet: received request to replace tablet 0e09fa674c21442cbecdbe1ecbe24359 from {username='slave'} at 127.0.0.1:59180
W20251025 08:02:23.908200 14655 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff155cb1c7e44986bb999bb0177f8f75 consensus state has no leader
I20251025 08:02:23.908346 14655 master_service.cc:954] ReplaceTablet: received request to replace tablet abd8c09e1e884d3cbd36801d6b7f9a98 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.908563 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "58b14a04ff6a4e18b9daa8c22f6e7307" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:23.908691 15113 raft_consensus.cc:3060] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.909593 15113 raft_consensus.cc:2468] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:23.909821 14915 leader_election.cc:304] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:23.909992 15464 raft_consensus.cc:2804] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.910072 15464 raft_consensus.cc:697] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:23.910209 15464 consensus_queue.cc:237] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.910965 15372 tablet_bootstrap.cc:492] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.911972 15372 tablet_bootstrap.cc:654] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.913146 14654 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet f52aa4230f7847f6a5effda6c06063a5
I20251025 08:02:23.913448 14654 catalog_manager.cc:6719] ReplaceTablet: tablet f52aa4230f7847f6a5effda6c06063a5 deleted and replaced by tablet c64cf55ede2446ecbfc47be3e04eb646
I20251025 08:02:23.913573 14654 master_service.cc:954] ReplaceTablet: received request to replace tablet e53e89d1f67840bbbf515e75f8438e87 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.913580 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet f52aa4230f7847f6a5effda6c06063a5 with delete_type TABLET_DATA_DELETED (replaced by tablet c64cf55ede2446ecbfc47be3e04eb646) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.913889 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet f52aa4230f7847f6a5effda6c06063a5 with delete_type TABLET_DATA_DELETED (replaced by tablet c64cf55ede2446ecbfc47be3e04eb646) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.914116 15388 tablet_replica.cc:333] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.914259 15388 raft_consensus.cc:2243] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.914357 15388 raft_consensus.cc:2272] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.914414 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet f52aa4230f7847f6a5effda6c06063a5 with delete_type TABLET_DATA_DELETED (replaced by tablet c64cf55ede2446ecbfc47be3e04eb646) from {username='slave'} at 127.0.0.1:37198
W20251025 08:02:23.914620 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet f52aa4230f7847f6a5effda6c06063a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f52aa4230f7847f6a5effda6c06063a5 already in progress: creating tablet
I20251025 08:02:23.914659 15385 tablet_replica.cc:333] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.914769 15385 raft_consensus.cc:2243] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.914862 15385 raft_consensus.cc:2272] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.915246 15388 ts_tablet_manager.cc:1916] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.917116 15388 ts_tablet_manager.cc:1929] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.917163 15388 log.cc:1199] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/f52aa4230f7847f6a5effda6c06063a5
I20251025 08:02:23.917311 15388 ts_tablet_manager.cc:1950] T f52aa4230f7847f6a5effda6c06063a5 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.917666 15385 ts_tablet_manager.cc:1916] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.917997 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet f52aa4230f7847f6a5effda6c06063a5 (table default.Table_f398b0ec52b14af5889821d6f4bc881d [id=680b8d6772bf4a08a5102bba9a48f34d]) successfully deleted
I20251025 08:02:23.918747 15369 tablet_bootstrap.cc:492] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.918815 15369 ts_tablet_manager.cc:1403] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.000s
I20251025 08:02:23.919219 15369 raft_consensus.cc:359] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.919303 15369 raft_consensus.cc:385] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.919341 15369 raft_consensus.cc:740] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.919440 15369 consensus_queue.cc:260] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.919651 15385 ts_tablet_manager.cc:1929] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.919701 15385 log.cc:1199] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/f52aa4230f7847f6a5effda6c06063a5
I20251025 08:02:23.919723 15369 ts_tablet_manager.cc:1434] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.919889 15385 ts_tablet_manager.cc:1950] T f52aa4230f7847f6a5effda6c06063a5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.919906 15369 tablet_bootstrap.cc:492] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.919950 14654 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet e53e89d1f67840bbbf515e75f8438e87
I20251025 08:02:23.920115 15380 raft_consensus.cc:493] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.920208 14654 catalog_manager.cc:6719] ReplaceTablet: tablet e53e89d1f67840bbbf515e75f8438e87 deleted and replaced by tablet 3f7aa0b88b284d52a6cca064a798aa54
I20251025 08:02:23.920182 15380 raft_consensus.cc:515] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.920377 14654 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_d29e190e7c9b4da8b3f4d850a916123c" } modify_external_catalogs: true
I20251025 08:02:23.920467 14654 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_d29e190e7c9b4da8b3f4d850a916123c" } modify_external_catalogs: true
I20251025 08:02:23.920537 15380 leader_election.cc:290] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:23.920821 15369 tablet_bootstrap.cc:654] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.921599 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff155cb1c7e44986bb999bb0177f8f75" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:23.921717 15246 raft_consensus.cc:2468] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:23.922366 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet e53e89d1f67840bbbf515e75f8438e87 with delete_type TABLET_DATA_DELETED (replaced by tablet 3f7aa0b88b284d52a6cca064a798aa54) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.922825 15049 leader_election.cc:304] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.922986 15380 raft_consensus.cc:2804] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.923032 15380 raft_consensus.cc:493] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.923069 15380 raft_consensus.cc:3060] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.923228 15369 tablet_bootstrap.cc:492] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.923290 15369 ts_tablet_manager.cc:1403] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:23.923386 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet e53e89d1f67840bbbf515e75f8438e87 with delete_type TABLET_DATA_DELETED (replaced by tablet 3f7aa0b88b284d52a6cca064a798aa54) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.923378 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet f52aa4230f7847f6a5effda6c06063a5 (table default.Table_f398b0ec52b14af5889821d6f4bc881d [id=680b8d6772bf4a08a5102bba9a48f34d]) successfully deleted
I20251025 08:02:23.923620 15386 tablet_replica.cc:333] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.923642 15369 raft_consensus.cc:359] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.923732 15369 raft_consensus.cc:385] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.923739 15386 raft_consensus.cc:2243] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.923769 15369 raft_consensus.cc:740] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.923817 15386 raft_consensus.cc:2272] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.923877 15380 raft_consensus.cc:515] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.924015 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff155cb1c7e44986bb999bb0177f8f75" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.924110 14978 raft_consensus.cc:2468] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:23.924180 15380 leader_election.cc:290] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:23.924341 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet e53e89d1f67840bbbf515e75f8438e87 with delete_type TABLET_DATA_DELETED (replaced by tablet 3f7aa0b88b284d52a6cca064a798aa54) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.924568 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff155cb1c7e44986bb999bb0177f8f75" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:23.924669 15246 raft_consensus.cc:3060] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.925032 15386 ts_tablet_manager.cc:1916] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.925112 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff155cb1c7e44986bb999bb0177f8f75" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:23.925210 14978 raft_consensus.cc:3060] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.925585 15246 raft_consensus.cc:2468] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:23.925822 14978 raft_consensus.cc:2468] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:23.925945 15049 leader_election.cc:304] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:23.926458 15388 tablet_replica.cc:333] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.926570 15388 raft_consensus.cc:2243] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:23.926694 15388 pending_rounds.cc:70] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:23.926721 15388 pending_rounds.cc:77] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609792469704704 op_type: NO_OP noop_request { }
I20251025 08:02:23.926762 15388 raft_consensus.cc:2889] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:23.926811 15388 raft_consensus.cc:2272] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.926986 15386 ts_tablet_manager.cc:1929] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.926959 15369 consensus_queue.cc:260] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.927038 15386 log.cc:1199] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/e53e89d1f67840bbbf515e75f8438e87
I20251025 08:02:23.927233 15386 ts_tablet_manager.cc:1950] T e53e89d1f67840bbbf515e75f8438e87 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.927286 15369 ts_tablet_manager.cc:1434] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:23.927407 15380 raft_consensus.cc:2804] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:23.927477 15380 raft_consensus.cc:697] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:23.927585 15380 consensus_queue.cc:237] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.928251 15160 heartbeater.cc:499] Master 127.14.70.60:34453 was elected leader, sending a full tablet report...
I20251025 08:02:23.929682 15385 tablet_replica.cc:333] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.929783 15385 raft_consensus.cc:2243] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.929864 15385 raft_consensus.cc:2272] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.930164 15519 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e51a2be794f04642b89386067ecbc77e" instance_seqno: 1761379342456414) as {username='slave'} at 127.14.70.2:47747; Asking this server to re-register.
I20251025 08:02:23.930308 15385 ts_tablet_manager.cc:1916] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.930720 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 182d711eb2d547cb91f9624ea17eb4ad (DEFAULT_TABLE table=default.Table_3871f03720f24effbbcfc45b952843fd [id=33c97f69fa104ce1bff69626847a5b68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.930928 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182d711eb2d547cb91f9624ea17eb4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.931355 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 182d711eb2d547cb91f9624ea17eb4ad (DEFAULT_TABLE table=default.Table_3871f03720f24effbbcfc45b952843fd [id=33c97f69fa104ce1bff69626847a5b68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.931506 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 24a584d6039d4041941f7c53bfcd9f2f (DEFAULT_TABLE table=default.Table_0f289526bf514ddc90a5622136145bff [id=170fdc9a02124e5488b4ac3d2776ca83]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.931576 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182d711eb2d547cb91f9624ea17eb4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.931674 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24a584d6039d4041941f7c53bfcd9f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.931977 15385 ts_tablet_manager.cc:1929] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.932039 15385 log.cc:1199] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/e53e89d1f67840bbbf515e75f8438e87
I20251025 08:02:23.932214 15385 ts_tablet_manager.cc:1950] T e53e89d1f67840bbbf515e75f8438e87 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.932875 15160 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:23.932916 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 05be924a2b1c4f16a6cff056df2c1f71 (DEFAULT_TABLE table=default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.933138 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05be924a2b1c4f16a6cff056df2c1f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.933976 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 05be924a2b1c4f16a6cff056df2c1f71 (DEFAULT_TABLE table=default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.927613 15388 ts_tablet_manager.cc:1916] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.934232 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05be924a2b1c4f16a6cff056df2c1f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.935683 15519 ts_manager.cc:194] Registered new tserver with Master: e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:23.936244 15388 ts_tablet_manager.cc:1929] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:23.936306 15370 tablet_bootstrap.cc:492] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.936313 15388 log.cc:1199] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/e53e89d1f67840bbbf515e75f8438e87
I20251025 08:02:23.936619 15388 ts_tablet_manager.cc:1950] T e53e89d1f67840bbbf515e75f8438e87 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.937199 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet e53e89d1f67840bbbf515e75f8438e87 (table default.Table_beb1f6ec236e4f3b96df6b5201581c79 [id=cead87820a99412e936796998d2150dc]) successfully deleted
I20251025 08:02:23.937237 15370 tablet_bootstrap.cc:654] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.938254 15370 tablet_bootstrap.cc:492] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.938344 15370 ts_tablet_manager.cc:1403] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251025 08:02:23.938760 15370 raft_consensus.cc:359] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.938848 15370 raft_consensus.cc:385] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.938877 15370 raft_consensus.cc:740] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.938995 15370 consensus_queue.cc:260] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.939285 15370 ts_tablet_manager.cc:1434] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.939596 15370 tablet_bootstrap.cc:492] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.939920 15093 tablet_service.cc:1505] Processing CreateTablet for tablet b9d37ec643294d4fb8a715596f078599 (DEFAULT_TABLE table=default.Table_742a7811d8054888be95298c1febef0d [id=9ca80f87609a4cb789c6164e313f3f20]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.940138 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d37ec643294d4fb8a715596f078599. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.940637 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet e53e89d1f67840bbbf515e75f8438e87 (table default.Table_beb1f6ec236e4f3b96df6b5201581c79 [id=cead87820a99412e936796998d2150dc]) successfully deleted
I20251025 08:02:23.941354 15370 tablet_bootstrap.cc:654] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.941754 15227 tablet_service.cc:1505] Processing CreateTablet for tablet b9d37ec643294d4fb8a715596f078599 (DEFAULT_TABLE table=default.Table_742a7811d8054888be95298c1febef0d [id=9ca80f87609a4cb789c6164e313f3f20]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.941967 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d37ec643294d4fb8a715596f078599. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.942402 15370 tablet_bootstrap.cc:492] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.942480 15370 ts_tablet_manager.cc:1403] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:23.942682 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet e53e89d1f67840bbbf515e75f8438e87 (table default.Table_beb1f6ec236e4f3b96df6b5201581c79 [id=cead87820a99412e936796998d2150dc]) successfully deleted
I20251025 08:02:23.942934 15370 raft_consensus.cc:359] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.943040 15370 raft_consensus.cc:385] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.943074 15370 raft_consensus.cc:740] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.943192 15370 consensus_queue.cc:260] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.943419 15370 ts_tablet_manager.cc:1434] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.943454 14957 tablet_service.cc:1505] Processing CreateTablet for tablet b9d37ec643294d4fb8a715596f078599 (DEFAULT_TABLE table=default.Table_742a7811d8054888be95298c1febef0d [id=9ca80f87609a4cb789c6164e313f3f20]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.943571 15370 tablet_bootstrap.cc:492] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.943529 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 05be924a2b1c4f16a6cff056df2c1f71 (DEFAULT_TABLE table=default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.943670 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9d37ec643294d4fb8a715596f078599. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.944176 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05be924a2b1c4f16a6cff056df2c1f71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.944401 15370 tablet_bootstrap.cc:654] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.945322 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 182d711eb2d547cb91f9624ea17eb4ad (DEFAULT_TABLE table=default.Table_3871f03720f24effbbcfc45b952843fd [id=33c97f69fa104ce1bff69626847a5b68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.945526 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 182d711eb2d547cb91f9624ea17eb4ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.945631 15369 tablet_bootstrap.cc:492] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.943452 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 24a584d6039d4041941f7c53bfcd9f2f (DEFAULT_TABLE table=default.Table_0f289526bf514ddc90a5622136145bff [id=170fdc9a02124e5488b4ac3d2776ca83]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.945955 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24a584d6039d4041941f7c53bfcd9f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.947803 15372 tablet_bootstrap.cc:492] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.947873 15369 tablet_bootstrap.cc:654] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.947881 15372 ts_tablet_manager.cc:1403] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.000s
I20251025 08:02:23.948206 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 24a584d6039d4041941f7c53bfcd9f2f (DEFAULT_TABLE table=default.Table_0f289526bf514ddc90a5622136145bff [id=170fdc9a02124e5488b4ac3d2776ca83]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:23.948346 15372 raft_consensus.cc:359] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.948426 15372 raft_consensus.cc:385] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.948480 15372 raft_consensus.cc:740] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.948431 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24a584d6039d4041941f7c53bfcd9f2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:23.948627 15372 consensus_queue.cc:260] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:23.948987 14646 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 58b14a04ff6a4e18b9daa8c22f6e7307 consensus state has no leader
I20251025 08:02:23.949189 14646 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_bc4af92ab72c4a9a92d850a89056986c" } modify_external_catalogs: true
I20251025 08:02:23.949291 14646 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_bc4af92ab72c4a9a92d850a89056986c" } modify_external_catalogs: true
I20251025 08:02:23.951412 15372 ts_tablet_manager.cc:1434] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:23.952105 14647 master_service.cc:954] ReplaceTablet: received request to replace tablet 6dbf9c53df494216865ac4631fd48af4 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:23.952466 15372 tablet_bootstrap.cc:492] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.953533 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet f52aa4230f7847f6a5effda6c06063a5 with delete_type TABLET_DATA_DELETED (replaced by tablet c64cf55ede2446ecbfc47be3e04eb646) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:23.953915 14642 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet f52aa4230f7847f6a5effda6c06063a5 because the tablet was not found. No further retry: Not found: Tablet not found: f52aa4230f7847f6a5effda6c06063a5
I20251025 08:02:23.954458 15372 tablet_bootstrap.cc:654] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.955379 15369 tablet_bootstrap.cc:492] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.955449 15369 ts_tablet_manager.cc:1403] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20251025 08:02:23.955822 15369 raft_consensus.cc:359] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.955917 15369 raft_consensus.cc:385] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.955945 15369 raft_consensus.cc:740] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.956053 15369 consensus_queue.cc:260] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.956307 15369 ts_tablet_manager.cc:1434] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:23.956457 15369 tablet_bootstrap.cc:492] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.956696 15370 tablet_bootstrap.cc:492] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.956779 15370 ts_tablet_manager.cc:1403] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20251025 08:02:23.957183 15370 raft_consensus.cc:359] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.957275 15370 raft_consensus.cc:385] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.957309 15370 raft_consensus.cc:740] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.957317 15369 tablet_bootstrap.cc:654] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.957419 15370 consensus_queue.cc:260] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.957650 15370 ts_tablet_manager.cc:1434] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.957818 15370 tablet_bootstrap.cc:492] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:23.958477 14650 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 3dc4e2f330ed47369b8ed63b1bcf134b
I20251025 08:02:23.959652 14650 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 182d711eb2d547cb91f9624ea17eb4ad (table default.Table_3871f03720f24effbbcfc45b952843fd [id=33c97f69fa104ce1bff69626847a5b68]). Expected version 1 got 0
I20251025 08:02:23.959760 14650 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 24a584d6039d4041941f7c53bfcd9f2f (table default.Table_0f289526bf514ddc90a5622136145bff [id=170fdc9a02124e5488b4ac3d2776ca83]). Expected version 1 got 0
I20251025 08:02:23.959853 14650 catalog_manager.cc:5649] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:23.960032 14650 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet ff155cb1c7e44986bb999bb0177f8f75 (table default.Table_eb789fed3e81408b8b688461884e9c5a [id=1ee33ee129d749d0bd7f26dc49fca0fe]). Expected version 1 got 0
I20251025 08:02:23.960417 14651 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 80518db725264459a5d56b32f61ff9f8
I20251025 08:02:23.961004 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 3dc4e2f330ed47369b8ed63b1bcf134b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.961153 15388 tablet_replica.cc:333] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.961229 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 80518db725264459a5d56b32f61ff9f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.961241 15388 raft_consensus.cc:2243] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.961467 14655 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet abd8c09e1e884d3cbd36801d6b7f9a98
I20251025 08:02:23.961503 15388 raft_consensus.cc:2272] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.961683 14655 catalog_manager.cc:6719] ReplaceTablet: tablet abd8c09e1e884d3cbd36801d6b7f9a98 deleted and replaced by tablet 1695780ae4e24c288df851c2aff7e22c
I20251025 08:02:23.962376 15369 tablet_bootstrap.cc:492] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.962422 15370 tablet_bootstrap.cc:654] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.962445 15369 ts_tablet_manager.cc:1403] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20251025 08:02:23.962505 15388 ts_tablet_manager.cc:1916] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.962818 15369 raft_consensus.cc:359] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.962913 15369 raft_consensus.cc:385] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.962954 15369 raft_consensus.cc:740] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.963073 15369 consensus_queue.cc:260] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.963336 15369 ts_tablet_manager.cc:1434] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.963351 15372 tablet_bootstrap.cc:492] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.963429 15372 ts_tablet_manager.cc:1403] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20251025 08:02:23.963472 15369 tablet_bootstrap.cc:492] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.963852 15372 raft_consensus.cc:359] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.963948 15372 raft_consensus.cc:385] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.963989 15372 raft_consensus.cc:740] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.964109 15372 consensus_queue.cc:260] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.964303 15369 tablet_bootstrap.cc:654] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.964417 15372 ts_tablet_manager.cc:1434] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.964494 15388 ts_tablet_manager.cc:1929] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.964558 15388 log.cc:1199] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/3dc4e2f330ed47369b8ed63b1bcf134b
I20251025 08:02:23.964629 15372 tablet_bootstrap.cc:492] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.964756 15388 ts_tablet_manager.cc:1950] T 3dc4e2f330ed47369b8ed63b1bcf134b P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.965188 15388 tablet_replica.cc:333] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.965291 15388 raft_consensus.cc:2243] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.965370 15388 raft_consensus.cc:2272] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.965492 15372 tablet_bootstrap.cc:654] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.966167 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 3dc4e2f330ed47369b8ed63b1bcf134b (table default.Table_254086ab62b448c7a5fbc8b8c2589716 [id=f08621eb6d0e46cda20a72e487a1c2da]) successfully deleted
I20251025 08:02:23.966336 15369 tablet_bootstrap.cc:492] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.966416 15369 ts_tablet_manager.cc:1403] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:23.966428 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet abd8c09e1e884d3cbd36801d6b7f9a98 with delete_type TABLET_DATA_DELETED (replaced by tablet 1695780ae4e24c288df851c2aff7e22c) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.966903 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet abd8c09e1e884d3cbd36801d6b7f9a98 with delete_type TABLET_DATA_DELETED (replaced by tablet 1695780ae4e24c288df851c2aff7e22c) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.967056 15385 tablet_replica.cc:333] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.967147 15385 raft_consensus.cc:2243] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:23.967269 15385 pending_rounds.cc:70] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:23.967296 15385 pending_rounds.cc:77] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609792387653632 op_type: NO_OP noop_request { }
I20251025 08:02:23.967336 15385 raft_consensus.cc:2889] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:23.967378 15385 raft_consensus.cc:2272] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.966900 15369 raft_consensus.cc:359] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.967876 15369 raft_consensus.cc:385] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.967909 15385 ts_tablet_manager.cc:1916] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.967883 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 3dc4e2f330ed47369b8ed63b1bcf134b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.968564 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 80518db725264459a5d56b32f61ff9f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.969727 15385 ts_tablet_manager.cc:1929] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:23.969784 15385 log.cc:1199] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/abd8c09e1e884d3cbd36801d6b7f9a98
I20251025 08:02:23.970001 15385 ts_tablet_manager.cc:1950] T abd8c09e1e884d3cbd36801d6b7f9a98 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.970405 15388 ts_tablet_manager.cc:1916] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.970494 15385 tablet_replica.cc:333] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.970577 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet abd8c09e1e884d3cbd36801d6b7f9a98 (table default.Table_c11d0b545be3442685df355dba9a8f12 [id=9f02c9df85ba446cbe85aa321eb93c2d]) successfully deleted
I20251025 08:02:23.970708 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 3dc4e2f330ed47369b8ed63b1bcf134b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.970821 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet 80518db725264459a5d56b32f61ff9f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.970899 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet abd8c09e1e884d3cbd36801d6b7f9a98 with delete_type TABLET_DATA_DELETED (replaced by tablet 1695780ae4e24c288df851c2aff7e22c) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.971103 15386 tablet_replica.cc:333] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.971143 15385 raft_consensus.cc:2243] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.971203 15386 raft_consensus.cc:2243] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.971225 15385 raft_consensus.cc:2272] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.971280 15386 raft_consensus.cc:2272] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.971619 15385 ts_tablet_manager.cc:1916] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.972152 15388 ts_tablet_manager.cc:1929] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.972234 15388 log.cc:1199] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/80518db725264459a5d56b32f61ff9f8
I20251025 08:02:23.972441 15388 ts_tablet_manager.cc:1950] T 80518db725264459a5d56b32f61ff9f8 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.972971 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 80518db725264459a5d56b32f61ff9f8 (table default.Table_61b65da9fa07408e88597c52bf6358d6 [id=2421416ff90d4fe4977a03bce3048815]) successfully deleted
I20251025 08:02:23.973104 15113 raft_consensus.cc:1275] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer f0f2f8ce3e9f4d9ba3f3f02813397c31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:23.973194 15386 ts_tablet_manager.cc:1916] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.973203 15388 tablet_replica.cc:333] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.973311 15388 raft_consensus.cc:2243] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.973395 15388 raft_consensus.cc:2272] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.973800 15388 ts_tablet_manager.cc:1916] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.973814 14978 raft_consensus.cc:1275] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer f0f2f8ce3e9f4d9ba3f3f02813397c31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251025 08:02:23.974416 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 3dc4e2f330ed47369b8ed63b1bcf134b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3dc4e2f330ed47369b8ed63b1bcf134b already in progress: creating tablet
I20251025 08:02:23.975126 15386 ts_tablet_manager.cc:1929] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.975191 15386 log.cc:1199] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/80518db725264459a5d56b32f61ff9f8
I20251025 08:02:23.975322 15372 tablet_bootstrap.cc:492] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.975379 15386 ts_tablet_manager.cc:1950] T 80518db725264459a5d56b32f61ff9f8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.975589 15388 ts_tablet_manager.cc:1929] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.975647 15388 log.cc:1199] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/abd8c09e1e884d3cbd36801d6b7f9a98
I20251025 08:02:23.975697 14646 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet cd03eb08d0e54427a4709a4de4c4796c
I20251025 08:02:23.975827 15388 ts_tablet_manager.cc:1950] T abd8c09e1e884d3cbd36801d6b7f9a98 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:23.975852 15386 tablet_replica.cc:333] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.975951 15386 raft_consensus.cc:2243] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.976032 15386 raft_consensus.cc:2272] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.976140 15384 consensus_queue.cc:1048] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:23.976441 15386 ts_tablet_manager.cc:1916] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.976502 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 80518db725264459a5d56b32f61ff9f8 (table default.Table_61b65da9fa07408e88597c52bf6358d6 [id=2421416ff90d4fe4977a03bce3048815]) successfully deleted
I20251025 08:02:23.976634 15384 consensus_queue.cc:1048] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:23.977085 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet cd03eb08d0e54427a4709a4de4c4796c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.975386 15372 ts_tablet_manager.cc:1403] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20251025 08:02:23.977581 15372 raft_consensus.cc:359] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.977653 15372 raft_consensus.cc:385] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.977680 15372 raft_consensus.cc:740] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.977660 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet cd03eb08d0e54427a4709a4de4c4796c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.977772 15372 consensus_queue.cc:260] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.978052 15372 ts_tablet_manager.cc:1434] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:23.978071 15386 ts_tablet_manager.cc:1929] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.978229 15372 tablet_bootstrap.cc:492] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.978603 15385 ts_tablet_manager.cc:1929] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.978664 15385 log.cc:1199] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/3dc4e2f330ed47369b8ed63b1bcf134b
I20251025 08:02:23.978838 15385 ts_tablet_manager.cc:1950] T 3dc4e2f330ed47369b8ed63b1bcf134b P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.979079 15372 tablet_bootstrap.cc:654] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.979295 15385 tablet_replica.cc:333] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.979391 15385 raft_consensus.cc:2243] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.979468 15385 raft_consensus.cc:2272] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.979503 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet cd03eb08d0e54427a4709a4de4c4796c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.978116 15386 log.cc:1199] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/abd8c09e1e884d3cbd36801d6b7f9a98
I20251025 08:02:23.979733 15386 ts_tablet_manager.cc:1950] T abd8c09e1e884d3cbd36801d6b7f9a98 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.980167 15386 tablet_replica.cc:333] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.980259 15386 raft_consensus.cc:2243] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:23.980281 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet abd8c09e1e884d3cbd36801d6b7f9a98 (table default.Table_c11d0b545be3442685df355dba9a8f12 [id=9f02c9df85ba446cbe85aa321eb93c2d]) successfully deleted
I20251025 08:02:23.980347 15386 pending_rounds.cc:70] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 2 pending ops.
I20251025 08:02:23.980371 15386 pending_rounds.cc:77] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7214609792910450688 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "cd03eb08d0e54427a4709a4de4c4796c" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_bc4af92ab72c4a9a92d850a89056986c" dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" new_extra_config { } }
W20251025 08:02:23.980471 15386 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:36846: Aborted: Op aborted
I20251025 08:02:23.980605 15386 pending_rounds.cc:77] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609792420339712 op_type: NO_OP noop_request { }
I20251025 08:02:23.980660 15386 raft_consensus.cc:2889] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:23.980708 15386 raft_consensus.cc:2272] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.967916 15369 raft_consensus.cc:740] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.980939 15369 consensus_queue.cc:260] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.981225 15386 ts_tablet_manager.cc:1916] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.981248 15369 ts_tablet_manager.cc:1434] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:23.981403 15369 tablet_bootstrap.cc:492] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:23.982045 15388 tablet_replica.cc:333] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:23.982147 15388 raft_consensus.cc:2243] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.982360 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet abd8c09e1e884d3cbd36801d6b7f9a98 (table default.Table_c11d0b545be3442685df355dba9a8f12 [id=9f02c9df85ba446cbe85aa321eb93c2d]) successfully deleted
I20251025 08:02:23.982432 15370 tablet_bootstrap.cc:492] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:23.982498 15370 ts_tablet_manager.cc:1403] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.002s
I20251025 08:02:23.983014 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 3dc4e2f330ed47369b8ed63b1bcf134b (table default.Table_254086ab62b448c7a5fbc8b8c2589716 [id=f08621eb6d0e46cda20a72e487a1c2da]) successfully deleted
I20251025 08:02:23.983080 15369 tablet_bootstrap.cc:654] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.983851 15385 ts_tablet_manager.cc:1916] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.984851 15370 raft_consensus.cc:359] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.984956 15370 raft_consensus.cc:385] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.984987 15370 raft_consensus.cc:740] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.985103 15370 consensus_queue.cc:260] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.985229 15386 ts_tablet_manager.cc:1929] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:23.985283 15386 log.cc:1199] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/cd03eb08d0e54427a4709a4de4c4796c
I20251025 08:02:23.985419 15370 ts_tablet_manager.cc:1434] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20251025 08:02:23.985519 15386 ts_tablet_manager.cc:1950] T cd03eb08d0e54427a4709a4de4c4796c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.985584 15388 pending_rounds.cc:70] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e: Trying to abort 2 pending ops.
I20251025 08:02:23.985616 15388 pending_rounds.cc:77] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7214609792910450688 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "cd03eb08d0e54427a4709a4de4c4796c" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_bc4af92ab72c4a9a92d850a89056986c" dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" new_extra_config { } }
I20251025 08:02:23.985802 15388 pending_rounds.cc:77] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609792420339712 op_type: NO_OP noop_request { }
I20251025 08:02:23.985853 15388 raft_consensus.cc:2889] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:23.985913 15388 raft_consensus.cc:2272] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.986291 14647 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 6dbf9c53df494216865ac4631fd48af4
I20251025 08:02:23.986531 15369 tablet_bootstrap.cc:492] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:23.986593 14647 catalog_manager.cc:6719] ReplaceTablet: tablet 6dbf9c53df494216865ac4631fd48af4 deleted and replaced by tablet 44036e636edf42b89952e23dfc1a3d4c
I20251025 08:02:23.986603 15369 ts_tablet_manager.cc:1403] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:23.987056 15385 ts_tablet_manager.cc:1929] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.987039 15369 raft_consensus.cc:359] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.987128 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 6dbf9c53df494216865ac4631fd48af4 with delete_type TABLET_DATA_DELETED (replaced by tablet 44036e636edf42b89952e23dfc1a3d4c) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.987176 15369 raft_consensus.cc:385] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.987205 15369 raft_consensus.cc:740] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.987265 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 6dbf9c53df494216865ac4631fd48af4 with delete_type TABLET_DATA_DELETED (replaced by tablet 44036e636edf42b89952e23dfc1a3d4c) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:23.987417 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 6dbf9c53df494216865ac4631fd48af4 with delete_type TABLET_DATA_DELETED (replaced by tablet 44036e636edf42b89952e23dfc1a3d4c) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:23.987429 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet cd03eb08d0e54427a4709a4de4c4796c (table default.Table_bc4af92ab72c4a9a92d850a89056986c [id=9922f64110ca4506bc2d3454cb7a297f]) successfully deleted
I20251025 08:02:23.987560 15386 tablet_replica.cc:333] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:23.987665 15386 raft_consensus.cc:2243] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.987744 15386 raft_consensus.cc:2272] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.988871 15386 ts_tablet_manager.cc:1916] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:23.989239 14653 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet ff155cb1c7e44986bb999bb0177f8f75 (table default.Table_eb789fed3e81408b8b688461884e9c5a [id=1ee33ee129d749d0bd7f26dc49fca0fe]). Expected version 1 got 0
I20251025 08:02:23.989465 14652 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 0e09fa674c21442cbecdbe1ecbe24359
I20251025 08:02:23.990022 15497 raft_consensus.cc:493] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:23.990089 15497 raft_consensus.cc:515] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.990419 15497 leader_election.cc:290] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:23.990798 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6dbf9c53df494216865ac4631fd48af4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:23.990895 14979 raft_consensus.cc:2468] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:23.990779 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 0e09fa674c21442cbecdbe1ecbe24359 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.991206 15048 leader_election.cc:304] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:23.991338 15497 raft_consensus.cc:2804] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:23.991374 15497 raft_consensus.cc:493] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:23.991406 15497 raft_consensus.cc:3060] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.987154 15385 log.cc:1199] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/80518db725264459a5d56b32f61ff9f8
I20251025 08:02:23.992163 15497 raft_consensus.cc:515] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.992393 15385 ts_tablet_manager.cc:1950] T 80518db725264459a5d56b32f61ff9f8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:23.992450 15497 leader_election.cc:290] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:23.992839 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6dbf9c53df494216865ac4631fd48af4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:23.992878 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 80518db725264459a5d56b32f61ff9f8 (table default.Table_61b65da9fa07408e88597c52bf6358d6 [id=2421416ff90d4fe4977a03bce3048815]) successfully deleted
I20251025 08:02:23.992923 14979 raft_consensus.cc:3060] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:23.993098 15385 tablet_replica.cc:333] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:23.993203 15385 raft_consensus.cc:2243] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:23.993201 14654 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 289e3ff2a6be4daaadcac6fe492117c9
I20251025 08:02:23.993273 15385 pending_rounds.cc:70] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 2 pending ops.
I20251025 08:02:23.993295 15385 pending_rounds.cc:77] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7214609792910450688 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "cd03eb08d0e54427a4709a4de4c4796c" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_bc4af92ab72c4a9a92d850a89056986c" dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" new_extra_config { } }
I20251025 08:02:23.993430 15385 pending_rounds.cc:77] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609792420339712 op_type: NO_OP noop_request { }
I20251025 08:02:23.993479 15385 raft_consensus.cc:2889] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:23.993537 15385 raft_consensus.cc:2272] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:23.993638 14979 raft_consensus.cc:2468] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:23.993881 15048 leader_election.cc:304] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:23.994041 15497 raft_consensus.cc:2804] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
W20251025 08:02:23.994527 15632 consensus_queue.cc:1175] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ab02c9d78a9d42f193755d436c8d44b2" status { last_received { term: 1 index: 2 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 2 } }
I20251025 08:02:23.994691 15386 ts_tablet_manager.cc:1929] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:23.994743 15386 log.cc:1199] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/6dbf9c53df494216865ac4631fd48af4
I20251025 08:02:23.994910 15386 ts_tablet_manager.cc:1950] T 6dbf9c53df494216865ac4631fd48af4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:23.994894 14648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_78f6013cec184a249b798e35ae7f09ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:23.987321 15369 consensus_queue.cc:260] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.995075 15372 tablet_bootstrap.cc:492] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.995139 15372 ts_tablet_manager.cc:1403] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20251025 08:02:23.995219 15369 ts_tablet_manager.cc:1434] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
W20251025 08:02:23.995241 14648 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78f6013cec184a249b798e35ae7f09ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:23.995682 15372 raft_consensus.cc:359] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.995771 15372 raft_consensus.cc:385] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:23.995807 15372 raft_consensus.cc:740] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:23.995918 15372 consensus_queue.cc:260] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.996167 15372 ts_tablet_manager.cc:1434] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:23.996335 15372 tablet_bootstrap.cc:492] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:23.997215 15372 tablet_bootstrap.cc:654] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:23.994117 15497 raft_consensus.cc:697] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:23.998312 15497 consensus_queue.cc:237] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:23.998438 15372 tablet_bootstrap.cc:492] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:23.998518 15372 ts_tablet_manager.cc:1403] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:23.999553 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 289e3ff2a6be4daaadcac6fe492117c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.999621 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 with delete_type TABLET_DATA_DELETED (replaced by tablet 58b14a04ff6a4e18b9daa8c22f6e7307) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:23.999763 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 289e3ff2a6be4daaadcac6fe492117c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.000249 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 0e09fa674c21442cbecdbe1ecbe24359 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.000348 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet e53e89d1f67840bbbf515e75f8438e87 with delete_type TABLET_DATA_DELETED (replaced by tablet 3f7aa0b88b284d52a6cca064a798aa54) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.000476 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 0e09fa674c21442cbecdbe1ecbe24359 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.000576 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 289e3ff2a6be4daaadcac6fe492117c9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.000663 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet f637313389174f729f784974fc2f94b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.001024 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 6dbf9c53df494216865ac4631fd48af4 (table default.Table_6b8cc455bb574b30bdb9bca2ac803ae0 [id=6739c1319b784c8eb66fc75125f83056]) successfully deleted
I20251025 08:02:24.001526 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 3dc4e2f330ed47369b8ed63b1bcf134b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:24.002435 14641 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet e53e89d1f67840bbbf515e75f8438e87 because the tablet was not found. No further retry: Not found: Tablet not found: e53e89d1f67840bbbf515e75f8438e87
I20251025 08:02:24.002869 15386 tablet_replica.cc:333] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.002974 15386 raft_consensus.cc:2243] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.003060 15386 raft_consensus.cc:2272] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:24.003676 15049 leader_election.cc:343] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: 6dbf9c53df494216865ac4631fd48af4
W20251025 08:02:24.003957 15049 leader_election.cc:343] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: 6dbf9c53df494216865ac4631fd48af4
I20251025 08:02:24.004171 15245 raft_consensus.cc:1275] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.004310 15372 raft_consensus.cc:359] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.004397 15372 raft_consensus.cc:385] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.004436 15372 raft_consensus.cc:740] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.004527 15380 consensus_queue.cc:1048] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.004550 15372 consensus_queue.cc:260] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.004854 15372 ts_tablet_manager.cc:1434] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:24.005148 15386 ts_tablet_manager.cc:1916] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.005712 15372 tablet_bootstrap.cc:492] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.006757 15372 tablet_bootstrap.cc:654] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.008486 15386 ts_tablet_manager.cc:1929] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.008546 15386 log.cc:1199] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/0e09fa674c21442cbecdbe1ecbe24359
I20251025 08:02:24.008718 15386 ts_tablet_manager.cc:1950] T 0e09fa674c21442cbecdbe1ecbe24359 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.009163 15386 tablet_replica.cc:333] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.009253 15386 raft_consensus.cc:2243] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.009322 15386 raft_consensus.cc:2272] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.009712 14979 raft_consensus.cc:1275] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.010022 15386 ts_tablet_manager.cc:1916] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.010494 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 0e09fa674c21442cbecdbe1ecbe24359 (table default.Table_4e764c9b1b9d4238b6df2a23c9c3ef34 [id=29a1ac5b34e84405ad2a34bd49ea9997]) successfully deleted
I20251025 08:02:24.010622 15497 consensus_queue.cc:1048] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.011379 14649 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 58b14a04ff6a4e18b9daa8c22f6e7307 (table default.Table_af01f40543814889943b631a351a302e [id=e8f1b9d591bb4f8fbbb05ee960280cc6]). Expected version 1 got 0
W20251025 08:02:23.994067 15630 consensus_queue.cc:1175] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e51a2be794f04642b89386067ecbc77e" status { last_received { term: 1 index: 2 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 2 } }
I20251025 08:02:24.011960 15386 ts_tablet_manager.cc:1929] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.012012 15386 log.cc:1199] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/289e3ff2a6be4daaadcac6fe492117c9
I20251025 08:02:24.012187 15386 ts_tablet_manager.cc:1950] T 289e3ff2a6be4daaadcac6fe492117c9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.012609 15386 tablet_replica.cc:333] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.012687 15388 ts_tablet_manager.cc:1916] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.012698 15386 raft_consensus.cc:2243] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.012719 14958 tablet_service.cc:1505] Processing CreateTablet for tablet e0635cb57c4d4d51bed5897b28cc3dcd (DEFAULT_TABLE table=default.Table_bb2712f0481c486fa9db6d0113289be2 [id=198c7d73328440ac8c6eef2c24c5e0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.012778 15386 raft_consensus.cc:2272] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.012928 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0635cb57c4d4d51bed5897b28cc3dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.014539 15385 ts_tablet_manager.cc:1916] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.014703 15388 ts_tablet_manager.cc:1929] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.014766 15388 log.cc:1199] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/cd03eb08d0e54427a4709a4de4c4796c
I20251025 08:02:24.015015 15388 ts_tablet_manager.cc:1950] T cd03eb08d0e54427a4709a4de4c4796c P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.015550 15388 tablet_replica.cc:333] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.015599 14649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_8f74d707fd274ba48bd0f75155b2a180"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.015657 15388 raft_consensus.cc:2243] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.015765 15388 pending_rounds.cc:70] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:24.015791 15388 pending_rounds.cc:77] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609793018638336 op_type: NO_OP noop_request { }
I20251025 08:02:24.015830 15388 raft_consensus.cc:2889] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:24.015874 15388 raft_consensus.cc:2272] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:24.015924 14649 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f74d707fd274ba48bd0f75155b2a180 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.016323 15385 ts_tablet_manager.cc:1929] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.016383 15385 log.cc:1199] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/cd03eb08d0e54427a4709a4de4c4796c
I20251025 08:02:24.016603 15385 ts_tablet_manager.cc:1950] T cd03eb08d0e54427a4709a4de4c4796c P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.016645 14648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_40e75fd0e39f4ae69856bde4bfd62a45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.016944 14648 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_40e75fd0e39f4ae69856bde4bfd62a45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.017082 15385 tablet_replica.cc:333] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.017174 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet cd03eb08d0e54427a4709a4de4c4796c (table default.Table_bc4af92ab72c4a9a92d850a89056986c [id=9922f64110ca4506bc2d3454cb7a297f]) successfully deleted
I20251025 08:02:24.017223 15385 raft_consensus.cc:2243] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.017302 15385 raft_consensus.cc:2272] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.017743 15385 ts_tablet_manager.cc:1916] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.018299 15369 tablet_bootstrap.cc:492] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.018929 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet cd03eb08d0e54427a4709a4de4c4796c (table default.Table_bc4af92ab72c4a9a92d850a89056986c [id=9922f64110ca4506bc2d3454cb7a297f]) successfully deleted
I20251025 08:02:24.019042 15093 tablet_service.cc:1505] Processing CreateTablet for tablet e0635cb57c4d4d51bed5897b28cc3dcd (DEFAULT_TABLE table=default.Table_bb2712f0481c486fa9db6d0113289be2 [id=198c7d73328440ac8c6eef2c24c5e0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.019265 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0635cb57c4d4d51bed5897b28cc3dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.019304 15436 tablet.cc:1722] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.019588 14653 catalog_manager.cc:5649] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:24.019757 14653 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 58b14a04ff6a4e18b9daa8c22f6e7307 (table default.Table_af01f40543814889943b631a351a302e [id=e8f1b9d591bb4f8fbbb05ee960280cc6]). Expected version 1 got 0
I20251025 08:02:24.019878 14653 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 182d711eb2d547cb91f9624ea17eb4ad (table default.Table_3871f03720f24effbbcfc45b952843fd [id=33c97f69fa104ce1bff69626847a5b68]). Expected version 1 got 0
I20251025 08:02:24.019961 14653 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 24a584d6039d4041941f7c53bfcd9f2f (table default.Table_0f289526bf514ddc90a5622136145bff [id=170fdc9a02124e5488b4ac3d2776ca83]). Expected version 1 got 0
I20251025 08:02:24.020102 14653 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet ff155cb1c7e44986bb999bb0177f8f75 (table default.Table_eb789fed3e81408b8b688461884e9c5a [id=1ee33ee129d749d0bd7f26dc49fca0fe]). Expected version 1 got 0
I20251025 08:02:24.021236 15370 tablet_bootstrap.cc:492] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.021466 15227 tablet_service.cc:1505] Processing CreateTablet for tablet e0635cb57c4d4d51bed5897b28cc3dcd (DEFAULT_TABLE table=default.Table_bb2712f0481c486fa9db6d0113289be2 [id=198c7d73328440ac8c6eef2c24c5e0ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.021579 15380 raft_consensus.cc:493] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.021660 15380 raft_consensus.cc:515] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.021703 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0635cb57c4d4d51bed5897b28cc3dcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.021715 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 289e3ff2a6be4daaadcac6fe492117c9 (table default.Table_d29e190e7c9b4da8b3f4d850a916123c [id=69c97a171f1e480ba9faf62bacc1ec38]) successfully deleted
I20251025 08:02:24.021979 15380 leader_election.cc:290] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.022097 15370 tablet_bootstrap.cc:654] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.022693 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "24a584d6039d4041941f7c53bfcd9f2f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.022790 14978 raft_consensus.cc:2468] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:24.023051 15048 leader_election.cc:304] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:24.023494 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet f52aa4230f7847f6a5effda6c06063a5 with delete_type TABLET_DATA_DELETED (replaced by tablet c64cf55ede2446ecbfc47be3e04eb646) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.023728 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 3dc4e2f330ed47369b8ed63b1bcf134b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.023887 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 3f7aa0b88b284d52a6cca064a798aa54 (DEFAULT_TABLE table=default.Table_beb1f6ec236e4f3b96df6b5201581c79 [id=cead87820a99412e936796998d2150dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.023957 14957 tablet_service.cc:1505] Processing CreateTablet for tablet d8d2d5d7676f4b8096d10781cb0e5fce (DEFAULT_TABLE table=default.Table_9cd0b4b3548a46f3a5cd27fb5e3b9672 [id=bb1d4aea5e9c4907a826f763e2c62707]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.024083 15380 raft_consensus.cc:2804] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.024112 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7aa0b88b284d52a6cca064a798aa54. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.024137 15380 raft_consensus.cc:493] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.024140 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 28d12c168eac49b8ba08e38d9880c798 (DEFAULT_TABLE table=default.Table_cccb10034b9549bc84a9019610866553 [id=3a6fcff5488b4ee698661c7e51f754ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.024184 15380 raft_consensus.cc:3060] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.024286 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d2d5d7676f4b8096d10781cb0e5fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.024770 15451 tablet.cc:1722] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.024946 15380 raft_consensus.cc:515] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.025260 15380 leader_election.cc:290] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.025775 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d12c168eac49b8ba08e38d9880c798. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.026072 14652 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_ba3e2cf8a7ab42a890554e661cd69684"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.026398 14652 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba3e2cf8a7ab42a890554e661cd69684 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.027721 15369 tablet_bootstrap.cc:654] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.028581 14958 tablet_service.cc:1505] Processing CreateTablet for tablet c64cf55ede2446ecbfc47be3e04eb646 (DEFAULT_TABLE table=default.Table_f398b0ec52b14af5889821d6f4bc881d [id=680b8d6772bf4a08a5102bba9a48f34d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.028788 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64cf55ede2446ecbfc47be3e04eb646. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.031239 14650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_e23e633dc76a491096bd496bd2b9585b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.031548 14650 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e23e633dc76a491096bd496bd2b9585b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:24.032240 15635 consensus_queue.cc:1175] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e51a2be794f04642b89386067ecbc77e" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20251025 08:02:24.032339 15093 tablet_service.cc:1505] Processing CreateTablet for tablet c64cf55ede2446ecbfc47be3e04eb646 (DEFAULT_TABLE table=default.Table_f398b0ec52b14af5889821d6f4bc881d [id=680b8d6772bf4a08a5102bba9a48f34d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.032474 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 3f7aa0b88b284d52a6cca064a798aa54 (DEFAULT_TABLE table=default.Table_beb1f6ec236e4f3b96df6b5201581c79 [id=cead87820a99412e936796998d2150dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.032547 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64cf55ede2446ecbfc47be3e04eb646. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.032675 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7aa0b88b284d52a6cca064a798aa54. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.032688 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 28d12c168eac49b8ba08e38d9880c798 (DEFAULT_TABLE table=default.Table_cccb10034b9549bc84a9019610866553 [id=3a6fcff5488b4ee698661c7e51f754ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.033006 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d12c168eac49b8ba08e38d9880c798. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.034397 15385 ts_tablet_manager.cc:1929] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.034461 15385 log.cc:1199] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/6dbf9c53df494216865ac4631fd48af4
I20251025 08:02:24.034650 15385 ts_tablet_manager.cc:1950] T 6dbf9c53df494216865ac4631fd48af4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.035072 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "24a584d6039d4041941f7c53bfcd9f2f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:24.035168 14979 raft_consensus.cc:3060] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.035567 15092 tablet_service.cc:1505] Processing CreateTablet for tablet d8d2d5d7676f4b8096d10781cb0e5fce (DEFAULT_TABLE table=default.Table_9cd0b4b3548a46f3a5cd27fb5e3b9672 [id=bb1d4aea5e9c4907a826f763e2c62707]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.035766 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d2d5d7676f4b8096d10781cb0e5fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.035840 15388 ts_tablet_manager.cc:1916] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.035910 14979 raft_consensus.cc:2468] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:24.036134 15385 tablet_replica.cc:333] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.036211 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 6dbf9c53df494216865ac4631fd48af4 (table default.Table_6b8cc455bb574b30bdb9bca2ac803ae0 [id=6739c1319b784c8eb66fc75125f83056]) successfully deleted
I20251025 08:02:24.036244 15385 raft_consensus.cc:2243] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.036327 15385 raft_consensus.cc:2272] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.036682 15370 tablet_bootstrap.cc:492] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.036748 15370 ts_tablet_manager.cc:1403] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20251025 08:02:24.037134 15370 raft_consensus.cc:359] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.037215 15370 raft_consensus.cc:385] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.037252 15370 raft_consensus.cc:740] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.037395 15370 consensus_queue.cc:260] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.037652 15370 ts_tablet_manager.cc:1434] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.037817 15370 tablet_bootstrap.cc:492] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.038705 15370 tablet_bootstrap.cc:654] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.039238 14647 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_e7d81e9e21714341be16ee46af55cde8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.039263 15223 tablet_service.cc:1505] Processing CreateTablet for tablet c64cf55ede2446ecbfc47be3e04eb646 (DEFAULT_TABLE table=default.Table_f398b0ec52b14af5889821d6f4bc881d [id=680b8d6772bf4a08a5102bba9a48f34d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.039470 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c64cf55ede2446ecbfc47be3e04eb646. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.039516 15228 tablet_service.cc:1505] Processing CreateTablet for tablet d8d2d5d7676f4b8096d10781cb0e5fce (DEFAULT_TABLE table=default.Table_9cd0b4b3548a46f3a5cd27fb5e3b9672 [id=bb1d4aea5e9c4907a826f763e2c62707]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:24.039557 14647 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7d81e9e21714341be16ee46af55cde8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.039685 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8d2d5d7676f4b8096d10781cb0e5fce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.041249 15245 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "24a584d6039d4041941f7c53bfcd9f2f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.041330 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 28d12c168eac49b8ba08e38d9880c798 (DEFAULT_TABLE table=default.Table_cccb10034b9549bc84a9019610866553 [id=3a6fcff5488b4ee698661c7e51f754ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.041510 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28d12c168eac49b8ba08e38d9880c798. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.042088 15048 leader_election.cc:304] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:24.042339 14655 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_4960c3071f8247149c201f2d6c65090f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.042624 15497 raft_consensus.cc:2804] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
W20251025 08:02:24.042634 14655 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4960c3071f8247149c201f2d6c65090f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.042701 15497 raft_consensus.cc:697] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
W20251025 08:02:24.042809 15049 leader_election.cc:343] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.043283 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "24a584d6039d4041941f7c53bfcd9f2f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.043927 15437 tablet.cc:1722] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.045089 14646 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet ff155cb1c7e44986bb999bb0177f8f75 (table default.Table_eb789fed3e81408b8b688461884e9c5a [id=1ee33ee129d749d0bd7f26dc49fca0fe]). Expected version 1 got 0
I20251025 08:02:24.042806 15497 consensus_queue.cc:237] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.046267 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet cd03eb08d0e54427a4709a4de4c4796c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.046482 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 3f7aa0b88b284d52a6cca064a798aa54 (DEFAULT_TABLE table=default.Table_beb1f6ec236e4f3b96df6b5201581c79 [id=cead87820a99412e936796998d2150dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.046656 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f7aa0b88b284d52a6cca064a798aa54. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:24.047852 15049 leader_election.cc:343] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.047875 15380 raft_consensus.cc:493] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.047931 15380 raft_consensus.cc:515] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.048142 15376 raft_consensus.cc:493] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.048229 15380 leader_election.cc:290] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.048207 15376 raft_consensus.cc:515] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.048470 15376 leader_election.cc:290] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.048652 15372 tablet_bootstrap.cc:492] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.048718 15372 ts_tablet_manager.cc:1403] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.000s
I20251025 08:02:24.049137 15372 raft_consensus.cc:359] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.049216 15372 raft_consensus.cc:385] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.049247 15372 raft_consensus.cc:740] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.049356 15372 consensus_queue.cc:260] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.049404 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9d37ec643294d4fb8a715596f078599" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.049504 14978 raft_consensus.cc:2468] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:24.049844 15464 consensus_queue.cc:1048] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.050287 15372 ts_tablet_manager.cc:1434] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:24.050426 15372 tablet_bootstrap.cc:492] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.050918 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05be924a2b1c4f16a6cff056df2c1f71" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.051108 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9d37ec643294d4fb8a715596f078599" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.051858 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet cd03eb08d0e54427a4709a4de4c4796c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.052282 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05be924a2b1c4f16a6cff056df2c1f71" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.052403 14979 raft_consensus.cc:2468] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:24.052801 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet f637313389174f729f784974fc2f94b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:23 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.053143 15048 leader_election.cc:304] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:24.053321 15376 raft_consensus.cc:2804] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.053382 15376 raft_consensus.cc:493] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.053426 15376 raft_consensus.cc:3060] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.053642 15372 tablet_bootstrap.cc:654] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.054296 15376 raft_consensus.cc:515] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.053328 15048 leader_election.cc:304] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
W20251025 08:02:24.054665 15049 leader_election.cc:343] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.054821 15385 ts_tablet_manager.cc:1916] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:24.055066 15049 leader_election.cc:343] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.055415 15497 raft_consensus.cc:2804] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.055464 15497 raft_consensus.cc:493] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.055498 15497 raft_consensus.cc:3060] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.056195 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9d37ec643294d4fb8a715596f078599" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.056309 15497 raft_consensus.cc:515] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.056619 15497 leader_election.cc:290] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
W20251025 08:02:24.056876 15049 leader_election.cc:343] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.057147 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05be924a2b1c4f16a6cff056df2c1f71" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.058338 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9d37ec643294d4fb8a715596f078599" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:24.058424 14979 raft_consensus.cc:3060] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.058440 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "05be924a2b1c4f16a6cff056df2c1f71" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:24.058528 14978 raft_consensus.cc:3060] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.059151 14979 raft_consensus.cc:2468] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:24.059160 14647 catalog_manager.cc:5649] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:24.059381 14647 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 24a584d6039d4041941f7c53bfcd9f2f (table default.Table_0f289526bf514ddc90a5622136145bff [id=170fdc9a02124e5488b4ac3d2776ca83]). Expected version 1 got 0
I20251025 08:02:24.059391 14978 raft_consensus.cc:2468] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:24.059765 15385 ts_tablet_manager.cc:1929] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.059818 15385 log.cc:1199] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/0e09fa674c21442cbecdbe1ecbe24359
I20251025 08:02:24.059989 15385 ts_tablet_manager.cc:1950] T 0e09fa674c21442cbecdbe1ecbe24359 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.060552 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 0e09fa674c21442cbecdbe1ecbe24359 (table default.Table_4e764c9b1b9d4238b6df2a23c9c3ef34 [id=29a1ac5b34e84405ad2a34bd49ea9997]) successfully deleted
I20251025 08:02:24.060720 15385 tablet_replica.cc:333] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.060808 15385 raft_consensus.cc:2243] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
W20251025 08:02:24.060794 15049 leader_election.cc:343] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.060911 15385 pending_rounds.cc:70] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:24.061254 15048 leader_election.cc:304] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.060933 15385 pending_rounds.cc:77] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609792437952512 op_type: NO_OP noop_request { }
I20251025 08:02:24.061393 15385 raft_consensus.cc:2889] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:24.061450 15385 raft_consensus.cc:2272] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.061829 15497 raft_consensus.cc:2804] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.061898 15497 raft_consensus.cc:697] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:24.061986 15497 consensus_queue.cc:237] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.062103 15370 tablet_bootstrap.cc:492] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.062170 15370 ts_tablet_manager.cc:1403] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.024s user 0.000s sys 0.001s
I20251025 08:02:24.062662 15048 leader_election.cc:304] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.062724 15370 raft_consensus.cc:359] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.062814 15370 raft_consensus.cc:385] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.062847 15370 raft_consensus.cc:740] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.062951 15380 raft_consensus.cc:2804] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.062938 15370 consensus_queue.cc:260] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.063041 15380 raft_consensus.cc:697] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:24.063136 15380 consensus_queue.cc:237] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.063207 15370 ts_tablet_manager.cc:1434] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.063365 15370 tablet_bootstrap.cc:492] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.054598 15376 leader_election.cc:290] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.064174 15370 tablet_bootstrap.cc:654] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.065100 15386 ts_tablet_manager.cc:1916] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.065465 15445 consensus_queue.cc:1048] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.065745 15388 ts_tablet_manager.cc:1929] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:24.065816 15388 log.cc:1199] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/6dbf9c53df494216865ac4631fd48af4
I20251025 08:02:24.066321 15385 ts_tablet_manager.cc:1916] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.068058 14646 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_eb789fed3e81408b8b688461884e9c5a [id=1ee33ee129d749d0bd7f26dc49fca0fe] alter complete (version 1)
I20251025 08:02:24.068274 15385 ts_tablet_manager.cc:1929] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:24.068331 15385 log.cc:1199] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/289e3ff2a6be4daaadcac6fe492117c9
I20251025 08:02:24.068565 15385 ts_tablet_manager.cc:1950] T 289e3ff2a6be4daaadcac6fe492117c9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.069514 14646 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_9b93bef6a94b445180bc909f9a07cdb4" } new_table_name: "default.Table_3fa132009b464438a9f73ec8c048f294" modify_external_catalogs: true
I20251025 08:02:24.070706 15372 tablet_bootstrap.cc:492] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.070778 15372 ts_tablet_manager.cc:1403] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.001s
I20251025 08:02:24.071151 15372 raft_consensus.cc:359] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.071229 15372 raft_consensus.cc:385] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.071256 15372 raft_consensus.cc:740] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.071347 15372 consensus_queue.cc:260] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.071564 15372 ts_tablet_manager.cc:1434] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.071715 15372 tablet_bootstrap.cc:492] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.072050 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 289e3ff2a6be4daaadcac6fe492117c9 (table default.Table_d29e190e7c9b4da8b3f4d850a916123c [id=69c97a171f1e480ba9faf62bacc1ec38]) successfully deleted
I20251025 08:02:24.072248 15385 tablet_replica.cc:333] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.072388 15385 raft_consensus.cc:2243] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.072477 15385 raft_consensus.cc:2272] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.073541 15372 tablet_bootstrap.cc:654] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.074374 15386 ts_tablet_manager.cc:1929] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.074654 15386 log.cc:1199] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/f637313389174f729f784974fc2f94b9
I20251025 08:02:24.074906 15386 ts_tablet_manager.cc:1950] T f637313389174f729f784974fc2f94b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.074998 15388 ts_tablet_manager.cc:1950] T 6dbf9c53df494216865ac4631fd48af4 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.074990 15369 tablet_bootstrap.cc:492] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.075081 15369 ts_tablet_manager.cc:1403] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.000s
I20251025 08:02:24.075536 15369 raft_consensus.cc:359] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.075613 15388 tablet_replica.cc:333] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.075591 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet f637313389174f729f784974fc2f94b9 (table default.Table_2bc36ab5489746d9a1ed6e69965a4e17 [id=943ad581ce2d43b39ecafee069537b6f]) successfully deleted
I20251025 08:02:24.075637 15369 raft_consensus.cc:385] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.075680 15369 raft_consensus.cc:740] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.075724 15388 raft_consensus.cc:2243] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.075816 15388 raft_consensus.cc:2272] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.075796 15369 consensus_queue.cc:260] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.076047 15369 ts_tablet_manager.cc:1434] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.076210 15369 tablet_bootstrap.cc:492] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.077095 15388 ts_tablet_manager.cc:1916] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.077183 15369 tablet_bootstrap.cc:654] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.078339 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 6dbf9c53df494216865ac4631fd48af4 (table default.Table_6b8cc455bb574b30bdb9bca2ac803ae0 [id=6739c1319b784c8eb66fc75125f83056]) successfully deleted
I20251025 08:02:24.079041 15385 ts_tablet_manager.cc:1916] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.080792 15385 ts_tablet_manager.cc:1929] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.080859 15385 log.cc:1199] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/05f0f22c06ed45ae9c3433cc0cd7ffb9
I20251025 08:02:24.081065 15385 ts_tablet_manager.cc:1950] T 05f0f22c06ed45ae9c3433cc0cd7ffb9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.081621 15385 tablet_replica.cc:333] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.081723 15385 raft_consensus.cc:2243] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.081805 15385 raft_consensus.cc:2272] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.081960 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 05f0f22c06ed45ae9c3433cc0cd7ffb9 (table default.Table_af01f40543814889943b631a351a302e [id=e8f1b9d591bb4f8fbbb05ee960280cc6]) successfully deleted
W20251025 08:02:24.082134 14640 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet cd03eb08d0e54427a4709a4de4c4796c because the tablet was not found. No further retry: Not found: Tablet not found: cd03eb08d0e54427a4709a4de4c4796c
I20251025 08:02:24.082871 15436 tablet.cc:1722] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20251025 08:02:24.082918 14647 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_e23e633dc76a491096bd496bd2b9585b" } new_table_name: "default.Table_2d86a1e7ec904a128454ea0cf0839ed6" modify_external_catalogs: true
I20251025 08:02:24.083690 15369 tablet_bootstrap.cc:492] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.083762 15369 ts_tablet_manager.cc:1403] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251025 08:02:24.084162 15369 raft_consensus.cc:359] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.084247 15369 raft_consensus.cc:385] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.084278 15369 raft_consensus.cc:740] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.084379 15369 consensus_queue.cc:260] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.084628 15369 ts_tablet_manager.cc:1434] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.084784 15369 tablet_bootstrap.cc:492] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.084789 15370 tablet_bootstrap.cc:492] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.084849 15370 ts_tablet_manager.cc:1403] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.002s
I20251025 08:02:24.085238 15370 raft_consensus.cc:359] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.085338 15370 raft_consensus.cc:385] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.085366 15370 raft_consensus.cc:740] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.085449 15370 consensus_queue.cc:260] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.085623 15369 tablet_bootstrap.cc:654] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.085685 15370 ts_tablet_manager.cc:1434] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.085836 15370 tablet_bootstrap.cc:492] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.086473 15445 raft_consensus.cc:493] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.086541 15445 raft_consensus.cc:515] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.086699 15370 tablet_bootstrap.cc:654] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.086858 15445 leader_election.cc:290] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.087420 15385 ts_tablet_manager.cc:1916] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.087795 15451 tablet.cc:1722] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20251025 08:02:24.088048 15437 tablet.cc:1722] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
W20251025 08:02:24.088536 14647 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db9202bf6e6041f28b3173580db9ad7d has no consensus state
I20251025 08:02:24.088711 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d8d2d5d7676f4b8096d10781cb0e5fce" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:24.089129 14655 catalog_manager.cc:5649] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:24.089361 14655 catalog_manager.cc:5649] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
W20251025 08:02:24.090755 14915 leader_election.cc:343] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.091097 14958 tablet_service.cc:1505] Processing CreateTablet for tablet ccb533134db94f29a781095e7fb55e04 (DEFAULT_TABLE table=default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.091318 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccb533134db94f29a781095e7fb55e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.091475 15385 ts_tablet_manager.cc:1929] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.091535 15385 log.cc:1199] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/f637313389174f729f784974fc2f94b9
I20251025 08:02:24.091714 15385 ts_tablet_manager.cc:1950] T f637313389174f729f784974fc2f94b9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.091892 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 1695780ae4e24c288df851c2aff7e22c (DEFAULT_TABLE table=default.Table_c11d0b545be3442685df355dba9a8f12 [id=9f02c9df85ba446cbe85aa321eb93c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.092074 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1695780ae4e24c288df851c2aff7e22c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.092347 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet f637313389174f729f784974fc2f94b9 (table default.Table_2bc36ab5489746d9a1ed6e69965a4e17 [id=943ad581ce2d43b39ecafee069537b6f]) successfully deleted
I20251025 08:02:24.093346 15092 tablet_service.cc:1505] Processing CreateTablet for tablet ccb533134db94f29a781095e7fb55e04 (DEFAULT_TABLE table=default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.093547 15370 tablet_bootstrap.cc:492] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.093611 15370 ts_tablet_manager.cc:1403] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20251025 08:02:24.093859 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 1695780ae4e24c288df851c2aff7e22c (DEFAULT_TABLE table=default.Table_c11d0b545be3442685df355dba9a8f12 [id=9f02c9df85ba446cbe85aa321eb93c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.093956 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d8d2d5d7676f4b8096d10781cb0e5fce" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.094023 15370 raft_consensus.cc:359] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.094096 15370 raft_consensus.cc:385] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.094125 15370 raft_consensus.cc:740] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.094260 15370 consensus_queue.cc:260] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:24.094321 14914 leader_election.cc:343] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.094376 14914 leader_election.cc:304] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.094547 15370 ts_tablet_manager.cc:1434] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.094558 15374 raft_consensus.cc:2749] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.094877 15370 tablet_bootstrap.cc:492] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.095729 15370 tablet_bootstrap.cc:654] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.096433 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 44036e636edf42b89952e23dfc1a3d4c (DEFAULT_TABLE table=default.Table_6b8cc455bb574b30bdb9bca2ac803ae0 [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.096637 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44036e636edf42b89952e23dfc1a3d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.096853 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1695780ae4e24c288df851c2aff7e22c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.097950 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccb533134db94f29a781095e7fb55e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.098623 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 44036e636edf42b89952e23dfc1a3d4c (DEFAULT_TABLE table=default.Table_6b8cc455bb574b30bdb9bca2ac803ae0 [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.098824 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44036e636edf42b89952e23dfc1a3d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.100473 15370 tablet_bootstrap.cc:492] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.100556 15370 ts_tablet_manager.cc:1403] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20251025 08:02:24.100939 15370 raft_consensus.cc:359] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.101023 15370 raft_consensus.cc:385] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.101053 15370 raft_consensus.cc:740] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.101152 15370 consensus_queue.cc:260] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.101413 15370 ts_tablet_manager.cc:1434] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.101558 15370 tablet_bootstrap.cc:492] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.101614 14646 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_3fa132009b464438a9f73ec8c048f294 [id=394a1e6daa8f42f4a69517cb60a9a935] alter complete (version 4)
I20251025 08:02:24.102399 15227 tablet_service.cc:1505] Processing CreateTablet for tablet ccb533134db94f29a781095e7fb55e04 (DEFAULT_TABLE table=default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.102609 15370 tablet_bootstrap.cc:654] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.102620 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccb533134db94f29a781095e7fb55e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.103343 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 44036e636edf42b89952e23dfc1a3d4c (DEFAULT_TABLE table=default.Table_6b8cc455bb574b30bdb9bca2ac803ae0 [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.103530 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44036e636edf42b89952e23dfc1a3d4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.104041 15388 ts_tablet_manager.cc:1929] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.104104 15388 log.cc:1199] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/289e3ff2a6be4daaadcac6fe492117c9
I20251025 08:02:24.104290 15388 ts_tablet_manager.cc:1950] T 289e3ff2a6be4daaadcac6fe492117c9 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.104496 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 1695780ae4e24c288df851c2aff7e22c (DEFAULT_TABLE table=default.Table_c11d0b545be3442685df355dba9a8f12 [id=9f02c9df85ba446cbe85aa321eb93c2d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.104671 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1695780ae4e24c288df851c2aff7e22c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.105093 14653 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 182d711eb2d547cb91f9624ea17eb4ad (table default.Table_3871f03720f24effbbcfc45b952843fd [id=33c97f69fa104ce1bff69626847a5b68]). Expected version 1 got 0
I20251025 08:02:24.105461 14655 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_f746f39c231f451dba0a647b1690ddce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.105634 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 289e3ff2a6be4daaadcac6fe492117c9 (table default.Table_d29e190e7c9b4da8b3f4d850a916123c [id=69c97a171f1e480ba9faf62bacc1ec38]) successfully deleted
W20251025 08:02:24.105773 14655 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f746f39c231f451dba0a647b1690ddce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.109102 14650 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_9cd0b4b3548a46f3a5cd27fb5e3b9672" } new_table_name: "default.Table_cc4fb27276854f679d49c263e71b51bb" modify_external_catalogs: true
I20251025 08:02:24.110167 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_b22d946b289a4a0aa9c6ef1135c68e60"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.110597 14652 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_3871f03720f24effbbcfc45b952843fd" } new_table_name: "default.Table_4a5a1f334fef444b959ee1c82ed0d5a0" modify_external_catalogs: true
I20251025 08:02:24.111042 15372 tablet_bootstrap.cc:492] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.111073 15386 tablet_replica.cc:333] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.111120 15372 ts_tablet_manager.cc:1403] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.001s
I20251025 08:02:24.111179 15386 raft_consensus.cc:2243] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.111277 15386 raft_consensus.cc:2272] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.111295 14647 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_aba4e23ad41c4bce9e35f52388813868"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.111464 15370 tablet_bootstrap.cc:492] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.111526 15370 ts_tablet_manager.cc:1403] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20251025 08:02:24.111543 15372 raft_consensus.cc:359] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.111622 15372 raft_consensus.cc:385] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.111653 15372 raft_consensus.cc:740] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.111749 15372 consensus_queue.cc:260] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.111830 15386 ts_tablet_manager.cc:1916] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.111896 15370 raft_consensus.cc:359] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:24.111928 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b22d946b289a4a0aa9c6ef1135c68e60 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.111974 15370 raft_consensus.cc:385] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.111985 15372 ts_tablet_manager.cc:1434] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.112005 15370 raft_consensus.cc:740] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.112154 15372 tablet_bootstrap.cc:492] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.112114 15370 consensus_queue.cc:260] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.112337 15370 ts_tablet_manager.cc:1434] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.112493 15370 tablet_bootstrap.cc:492] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.113005 15372 tablet_bootstrap.cc:654] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:24.113178 14647 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aba4e23ad41c4bce9e35f52388813868 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.113322 15370 tablet_bootstrap.cc:654] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.114965 15369 tablet_bootstrap.cc:492] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.115047 15369 ts_tablet_manager.cc:1403] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.000s
I20251025 08:02:24.115450 15369 raft_consensus.cc:359] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.115533 15369 raft_consensus.cc:385] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.115561 15369 raft_consensus.cc:740] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.115664 15369 consensus_queue.cc:260] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.115898 15369 ts_tablet_manager.cc:1434] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.116070 15369 tablet_bootstrap.cc:492] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.117498 15384 raft_consensus.cc:493] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.117573 15384 raft_consensus.cc:515] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.117867 15384 leader_election.cc:290] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.118585 15369 tablet_bootstrap.cc:654] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:24.118980 15183 leader_election.cc:343] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 3dc4e2f330ed47369b8ed63b1bcf134b
I20251025 08:02:24.121376 15386 ts_tablet_manager.cc:1929] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.121495 15386 log.cc:1199] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/f52aa4230f7847f6a5effda6c06063a5
W20251025 08:02:24.121680 15185 leader_election.cc:343] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 3dc4e2f330ed47369b8ed63b1bcf134b
I20251025 08:02:24.121773 15185 leader_election.cc:304] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:24.122037 15384 raft_consensus.cc:2749] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.122031 14649 master_service.cc:954] ReplaceTablet: received request to replace tablet 182d711eb2d547cb91f9624ea17eb4ad from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.122495 15386 ts_tablet_manager.cc:1950] T f52aa4230f7847f6a5effda6c06063a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.122896 15369 tablet_bootstrap.cc:492] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.123023 15369 ts_tablet_manager.cc:1403] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251025 08:02:24.123268 15370 tablet_bootstrap.cc:492] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.123344 15370 ts_tablet_manager.cc:1403] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20251025 08:02:24.123546 15369 raft_consensus.cc:359] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.123682 15369 raft_consensus.cc:385] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.123697 15370 raft_consensus.cc:359] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.123786 15370 raft_consensus.cc:385] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.123822 15370 raft_consensus.cc:740] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.123747 15369 raft_consensus.cc:740] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.123921 15370 consensus_queue.cc:260] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.123971 15369 consensus_queue.cc:260] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.124163 15370 ts_tablet_manager.cc:1434] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.124318 15370 tablet_bootstrap.cc:492] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.125118 15370 tablet_bootstrap.cc:654] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.127585 14651 master_service.cc:954] ReplaceTablet: received request to replace tablet 05be924a2b1c4f16a6cff056df2c1f71 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.127769 15369 ts_tablet_manager.cc:1434] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:24.129352 15369 tablet_bootstrap.cc:492] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.131325 15369 tablet_bootstrap.cc:654] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.122774 15372 tablet_bootstrap.cc:492] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.131923 15372 ts_tablet_manager.cc:1403] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.000s
I20251025 08:02:24.132370 15372 raft_consensus.cc:359] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.132480 15372 raft_consensus.cc:385] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.132517 15372 raft_consensus.cc:740] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.132622 15372 consensus_queue.cc:260] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.132874 15372 ts_tablet_manager.cc:1434] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.133025 15372 tablet_bootstrap.cc:492] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.133929 15372 tablet_bootstrap.cc:654] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.134135 15370 tablet_bootstrap.cc:492] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.134229 15370 ts_tablet_manager.cc:1403] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20251025 08:02:24.134613 15370 raft_consensus.cc:359] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.134703 15370 raft_consensus.cc:385] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251025 08:02:24.134722 14652 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 182d711eb2d547cb91f9624ea17eb4ad consensus state has no leader
I20251025 08:02:24.134737 15370 raft_consensus.cc:740] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.134852 15370 consensus_queue.cc:260] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.135089 15370 ts_tablet_manager.cc:1434] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.135200 15376 raft_consensus.cc:493] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.135255 15376 raft_consensus.cc:515] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.135581 15376 leader_election.cc:290] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:24.135771 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f7aa0b88b284d52a6cca064a798aa54" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.135860 14978 raft_consensus.cc:2468] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:24.136111 15048 leader_election.cc:304] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:24.136528 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f7aa0b88b284d52a6cca064a798aa54" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:24.136960 15049 leader_election.cc:343] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:24.138005 14650 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d8d2d5d7676f4b8096d10781cb0e5fce consensus state has no leader
I20251025 08:02:24.138259 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 3545cf3efbef403aa897a8ddd7896c6f (DEFAULT_TABLE table=default.Table_e7d81e9e21714341be16ee46af55cde8 [id=cb9294ed7c474aae989ac13159ec3166]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.138464 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3545cf3efbef403aa897a8ddd7896c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.139068 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 3545cf3efbef403aa897a8ddd7896c6f (DEFAULT_TABLE table=default.Table_e7d81e9e21714341be16ee46af55cde8 [id=cb9294ed7c474aae989ac13159ec3166]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.139078 15228 tablet_service.cc:1505] Processing CreateTablet for tablet d458ae384ebd4c33bfc74e7657772fa6 (DEFAULT_TABLE table=default.Table_40e75fd0e39f4ae69856bde4bfd62a45 [id=739dffe08d69409aa126a14a2c413ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.139276 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3545cf3efbef403aa897a8ddd7896c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.139285 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d458ae384ebd4c33bfc74e7657772fa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.140906 15376 raft_consensus.cc:2804] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.140960 15376 raft_consensus.cc:493] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.141008 15376 raft_consensus.cc:3060] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.141908 15376 raft_consensus.cc:515] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.142645 15370 tablet_bootstrap.cc:492] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.142858 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f7aa0b88b284d52a6cca064a798aa54" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:24.142886 15090 tablet_service.cc:1505] Processing CreateTablet for tablet d458ae384ebd4c33bfc74e7657772fa6 (DEFAULT_TABLE table=default.Table_40e75fd0e39f4ae69856bde4bfd62a45 [id=739dffe08d69409aa126a14a2c413ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.142952 14978 raft_consensus.cc:3060] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.143086 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d458ae384ebd4c33bfc74e7657772fa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.143505 15370 tablet_bootstrap.cc:654] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.143877 14978 raft_consensus.cc:2468] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:24.144222 15048 leader_election.cc:304] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:24.144392 15380 raft_consensus.cc:2804] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.144457 15380 raft_consensus.cc:697] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:24.144559 15380 consensus_queue.cc:237] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.144759 14958 tablet_service.cc:1505] Processing CreateTablet for tablet d458ae384ebd4c33bfc74e7657772fa6 (DEFAULT_TABLE table=default.Table_40e75fd0e39f4ae69856bde4bfd62a45 [id=739dffe08d69409aa126a14a2c413ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.144977 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d458ae384ebd4c33bfc74e7657772fa6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.145195 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 3545cf3efbef403aa897a8ddd7896c6f (DEFAULT_TABLE table=default.Table_e7d81e9e21714341be16ee46af55cde8 [id=cb9294ed7c474aae989ac13159ec3166]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.145391 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3545cf3efbef403aa897a8ddd7896c6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.147332 15114 raft_consensus.cc:1275] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.147465 15246 raft_consensus.cc:3060] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.147490 15497 raft_consensus.cc:493] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.147547 15497 raft_consensus.cc:515] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.147850 15497 leader_election.cc:290] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:24.147960 15374 consensus_queue.cc:1048] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.148176 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 4608033ee2244efda81dd70a5da61c5e (DEFAULT_TABLE table=default.Table_ba3e2cf8a7ab42a890554e661cd69684 [id=b9853b2d88cf4a96b9fc5e1099f87064]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.148398 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4608033ee2244efda81dd70a5da61c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.148382 15246 raft_consensus.cc:1275] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.150705 15388 tablet_replica.cc:333] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.150820 15388 raft_consensus.cc:2243] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.150898 15388 raft_consensus.cc:2272] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.151325 15539 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 1 FOLLOWER]: Advancing to term 2
I20251025 08:02:24.151391 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7922e71ecb4546dcb5c196b57ef5d3de" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.151479 14978 raft_consensus.cc:2468] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:24.151615 15388 ts_tablet_manager.cc:1916] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.151819 15048 leader_election.cc:304] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:24.152124 15497 raft_consensus.cc:2804] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.152170 15497 raft_consensus.cc:493] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.152204 15497 raft_consensus.cc:3060] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.153007 15497 raft_consensus.cc:515] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.153090 14649 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 182d711eb2d547cb91f9624ea17eb4ad
I20251025 08:02:24.153049 14646 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_af01f40543814889943b631a351a302e" } new_table_name: "default.Table_0cc98145ba51465da6bf4ed027cb5d4b" modify_external_catalogs: true
I20251025 08:02:24.153316 15497 leader_election.cc:290] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:24.153349 14649 catalog_manager.cc:6719] ReplaceTablet: tablet 182d711eb2d547cb91f9624ea17eb4ad deleted and replaced by tablet d9067b563519468ca71ebfcc738462b9
I20251025 08:02:24.153489 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7922e71ecb4546dcb5c196b57ef5d3de" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.153589 15246 raft_consensus.cc:2468] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:24.153614 15374 raft_consensus.cc:493] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.153676 15374 raft_consensus.cc:515] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.153945 14655 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet d8d2d5d7676f4b8096d10781cb0e5fce (table default.Table_cc4fb27276854f679d49c263e71b51bb [id=bb1d4aea5e9c4907a826f763e2c62707]). Expected version 1 got 0
I20251025 08:02:24.154026 15374 leader_election.cc:290] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.154074 14655 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 44036e636edf42b89952e23dfc1a3d4c (table default.Table_6b8cc455bb574b30bdb9bca2ac803ae0 [id=6739c1319b784c8eb66fc75125f83056]). Expected version 1 got 0
W20251025 08:02:24.154628 14655 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet 44036e636edf42b89952e23dfc1a3d4c (table default.Table_6b8cc455bb574b30bdb9bca2ac803ae0 [id=6739c1319b784c8eb66fc75125f83056], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 44036e636edf42b89952e23dfc1a3d4c consensus state has no leader
I20251025 08:02:24.154956 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 182d711eb2d547cb91f9624ea17eb4ad with delete_type TABLET_DATA_DELETED (replaced by tablet d9067b563519468ca71ebfcc738462b9) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.155398 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "182d711eb2d547cb91f9624ea17eb4ad" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:24.155421 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet 182d711eb2d547cb91f9624ea17eb4ad with delete_type TABLET_DATA_DELETED (replaced by tablet d9067b563519468ca71ebfcc738462b9) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.155504 15113 raft_consensus.cc:2468] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.155568 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7922e71ecb4546dcb5c196b57ef5d3de" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.155649 15246 raft_consensus.cc:3060] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.155927 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "182d711eb2d547cb91f9624ea17eb4ad" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.156008 15247 raft_consensus.cc:2468] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.156287 14914 leader_election.cc:304] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.156428 15246 raft_consensus.cc:2468] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:24.156442 15445 consensus_queue.cc:1048] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.156584 14651 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 05be924a2b1c4f16a6cff056df2c1f71
I20251025 08:02:24.156653 15445 raft_consensus.cc:2804] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.156695 15445 raft_consensus.cc:493] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.156730 15445 raft_consensus.cc:3060] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.156812 14651 catalog_manager.cc:6719] ReplaceTablet: tablet 05be924a2b1c4f16a6cff056df2c1f71 deleted and replaced by tablet dd2a01b7d5c14be0a1a6776540ef829e
I20251025 08:02:24.157117 14655 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 24a584d6039d4041941f7c53bfcd9f2f (table default.Table_0f289526bf514ddc90a5622136145bff [id=170fdc9a02124e5488b4ac3d2776ca83]). Expected version 1 got 0
I20251025 08:02:24.157567 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet 05be924a2b1c4f16a6cff056df2c1f71 with delete_type TABLET_DATA_DELETED (replaced by tablet dd2a01b7d5c14be0a1a6776540ef829e) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.157557 15445 raft_consensus.cc:515] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.157733 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 05be924a2b1c4f16a6cff056df2c1f71 with delete_type TABLET_DATA_DELETED (replaced by tablet dd2a01b7d5c14be0a1a6776540ef829e) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.157828 15445 leader_election.cc:290] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.157892 15385 tablet_replica.cc:333] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.157968 15049 leader_election.cc:304] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.158003 15385 raft_consensus.cc:2243] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.158094 15385 raft_consensus.cc:2272] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.158540 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7922e71ecb4546dcb5c196b57ef5d3de" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:24.158598 15385 ts_tablet_manager.cc:1916] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.158624 14978 raft_consensus.cc:3060] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.159369 14978 raft_consensus.cc:2468] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:24.159647 15380 raft_consensus.cc:2804] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.159713 15380 raft_consensus.cc:697] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:24.159811 15380 consensus_queue.cc:237] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.160496 15385 ts_tablet_manager.cc:1929] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.160552 15385 log.cc:1199] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/05be924a2b1c4f16a6cff056df2c1f71
I20251025 08:02:24.160746 15385 ts_tablet_manager.cc:1950] T 05be924a2b1c4f16a6cff056df2c1f71 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.161118 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "182d711eb2d547cb91f9624ea17eb4ad" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:24.161204 15113 raft_consensus.cc:3060] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.161583 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "182d711eb2d547cb91f9624ea17eb4ad" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.161670 15247 raft_consensus.cc:3060] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.161983 15113 raft_consensus.cc:2468] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.162559 15247 raft_consensus.cc:2468] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.162633 15370 tablet_bootstrap.cc:492] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.162598 14651 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_f746f39c231f451dba0a647b1690ddce" } modify_external_catalogs: true
I20251025 08:02:24.162698 15370 ts_tablet_manager.cc:1403] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.001s
I20251025 08:02:24.162690 14651 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_f746f39c231f451dba0a647b1690ddce" } modify_external_catalogs: true
I20251025 08:02:24.162851 15497 raft_consensus.cc:493] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.162912 15497 raft_consensus.cc:515] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.163141 15370 raft_consensus.cc:359] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.163213 15497 leader_election.cc:290] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:24.163220 15370 raft_consensus.cc:385] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.163287 15370 raft_consensus.cc:740] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.163410 15370 consensus_queue.cc:260] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.163578 14649 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_2d86a1e7ec904a128454ea0cf0839ed6" } modify_external_catalogs: true
I20251025 08:02:24.163642 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d8d2d5d7676f4b8096d10781cb0e5fce" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.163676 14649 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_2d86a1e7ec904a128454ea0cf0839ed6" } modify_external_catalogs: true
I20251025 08:02:24.163918 15376 leader_election.cc:290] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:24.164222 15049 leader_election.cc:343] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.164238 14653 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 58b14a04ff6a4e18b9daa8c22f6e7307 (table default.Table_af01f40543814889943b631a351a302e [id=e8f1b9d591bb4f8fbbb05ee960280cc6]). Expected version 1 got 0
I20251025 08:02:24.164454 14914 leader_election.cc:304] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.164628 15374 raft_consensus.cc:2804] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.164619 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 05be924a2b1c4f16a6cff056df2c1f71 with delete_type TABLET_DATA_DELETED (replaced by tablet dd2a01b7d5c14be0a1a6776540ef829e) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.164698 15374 raft_consensus.cc:697] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:24.164796 15374 consensus_queue.cc:237] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.164992 15370 ts_tablet_manager.cc:1434] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:24.165001 14655 catalog_manager.cc:5649] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:24.165148 15370 tablet_bootstrap.cc:492] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.165225 14655 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 58b14a04ff6a4e18b9daa8c22f6e7307 (table default.Table_af01f40543814889943b631a351a302e [id=e8f1b9d591bb4f8fbbb05ee960280cc6]). Expected version 1 got 0
I20251025 08:02:24.166064 15370 tablet_bootstrap.cc:654] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.169216 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f7aa0b88b284d52a6cca064a798aa54" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:24.169662 15049 leader_election.cc:343] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.169888 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 182d711eb2d547cb91f9624ea17eb4ad with delete_type TABLET_DATA_DELETED (replaced by tablet d9067b563519468ca71ebfcc738462b9) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.170106 15385 tablet_replica.cc:333] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.170256 15385 raft_consensus.cc:2243] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.170387 15385 pending_rounds.cc:70] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:24.170416 15385 pending_rounds.cc:77] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609793700155392 op_type: NO_OP noop_request { }
I20251025 08:02:24.170457 15385 raft_consensus.cc:2889] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:24.170502 15385 raft_consensus.cc:2272] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.171252 15370 tablet_bootstrap.cc:492] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.171324 15370 ts_tablet_manager.cc:1403] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20251025 08:02:24.171363 14647 master_service.cc:954] ReplaceTablet: received request to replace tablet 58b14a04ff6a4e18b9daa8c22f6e7307 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.171722 15370 raft_consensus.cc:359] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.171818 15370 raft_consensus.cc:385] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.171854 15370 raft_consensus.cc:740] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.171968 15370 consensus_queue.cc:260] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.172192 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 2a0a2af3ed1f41fea41962db52cfe7d8 (DEFAULT_TABLE table=default.Table_8f74d707fd274ba48bd0f75155b2a180 [id=1e1120fd790b44569595d67fea5165c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.172361 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 2a0a2af3ed1f41fea41962db52cfe7d8 (DEFAULT_TABLE table=default.Table_8f74d707fd274ba48bd0f75155b2a180 [id=1e1120fd790b44569595d67fea5165c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.172423 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a0a2af3ed1f41fea41962db52cfe7d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.172555 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a0a2af3ed1f41fea41962db52cfe7d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.172581 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 4608033ee2244efda81dd70a5da61c5e (DEFAULT_TABLE table=default.Table_ba3e2cf8a7ab42a890554e661cd69684 [id=b9853b2d88cf4a96b9fc5e1099f87064]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.172765 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4608033ee2244efda81dd70a5da61c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.173492 15388 ts_tablet_manager.cc:1929] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.173549 15388 log.cc:1199] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/0e09fa674c21442cbecdbe1ecbe24359
I20251025 08:02:24.173725 15388 ts_tablet_manager.cc:1950] T 0e09fa674c21442cbecdbe1ecbe24359 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.174396 15388 tablet_replica.cc:333] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.174486 15388 raft_consensus.cc:2243] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.174574 15388 raft_consensus.cc:2272] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.174669 15224 tablet_service.cc:1505] Processing CreateTablet for tablet db9202bf6e6041f28b3173580db9ad7d (DEFAULT_TABLE table=default.Table_2d86a1e7ec904a128454ea0cf0839ed6 [id=f5c6646ac8924dd18f06bd714d116aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.174849 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db9202bf6e6041f28b3173580db9ad7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.175067 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 954530e1c7204e1c9d9ded2460a823be (DEFAULT_TABLE table=default.Table_4960c3071f8247149c201f2d6c65090f [id=667f1e14021446d3bf165c34f9f0567d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.175133 15369 tablet_bootstrap.cc:492] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.175201 15369 ts_tablet_manager.cc:1403] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.000s
I20251025 08:02:24.175227 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 954530e1c7204e1c9d9ded2460a823be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.175704 15369 raft_consensus.cc:359] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.175830 15369 raft_consensus.cc:385] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.175858 15369 raft_consensus.cc:740] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.175999 15369 consensus_queue.cc:260] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.176421 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet f52aa4230f7847f6a5effda6c06063a5 (table default.Table_f398b0ec52b14af5889821d6f4bc881d [id=680b8d6772bf4a08a5102bba9a48f34d]) successfully deleted
I20251025 08:02:24.172199 15370 ts_tablet_manager.cc:1434] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.176857 15370 tablet_bootstrap.cc:492] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.177330 14650 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_c11d0b545be3442685df355dba9a8f12" } modify_external_catalogs: true
I20251025 08:02:24.177423 14650 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_c11d0b545be3442685df355dba9a8f12" } modify_external_catalogs: true
I20251025 08:02:24.177817 15386 tablet_replica.cc:333] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.177881 15370 tablet_bootstrap.cc:654] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.177922 15386 raft_consensus.cc:2243] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.178014 15386 raft_consensus.cc:2272] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.178438 15386 ts_tablet_manager.cc:1916] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.178774 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 05be924a2b1c4f16a6cff056df2c1f71 (table default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]) successfully deleted
I20251025 08:02:24.179262 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 2a0a2af3ed1f41fea41962db52cfe7d8 (DEFAULT_TABLE table=default.Table_8f74d707fd274ba48bd0f75155b2a180 [id=1e1120fd790b44569595d67fea5165c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.179286 14959 tablet_service.cc:1505] Processing CreateTablet for tablet db9202bf6e6041f28b3173580db9ad7d (DEFAULT_TABLE table=default.Table_2d86a1e7ec904a128454ea0cf0839ed6 [id=f5c6646ac8924dd18f06bd714d116aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.179376 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 4608033ee2244efda81dd70a5da61c5e (DEFAULT_TABLE table=default.Table_ba3e2cf8a7ab42a890554e661cd69684 [id=b9853b2d88cf4a96b9fc5e1099f87064]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.179507 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a0a2af3ed1f41fea41962db52cfe7d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.179528 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 954530e1c7204e1c9d9ded2460a823be (DEFAULT_TABLE table=default.Table_4960c3071f8247149c201f2d6c65090f [id=667f1e14021446d3bf165c34f9f0567d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.179587 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d8d2d5d7676f4b8096d10781cb0e5fce" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.179694 14978 raft_consensus.cc:2468] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:24.179761 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 954530e1c7204e1c9d9ded2460a823be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.179867 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4608033ee2244efda81dd70a5da61c5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.180624 15369 ts_tablet_manager.cc:1434] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:24.181067 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 0e09fa674c21442cbecdbe1ecbe24359 (table default.Table_4e764c9b1b9d4238b6df2a23c9c3ef34 [id=29a1ac5b34e84405ad2a34bd49ea9997]) successfully deleted
I20251025 08:02:24.181147 15048 leader_election.cc:304] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:24.181195 14642 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 3dc4e2f330ed47369b8ed63b1bcf134b because the tablet was not found. No further retry: Not found: Tablet not found: 3dc4e2f330ed47369b8ed63b1bcf134b
W20251025 08:02:24.181313 14642 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet cd03eb08d0e54427a4709a4de4c4796c because the tablet was not found. No further retry: Not found: Tablet not found: cd03eb08d0e54427a4709a4de4c4796c
I20251025 08:02:24.181382 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db9202bf6e6041f28b3173580db9ad7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.181700 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 954530e1c7204e1c9d9ded2460a823be (DEFAULT_TABLE table=default.Table_4960c3071f8247149c201f2d6c65090f [id=667f1e14021446d3bf165c34f9f0567d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.181893 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 954530e1c7204e1c9d9ded2460a823be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.182543 15642 raft_consensus.cc:2804] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.182597 15642 raft_consensus.cc:493] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.182641 15642 raft_consensus.cc:3060] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.182996 15369 tablet_bootstrap.cc:492] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.183528 15642 raft_consensus.cc:515] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.183868 15369 tablet_bootstrap.cc:654] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.184087 15642 leader_election.cc:290] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:24.184521 15245 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d8d2d5d7676f4b8096d10781cb0e5fce" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:24.184850 15049 leader_election.cc:343] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.184996 15090 tablet_service.cc:1505] Processing CreateTablet for tablet db9202bf6e6041f28b3173580db9ad7d (DEFAULT_TABLE table=default.Table_2d86a1e7ec904a128454ea0cf0839ed6 [id=f5c6646ac8924dd18f06bd714d116aa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.185132 15247 raft_consensus.cc:3060] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.185307 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db9202bf6e6041f28b3173580db9ad7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.185949 15247 raft_consensus.cc:1275] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.186033 15388 ts_tablet_manager.cc:1916] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.186946 15370 tablet_bootstrap.cc:492] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.187028 15370 ts_tablet_manager.cc:1403] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:24.187306 15642 consensus_queue.cc:1048] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.187412 15370 raft_consensus.cc:359] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.187595 15370 raft_consensus.cc:385] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.187636 15370 raft_consensus.cc:740] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.187758 15370 consensus_queue.cc:260] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.187919 14651 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet acee919057a64a1b86111f1804d8794b
I20251025 08:02:24.188036 15370 ts_tablet_manager.cc:1434] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.188161 14649 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet db9202bf6e6041f28b3173580db9ad7d
I20251025 08:02:24.188185 15370 tablet_bootstrap.cc:492] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.188722 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet db9202bf6e6041f28b3173580db9ad7d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.189441 15370 tablet_bootstrap.cc:654] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.189821 15386 ts_tablet_manager.cc:1929] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.189888 15386 log.cc:1199] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/3dc4e2f330ed47369b8ed63b1bcf134b
I20251025 08:02:24.190554 14655 master_service.cc:954] ReplaceTablet: received request to replace tablet 28d12c168eac49b8ba08e38d9880c798 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.191498 14956 tablet_service.cc:1552] Processing DeleteTablet for tablet db9202bf6e6041f28b3173580db9ad7d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.191587 15388 ts_tablet_manager.cc:1929] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.191658 15388 log.cc:1199] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/182d711eb2d547cb91f9624ea17eb4ad
I20251025 08:02:24.191838 15388 ts_tablet_manager.cc:1950] T 182d711eb2d547cb91f9624ea17eb4ad P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.192082 14649 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 24a584d6039d4041941f7c53bfcd9f2f (table default.Table_0f289526bf514ddc90a5622136145bff [id=170fdc9a02124e5488b4ac3d2776ca83]). Expected version 1 got 0
I20251025 08:02:24.192281 15388 tablet_replica.cc:333] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.192382 15388 raft_consensus.cc:2243] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.192502 15388 pending_rounds.cc:70] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:24.192535 15388 pending_rounds.cc:77] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609793283854336 op_type: NO_OP noop_request { }
I20251025 08:02:24.192574 15388 raft_consensus.cc:2889] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:24.192622 15388 raft_consensus.cc:2272] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.192849 15386 ts_tablet_manager.cc:1950] T 3dc4e2f330ed47369b8ed63b1bcf134b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.193419 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 3dc4e2f330ed47369b8ed63b1bcf134b (table default.Table_254086ab62b448c7a5fbc8b8c2589716 [id=f08621eb6d0e46cda20a72e487a1c2da]) successfully deleted
I20251025 08:02:24.193778 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 182d711eb2d547cb91f9624ea17eb4ad (table default.Table_4a5a1f334fef444b959ee1c82ed0d5a0 [id=33c97f69fa104ce1bff69626847a5b68]) successfully deleted
I20251025 08:02:24.194293 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet db9202bf6e6041f28b3173580db9ad7d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.195060 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d8d2d5d7676f4b8096d10781cb0e5fce" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:24.195152 14979 raft_consensus.cc:3060] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.198132 14979 raft_consensus.cc:2468] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:24.198324 14653 master_service.cc:954] ReplaceTablet: received request to replace tablet d458ae384ebd4c33bfc74e7657772fa6 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.198361 14651 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_4a5a1f334fef444b959ee1c82ed0d5a0" } modify_external_catalogs: true
I20251025 08:02:24.198434 14651 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_4a5a1f334fef444b959ee1c82ed0d5a0" } modify_external_catalogs: true
I20251025 08:02:24.199147 14978 raft_consensus.cc:1275] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.199129 14649 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_4960c3071f8247149c201f2d6c65090f" } modify_external_catalogs: true
I20251025 08:02:24.199225 14649 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_4960c3071f8247149c201f2d6c65090f" } modify_external_catalogs: true
I20251025 08:02:24.199504 15388 ts_tablet_manager.cc:1916] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.200824 15445 raft_consensus.cc:493] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.200901 15445 raft_consensus.cc:515] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.200933 14647 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 58b14a04ff6a4e18b9daa8c22f6e7307
I20251025 08:02:24.201167 14647 catalog_manager.cc:6719] ReplaceTablet: tablet 58b14a04ff6a4e18b9daa8c22f6e7307 deleted and replaced by tablet 2757cfa1345c4085b232e93ec32c8188
I20251025 08:02:24.201247 15445 leader_election.cc:290] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.201611 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet 58b14a04ff6a4e18b9daa8c22f6e7307 with delete_type TABLET_DATA_DELETED (replaced by tablet 2757cfa1345c4085b232e93ec32c8188) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.201817 15245 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2d7e4ad8c2f4915b721b77846cfc3cb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.201930 15245 raft_consensus.cc:2468] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.202271 14914 leader_election.cc:304] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.202463 15445 raft_consensus.cc:2804] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.202518 15445 raft_consensus.cc:493] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.202577 15445 raft_consensus.cc:3060] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.203408 15445 raft_consensus.cc:515] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.203729 15445 leader_election.cc:290] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.204411 15245 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2d7e4ad8c2f4915b721b77846cfc3cb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.204519 15245 raft_consensus.cc:3060] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.204607 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 58b14a04ff6a4e18b9daa8c22f6e7307 with delete_type TABLET_DATA_DELETED (replaced by tablet 2757cfa1345c4085b232e93ec32c8188) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.205094 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2d7e4ad8c2f4915b721b77846cfc3cb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:24.205200 15114 raft_consensus.cc:2468] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.205222 15048 leader_election.cc:304] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.205327 15388 ts_tablet_manager.cc:1929] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:24.205119 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2d7e4ad8c2f4915b721b77846cfc3cb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:24.205346 15245 raft_consensus.cc:2468] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.205400 15388 log.cc:1199] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/05be924a2b1c4f16a6cff056df2c1f71
I20251025 08:02:24.205421 15113 raft_consensus.cc:3060] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.205643 14914 leader_election.cc:304] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.205801 15445 raft_consensus.cc:2804] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.205858 15445 raft_consensus.cc:697] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:24.205958 15445 consensus_queue.cc:237] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.206306 15113 raft_consensus.cc:2468] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.206382 15497 raft_consensus.cc:2804] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.206466 15497 raft_consensus.cc:697] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:24.206492 15376 consensus_queue.cc:1048] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.206575 15497 consensus_queue.cc:237] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.207034 15436 tablet.cc:1722] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.207255 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 58b14a04ff6a4e18b9daa8c22f6e7307 with delete_type TABLET_DATA_DELETED (replaced by tablet 2757cfa1345c4085b232e93ec32c8188) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.209149 15437 tablet.cc:1722] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.209201 15451 tablet.cc:1722] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.211546 14648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_88cacd70c6c14947b18a8d94bc761229"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.211877 14648 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88cacd70c6c14947b18a8d94bc761229 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:24.211884 15668 consensus_queue.cc:1175] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ab02c9d78a9d42f193755d436c8d44b2" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20251025 08:02:24.212827 15464 raft_consensus.cc:493] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.212895 15464 raft_consensus.cc:515] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.213243 15464 leader_election.cc:290] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:24.213732 14640 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 44036e636edf42b89952e23dfc1a3d4c (table default.Table_6b8cc455bb574b30bdb9bca2ac803ae0 [id=6739c1319b784c8eb66fc75125f83056], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 44036e636edf42b89952e23dfc1a3d4c consensus state has no leader
I20251025 08:02:24.213728 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c64cf55ede2446ecbfc47be3e04eb646" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:24.214390 14914 leader_election.cc:343] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.214426 15385 ts_tablet_manager.cc:1916] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.215045 14646 catalog_manager.cc:5649] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:24.216053 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 5bf286568e8343b7921ac256a9313e63 (DEFAULT_TABLE table=default.Table_b22d946b289a4a0aa9c6ef1135c68e60 [id=46383e9b028a4d2bb7b39e04f147491e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.216183 15385 ts_tablet_manager.cc:1929] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:24.216250 15385 log.cc:1199] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/182d711eb2d547cb91f9624ea17eb4ad
I20251025 08:02:24.216300 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf286568e8343b7921ac256a9313e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.216477 15385 ts_tablet_manager.cc:1950] T 182d711eb2d547cb91f9624ea17eb4ad P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.216995 15385 tablet_replica.cc:333] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.217119 15385 raft_consensus.cc:2243] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.217290 15385 pending_rounds.cc:70] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:24.217320 15385 pending_rounds.cc:77] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7214609793888940032 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "58b14a04ff6a4e18b9daa8c22f6e7307" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.Table_0cc98145ba51465da6bf4ed027cb5d4b" dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" new_extra_config { } }
W20251025 08:02:24.217443 15385 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37198: Aborted: Op aborted
I20251025 08:02:24.217586 15385 raft_consensus.cc:2272] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.217655 15372 tablet_bootstrap.cc:492] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.217734 15372 ts_tablet_manager.cc:1403] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.085s user 0.001s sys 0.000s
I20251025 08:02:24.218148 15372 raft_consensus.cc:359] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.218300 15372 raft_consensus.cc:385] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.218333 15372 raft_consensus.cc:740] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.218436 15372 consensus_queue.cc:260] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.218556 15224 tablet_service.cc:1505] Processing CreateTablet for tablet dd2a01b7d5c14be0a1a6776540ef829e (DEFAULT_TABLE table=default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.218636 15385 ts_tablet_manager.cc:1916] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.218708 15372 ts_tablet_manager.cc:1434] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.218739 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2a01b7d5c14be0a1a6776540ef829e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.218871 15372 tablet_bootstrap.cc:492] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.219740 15372 tablet_bootstrap.cc:654] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.220206 15385 ts_tablet_manager.cc:1929] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:24.220372 15385 log.cc:1199] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/58b14a04ff6a4e18b9daa8c22f6e7307
I20251025 08:02:24.220674 15385 ts_tablet_manager.cc:1950] T 58b14a04ff6a4e18b9daa8c22f6e7307 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.221334 15386 tablet_replica.cc:333] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.221468 15386 raft_consensus.cc:2243] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.221563 15386 raft_consensus.cc:2272] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.223471 15228 tablet_service.cc:1505] Processing CreateTablet for tablet ed713c293e7f4b99a5d56f064db4b7b6 (DEFAULT_TABLE table=default.Table_aba4e23ad41c4bce9e35f52388813868 [id=b973c3ff7da44afea7909410938e2c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.223532 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 182d711eb2d547cb91f9624ea17eb4ad (table default.Table_4a5a1f334fef444b959ee1c82ed0d5a0 [id=33c97f69fa104ce1bff69626847a5b68]) successfully deleted
W20251025 08:02:24.223642 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet db9202bf6e6041f28b3173580db9ad7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db9202bf6e6041f28b3173580db9ad7d already in progress: creating tablet
I20251025 08:02:24.223666 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed713c293e7f4b99a5d56f064db4b7b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:24.223764 14640 catalog_manager.cc:5064] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): alter failed for tablet 58b14a04ff6a4e18b9daa8c22f6e7307 (table default.Table_0cc98145ba51465da6bf4ed027cb5d4b [id=e8f1b9d591bb4f8fbbb05ee960280cc6]): Aborted: Op aborted
I20251025 08:02:24.223870 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 58b14a04ff6a4e18b9daa8c22f6e7307 (table default.Table_0cc98145ba51465da6bf4ed027cb5d4b [id=e8f1b9d591bb4f8fbbb05ee960280cc6]) successfully deleted
I20251025 08:02:24.224193 14959 tablet_service.cc:1505] Processing CreateTablet for tablet dd2a01b7d5c14be0a1a6776540ef829e (DEFAULT_TABLE table=default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.224437 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2a01b7d5c14be0a1a6776540ef829e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.224498 15372 tablet_bootstrap.cc:492] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.224573 15372 ts_tablet_manager.cc:1403] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:24.224970 15372 raft_consensus.cc:359] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.225054 15372 raft_consensus.cc:385] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.225085 15372 raft_consensus.cc:740] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.225180 15372 consensus_queue.cc:260] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.225440 15372 ts_tablet_manager.cc:1434] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.225616 15372 tablet_bootstrap.cc:492] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.225627 15388 ts_tablet_manager.cc:1950] T 05be924a2b1c4f16a6cff056df2c1f71 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.225766 15386 ts_tablet_manager.cc:1916] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.226255 14958 tablet_service.cc:1505] Processing CreateTablet for tablet d9067b563519468ca71ebfcc738462b9 (DEFAULT_TABLE table=default.Table_4a5a1f334fef444b959ee1c82ed0d5a0 [id=33c97f69fa104ce1bff69626847a5b68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.226441 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9067b563519468ca71ebfcc738462b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.226487 15372 tablet_bootstrap.cc:654] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.226679 15370 tablet_bootstrap.cc:492] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.226773 15370 ts_tablet_manager.cc:1403] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.001s
I20251025 08:02:24.227175 15370 raft_consensus.cc:359] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.227260 15370 raft_consensus.cc:385] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.227293 15370 raft_consensus.cc:740] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.227394 15370 consensus_queue.cc:260] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.227514 15386 ts_tablet_manager.cc:1929] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.227563 15386 log.cc:1199] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/182d711eb2d547cb91f9624ea17eb4ad
I20251025 08:02:24.227619 15370 ts_tablet_manager.cc:1434] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.227727 15386 ts_tablet_manager.cc:1950] T 182d711eb2d547cb91f9624ea17eb4ad P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.227773 15370 tablet_bootstrap.cc:492] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.228152 15386 tablet_replica.cc:333] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.228255 15386 raft_consensus.cc:2243] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.228327 15386 raft_consensus.cc:2272] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.228591 15370 tablet_bootstrap.cc:654] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.229017 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 182d711eb2d547cb91f9624ea17eb4ad (table default.Table_4a5a1f334fef444b959ee1c82ed0d5a0 [id=33c97f69fa104ce1bff69626847a5b68]) successfully deleted
I20251025 08:02:24.229424 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 5bf286568e8343b7921ac256a9313e63 (DEFAULT_TABLE table=default.Table_b22d946b289a4a0aa9c6ef1135c68e60 [id=46383e9b028a4d2bb7b39e04f147491e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.229619 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf286568e8343b7921ac256a9313e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.230072 15388 tablet_replica.cc:333] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.230165 15388 raft_consensus.cc:2243] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.230273 15388 pending_rounds.cc:70] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e: Trying to abort 2 pending ops.
I20251025 08:02:24.230296 15388 pending_rounds.cc:77] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7214609793623330816 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "58b14a04ff6a4e18b9daa8c22f6e7307" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_af01f40543814889943b631a351a302e" dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" new_extra_config { } }
I20251025 08:02:24.230445 15388 pending_rounds.cc:77] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609792659054592 op_type: NO_OP noop_request { }
I20251025 08:02:24.230490 15388 raft_consensus.cc:2889] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:24.230545 15388 raft_consensus.cc:2272] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.231160 15369 tablet_bootstrap.cc:492] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.231232 15369 ts_tablet_manager.cc:1403] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.000s
I20251025 08:02:24.231662 15369 raft_consensus.cc:359] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.231760 15369 raft_consensus.cc:385] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.231796 15369 raft_consensus.cc:740] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.231935 15369 consensus_queue.cc:260] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.232350 15445 raft_consensus.cc:493] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.232422 15445 raft_consensus.cc:515] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.232669 15369 ts_tablet_manager.cc:1434] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.232738 15445 leader_election.cc:290] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.232820 15369 tablet_bootstrap.cc:492] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.233050 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0635cb57c4d4d51bed5897b28cc3dcd" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.233142 15246 raft_consensus.cc:2468] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.233397 14914 leader_election.cc:304] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.233615 15445 raft_consensus.cc:2804] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.233659 15445 raft_consensus.cc:493] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.233693 15445 raft_consensus.cc:3060] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.233773 15369 tablet_bootstrap.cc:654] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.234424 15445 raft_consensus.cc:515] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.234706 15445 leader_election.cc:290] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.235059 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0635cb57c4d4d51bed5897b28cc3dcd" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.235147 15246 raft_consensus.cc:3060] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.235302 15370 tablet_bootstrap.cc:492] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.235373 15370 ts_tablet_manager.cc:1403] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20251025 08:02:24.235821 15370 raft_consensus.cc:359] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.235898 15370 raft_consensus.cc:385] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.235924 15370 raft_consensus.cc:740] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.235950 15246 raft_consensus.cc:2468] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.236044 15370 consensus_queue.cc:260] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.236296 15388 ts_tablet_manager.cc:1916] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.236284 14914 leader_election.cc:304] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.236312 15370 ts_tablet_manager.cc:1434] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.236466 15370 tablet_bootstrap.cc:492] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.236855 15445 raft_consensus.cc:2804] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.236927 15445 raft_consensus.cc:697] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:24.237025 15445 consensus_queue.cc:237] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.237295 15370 tablet_bootstrap.cc:654] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.237836 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 05be924a2b1c4f16a6cff056df2c1f71 (table default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]) successfully deleted
W20251025 08:02:24.238015 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet db9202bf6e6041f28b3173580db9ad7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db9202bf6e6041f28b3173580db9ad7d already in progress: creating tablet
I20251025 08:02:24.238361 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c64cf55ede2446ecbfc47be3e04eb646" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:24.238456 15114 raft_consensus.cc:2468] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.238616 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 5bf286568e8343b7921ac256a9313e63 (DEFAULT_TABLE table=default.Table_b22d946b289a4a0aa9c6ef1135c68e60 [id=46383e9b028a4d2bb7b39e04f147491e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.238449 15388 ts_tablet_manager.cc:1929] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.238754 15388 log.cc:1199] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/58b14a04ff6a4e18b9daa8c22f6e7307
I20251025 08:02:24.238832 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bf286568e8343b7921ac256a9313e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.239001 15388 ts_tablet_manager.cc:1950] T 58b14a04ff6a4e18b9daa8c22f6e7307 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.239109 15369 tablet_bootstrap.cc:492] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.239173 15369 ts_tablet_manager.cc:1403] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.001s
I20251025 08:02:24.240546 15093 tablet_service.cc:1505] Processing CreateTablet for tablet dd2a01b7d5c14be0a1a6776540ef829e (DEFAULT_TABLE table=default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.240772 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2a01b7d5c14be0a1a6776540ef829e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.240795 15451 tablet.cc:1722] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.240871 15092 tablet_service.cc:1505] Processing CreateTablet for tablet d9067b563519468ca71ebfcc738462b9 (DEFAULT_TABLE table=default.Table_4a5a1f334fef444b959ee1c82ed0d5a0 [id=33c97f69fa104ce1bff69626847a5b68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.241075 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9067b563519468ca71ebfcc738462b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.241148 15464 raft_consensus.cc:493] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.241209 15464 raft_consensus.cc:515] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.241513 15464 leader_election.cc:290] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.242079 15369 raft_consensus.cc:359] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.242161 15369 raft_consensus.cc:385] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.242281 15369 raft_consensus.cc:740] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.242432 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "28d12c168eac49b8ba08e38d9880c798" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:24.242710 14914 leader_election.cc:343] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.242833 15369 consensus_queue.cc:260] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.243134 15091 tablet_service.cc:1505] Processing CreateTablet for tablet ed713c293e7f4b99a5d56f064db4b7b6 (DEFAULT_TABLE table=default.Table_aba4e23ad41c4bce9e35f52388813868 [id=b973c3ff7da44afea7909410938e2c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.243335 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed713c293e7f4b99a5d56f064db4b7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.243436 14915 leader_election.cc:304] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.243841 15369 ts_tablet_manager.cc:1434] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20251025 08:02:24.243844 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0635cb57c4d4d51bed5897b28cc3dcd" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:24.243950 15464 raft_consensus.cc:2804] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.243937 15114 raft_consensus.cc:2468] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.243991 15464 raft_consensus.cc:493] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.244022 15464 raft_consensus.cc:3060] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.244015 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "28d12c168eac49b8ba08e38d9880c798" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:24.244105 15112 raft_consensus.cc:2468] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.244349 15369 tablet_bootstrap.cc:492] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.244814 15464 raft_consensus.cc:515] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.245095 15464 leader_election.cc:290] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.245219 15369 tablet_bootstrap.cc:654] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.245239 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0635cb57c4d4d51bed5897b28cc3dcd" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:24.245324 15113 raft_consensus.cc:3060] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.245848 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c64cf55ede2446ecbfc47be3e04eb646" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.245932 15246 raft_consensus.cc:3060] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.246125 15113 raft_consensus.cc:2468] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.246277 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 58b14a04ff6a4e18b9daa8c22f6e7307 (table default.Table_0cc98145ba51465da6bf4ed027cb5d4b [id=e8f1b9d591bb4f8fbbb05ee960280cc6]) successfully deleted
I20251025 08:02:24.246325 14652 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_d91ac83609a0452680e6ef9a726b5f31"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.246692 15246 raft_consensus.cc:2468] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
W20251025 08:02:24.246686 14652 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d91ac83609a0452680e6ef9a726b5f31 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.247228 14914 leader_election.cc:304] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.247361 15464 raft_consensus.cc:2804] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.247424 15464 raft_consensus.cc:697] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:24.247540 15464 consensus_queue.cc:237] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.249099 15596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94a96657c5fd49398b88e9ad615bfe1e. Latest consensus state: current_term: 2 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:24.249202 15596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:24.249307 15596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:24.249363 15596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:24.249480 15224 tablet_service.cc:1505] Processing CreateTablet for tablet d9067b563519468ca71ebfcc738462b9 (DEFAULT_TABLE table=default.Table_4a5a1f334fef444b959ee1c82ed0d5a0 [id=33c97f69fa104ce1bff69626847a5b68]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.249663 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9067b563519468ca71ebfcc738462b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.250623 15370 tablet_bootstrap.cc:492] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.250691 15370 ts_tablet_manager.cc:1403] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20251025 08:02:24.251063 15370 raft_consensus.cc:359] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.251140 15370 raft_consensus.cc:385] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.251168 15370 raft_consensus.cc:740] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.251291 15370 consensus_queue.cc:260] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.251519 15370 ts_tablet_manager.cc:1434] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.251670 15370 tablet_bootstrap.cc:492] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.252489 15370 tablet_bootstrap.cc:654] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.252461 14915 leader_election.cc:304] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.254230 15370 tablet_bootstrap.cc:492] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.254302 15370 ts_tablet_manager.cc:1403] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:24.254318 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c64cf55ede2446ecbfc47be3e04eb646" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:24.254396 15113 raft_consensus.cc:3060] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.254647 15445 raft_consensus.cc:2804] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.254695 15445 raft_consensus.cc:493] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.254729 15445 raft_consensus.cc:3060] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.254710 15370 raft_consensus.cc:359] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.254786 15370 raft_consensus.cc:385] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.254814 15370 raft_consensus.cc:740] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.254915 15370 consensus_queue.cc:260] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.255142 15113 raft_consensus.cc:2468] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.255174 15370 ts_tablet_manager.cc:1434] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.255460 15445 raft_consensus.cc:515] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.255548 15370 tablet_bootstrap.cc:492] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.255733 15445 leader_election.cc:290] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.256098 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "28d12c168eac49b8ba08e38d9880c798" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:24.256353 14914 leader_election.cc:343] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.256485 15370 tablet_bootstrap.cc:654] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.256979 15372 tablet_bootstrap.cc:492] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.257053 15372 ts_tablet_manager.cc:1403] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20251025 08:02:24.257128 14955 tablet_service.cc:1505] Processing CreateTablet for tablet ed713c293e7f4b99a5d56f064db4b7b6 (DEFAULT_TABLE table=default.Table_aba4e23ad41c4bce9e35f52388813868 [id=b973c3ff7da44afea7909410938e2c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.257334 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed713c293e7f4b99a5d56f064db4b7b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.257567 15372 raft_consensus.cc:359] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.257673 15372 raft_consensus.cc:385] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.257711 15372 raft_consensus.cc:740] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.257829 15372 consensus_queue.cc:260] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.258057 15372 ts_tablet_manager.cc:1434] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.258246 15372 tablet_bootstrap.cc:492] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.259156 15372 tablet_bootstrap.cc:654] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.260244 15370 tablet_bootstrap.cc:492] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.260317 15370 ts_tablet_manager.cc:1403] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:24.260684 15370 raft_consensus.cc:359] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.260764 15370 raft_consensus.cc:385] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.260790 15370 raft_consensus.cc:740] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.260882 15370 consensus_queue.cc:260] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.261122 15370 ts_tablet_manager.cc:1434] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.261268 15370 tablet_bootstrap.cc:492] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.261883 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "28d12c168eac49b8ba08e38d9880c798" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:24.261970 15113 raft_consensus.cc:3060] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.262085 15370 tablet_bootstrap.cc:654] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.262715 15113 raft_consensus.cc:2468] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.262987 14915 leader_election.cc:304] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.263173 15445 raft_consensus.cc:2804] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.263264 15445 raft_consensus.cc:697] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:24.263368 15445 consensus_queue.cc:237] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.263717 15372 tablet_bootstrap.cc:492] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.263785 15372 ts_tablet_manager.cc:1403] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:24.264123 15369 tablet_bootstrap.cc:492] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.264189 15369 ts_tablet_manager.cc:1403] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.001s
I20251025 08:02:24.264192 15372 raft_consensus.cc:359] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.264279 15372 raft_consensus.cc:385] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.264312 15372 raft_consensus.cc:740] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.264408 15372 consensus_queue.cc:260] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.264580 15369 raft_consensus.cc:359] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.264626 15372 ts_tablet_manager.cc:1434] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.264660 15369 raft_consensus.cc:385] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.264690 15369 raft_consensus.cc:740] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.264776 15372 tablet_bootstrap.cc:492] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.264782 15369 consensus_queue.cc:260] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.265012 15369 ts_tablet_manager.cc:1434] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.265607 15372 tablet_bootstrap.cc:654] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.267308 14650 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 1695780ae4e24c288df851c2aff7e22c
W20251025 08:02:24.267482 14640 catalog_manager.cc:5058] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): alter failed for tablet 58b14a04ff6a4e18b9daa8c22f6e7307 (table default.Table_0cc98145ba51465da6bf4ed027cb5d4b [id=e8f1b9d591bb4f8fbbb05ee960280cc6]),no further retry: Not found: Tablet not found: 58b14a04ff6a4e18b9daa8c22f6e7307
I20251025 08:02:24.267700 14650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_3e2c7c94e9d94339863b1848f4d0bb6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.267823 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 1695780ae4e24c288df851c2aff7e22c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
W20251025 08:02:24.268018 14650 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e2c7c94e9d94339863b1848f4d0bb6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.268646 14654 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_0f289526bf514ddc90a5622136145bff [id=170fdc9a02124e5488b4ac3d2776ca83] alter complete (version 1)
I20251025 08:02:24.268893 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_9a3a6f5c45104e33a5a455d911ce8927"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.269054 14648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_e95c804d7eab4d979aa8b83cf41e6acc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.269173 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a3a6f5c45104e33a5a455d911ce8927 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:24.269270 14648 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e95c804d7eab4d979aa8b83cf41e6acc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.269820 14649 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 954530e1c7204e1c9d9ded2460a823be
I20251025 08:02:24.270092 14655 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 28d12c168eac49b8ba08e38d9880c798
I20251025 08:02:24.270311 14653 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet d458ae384ebd4c33bfc74e7657772fa6
I20251025 08:02:24.270409 14651 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet d9067b563519468ca71ebfcc738462b9
I20251025 08:02:24.270519 14653 catalog_manager.cc:6719] ReplaceTablet: tablet d458ae384ebd4c33bfc74e7657772fa6 deleted and replaced by tablet 0fa8e1e7a015466699c3b98dd0647cce
I20251025 08:02:24.270983 14647 catalog_manager.cc:5649] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:24.271809 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 1695780ae4e24c288df851c2aff7e22c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.271977 15388 tablet_replica.cc:333] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.272104 15388 raft_consensus.cc:2243] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.272187 15388 raft_consensus.cc:2272] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.272403 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 954530e1c7204e1c9d9ded2460a823be with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.272516 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 28d12c168eac49b8ba08e38d9880c798 with delete_type TABLET_DATA_DELETED (replaced by tablet 1127507b5fd54fe0b1a7e7edf936bc38) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.272512 15388 ts_tablet_manager.cc:1916] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.272642 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet d9067b563519468ca71ebfcc738462b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.272538 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet d458ae384ebd4c33bfc74e7657772fa6 with delete_type TABLET_DATA_DELETED (replaced by tablet 0fa8e1e7a015466699c3b98dd0647cce) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.272795 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_49352274aacf479292f43c128367eeb0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.273095 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49352274aacf479292f43c128367eeb0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.274434 15388 ts_tablet_manager.cc:1929] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.274499 15388 log.cc:1199] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/1695780ae4e24c288df851c2aff7e22c
I20251025 08:02:24.274695 15388 ts_tablet_manager.cc:1950] T 1695780ae4e24c288df851c2aff7e22c P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.274691 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet d9067b563519468ca71ebfcc738462b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.275034 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 28d12c168eac49b8ba08e38d9880c798 with delete_type TABLET_DATA_DELETED (replaced by tablet 1127507b5fd54fe0b1a7e7edf936bc38) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.270321 14655 catalog_manager.cc:6719] ReplaceTablet: tablet 28d12c168eac49b8ba08e38d9880c798 deleted and replaced by tablet 1127507b5fd54fe0b1a7e7edf936bc38
I20251025 08:02:24.275278 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet d458ae384ebd4c33bfc74e7657772fa6 with delete_type TABLET_DATA_DELETED (replaced by tablet 0fa8e1e7a015466699c3b98dd0647cce) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.275354 15388 tablet_replica.cc:333] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.275456 15388 raft_consensus.cc:2243] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.275557 15388 raft_consensus.cc:2272] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.275831 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 1695780ae4e24c288df851c2aff7e22c (table default.Table_c11d0b545be3442685df355dba9a8f12 [id=9f02c9df85ba446cbe85aa321eb93c2d]) successfully deleted
I20251025 08:02:24.276064 15388 ts_tablet_manager.cc:1916] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.276021 14649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_63514c27831b42fb86426281df03df7d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.276311 14649 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_63514c27831b42fb86426281df03df7d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.277715 15388 ts_tablet_manager.cc:1929] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.277788 15388 log.cc:1199] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/954530e1c7204e1c9d9ded2460a823be
I20251025 08:02:24.278012 15388 ts_tablet_manager.cc:1950] T 954530e1c7204e1c9d9ded2460a823be P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.278566 15388 tablet_replica.cc:333] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.278689 15388 raft_consensus.cc:2243] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.278780 15388 raft_consensus.cc:2272] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.278788 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 954530e1c7204e1c9d9ded2460a823be (table default.Table_4960c3071f8247149c201f2d6c65090f [id=667f1e14021446d3bf165c34f9f0567d]) successfully deleted
I20251025 08:02:24.278854 15369 tablet_bootstrap.cc:492] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.279242 15388 ts_tablet_manager.cc:1916] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.279582 15370 tablet_bootstrap.cc:492] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.279660 15370 ts_tablet_manager.cc:1403] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.018s user 0.000s sys 0.001s
I20251025 08:02:24.279862 15369 tablet_bootstrap.cc:654] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.280107 15370 raft_consensus.cc:359] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.280212 15370 raft_consensus.cc:385] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.280326 15370 raft_consensus.cc:740] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.280462 15370 consensus_queue.cc:260] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.280715 15370 ts_tablet_manager.cc:1434] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.280871 15388 ts_tablet_manager.cc:1929] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.280941 15388 log.cc:1199] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/28d12c168eac49b8ba08e38d9880c798
I20251025 08:02:24.281150 15388 ts_tablet_manager.cc:1950] T 28d12c168eac49b8ba08e38d9880c798 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.281150 15372 tablet_bootstrap.cc:492] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.281140 14652 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_0cc98145ba51465da6bf4ed027cb5d4b" } new_table_name: "default.Table_c414e6cfc2cf41198677517c4a4bfbef" modify_external_catalogs: true
I20251025 08:02:24.281235 15372 ts_tablet_manager.cc:1403] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20251025 08:02:24.281478 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 954530e1c7204e1c9d9ded2460a823be with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.281654 15372 raft_consensus.cc:359] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.281759 15372 raft_consensus.cc:385] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.281805 15372 raft_consensus.cc:740] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.281924 15372 consensus_queue.cc:260] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.282143 15386 ts_tablet_manager.cc:1916] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.282208 15372 ts_tablet_manager.cc:1434] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.282402 15372 tablet_bootstrap.cc:492] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.282414 15385 tablet_replica.cc:333] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.282521 15385 raft_consensus.cc:2243] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.282603 15385 raft_consensus.cc:2272] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.283270 15372 tablet_bootstrap.cc:654] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.284022 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet 954530e1c7204e1c9d9ded2460a823be with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.284125 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet 28d12c168eac49b8ba08e38d9880c798 with delete_type TABLET_DATA_DELETED (replaced by tablet 1127507b5fd54fe0b1a7e7edf936bc38) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.284211 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet d9067b563519468ca71ebfcc738462b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.284364 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet d458ae384ebd4c33bfc74e7657772fa6 with delete_type TABLET_DATA_DELETED (replaced by tablet 0fa8e1e7a015466699c3b98dd0647cce) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.284734 15369 tablet_bootstrap.cc:492] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.284809 15369 ts_tablet_manager.cc:1403] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:24.284837 15642 raft_consensus.cc:493] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.284899 15370 tablet_bootstrap.cc:492] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.284924 15380 raft_consensus.cc:493] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.284976 15380 raft_consensus.cc:515] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.285279 15380 leader_election.cc:290] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:24.285197 15369 raft_consensus.cc:359] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.285522 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44036e636edf42b89952e23dfc1a3d4c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.285549 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 1695780ae4e24c288df851c2aff7e22c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.285647 14978 raft_consensus.cc:2468] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:24.285780 15370 tablet_bootstrap.cc:654] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.284901 15642 raft_consensus.cc:515] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.286801 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4608033ee2244efda81dd70a5da61c5e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.286172 15642 leader_election.cc:290] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.286640 15048 leader_election.cc:304] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
W20251025 08:02:24.287865 15048 leader_election.cc:343] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.287874 15642 raft_consensus.cc:2804] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.289547 15642 raft_consensus.cc:493] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.289593 15642 raft_consensus.cc:3060] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.290518 15642 raft_consensus.cc:515] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.290648 15386 ts_tablet_manager.cc:1929] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.290706 15386 log.cc:1199] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/05be924a2b1c4f16a6cff056df2c1f71
I20251025 08:02:24.290849 15642 leader_election.cc:290] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:24.290892 15386 ts_tablet_manager.cc:1950] T 05be924a2b1c4f16a6cff056df2c1f71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.291122 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44036e636edf42b89952e23dfc1a3d4c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:24.291219 14978 raft_consensus.cc:3060] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.291489 15372 tablet_bootstrap.cc:492] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.291555 15372 ts_tablet_manager.cc:1403] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251025 08:02:24.291527 14651 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_d9f70d3fb7f64a8b85b2f0536b3c45f1" } new_table_name: "default.Table_8b233422b57e405daba765b7619adfad" modify_external_catalogs: true
I20251025 08:02:24.291942 15372 raft_consensus.cc:359] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.292066 15372 raft_consensus.cc:385] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.292071 14978 raft_consensus.cc:2468] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:24.292102 15372 raft_consensus.cc:740] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.292203 15372 consensus_queue.cc:260] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.292392 15048 leader_election.cc:304] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:24.292487 15372 ts_tablet_manager.cc:1434] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.292639 15372 tablet_bootstrap.cc:492] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.292919 15388 tablet_replica.cc:333] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.293052 15388 raft_consensus.cc:2243] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.293133 15388 raft_consensus.cc:2272] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.293136 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 28d12c168eac49b8ba08e38d9880c798 (table default.Table_cccb10034b9549bc84a9019610866553 [id=3a6fcff5488b4ee698661c7e51f754ea]) successfully deleted
I20251025 08:02:24.294525 15370 tablet_bootstrap.cc:492] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.294603 15370 ts_tablet_manager.cc:1403] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20251025 08:02:24.295003 15370 raft_consensus.cc:359] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.295095 15370 raft_consensus.cc:385] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.295126 15370 raft_consensus.cc:740] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.295241 15370 consensus_queue.cc:260] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.295485 15370 ts_tablet_manager.cc:1434] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:24.296068 15388 ts_tablet_manager.cc:1916] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.298051 15388 ts_tablet_manager.cc:1929] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.298126 15388 log.cc:1199] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/d9067b563519468ca71ebfcc738462b9
I20251025 08:02:24.298283 15372 tablet_bootstrap.cc:654] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.298465 15388 ts_tablet_manager.cc:1950] T d9067b563519468ca71ebfcc738462b9 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.298758 15386 tablet_replica.cc:333] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.298929 15386 raft_consensus.cc:2243] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.299108 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet d9067b563519468ca71ebfcc738462b9 (table default.Table_4a5a1f334fef444b959ee1c82ed0d5a0 [id=33c97f69fa104ce1bff69626847a5b68]) successfully deleted
I20251025 08:02:24.299235 15386 pending_rounds.cc:70] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 2 pending ops.
I20251025 08:02:24.299268 15380 raft_consensus.cc:2804] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.299288 15386 pending_rounds.cc:77] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7214609793623330816 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "58b14a04ff6a4e18b9daa8c22f6e7307" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_af01f40543814889943b631a351a302e" dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" new_extra_config { } }
I20251025 08:02:24.299371 15380 raft_consensus.cc:697] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:24.299510 15386 pending_rounds.cc:77] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609792659054592 op_type: NO_OP noop_request { }
I20251025 08:02:24.299489 15380 consensus_queue.cc:237] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.299592 15386 raft_consensus.cc:2889] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:24.299664 15386 raft_consensus.cc:2272] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.301129 15386 ts_tablet_manager.cc:1916] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:24.301368 14652 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2757cfa1345c4085b232e93ec32c8188 has no consensus state
I20251025 08:02:24.302282 14978 raft_consensus.cc:1275] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.302634 15380 consensus_queue.cc:1048] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.303700 15345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:24.303797 15345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: This master's current role is: LEADER
I20251025 08:02:24.305631 15386 ts_tablet_manager.cc:1929] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.305699 15386 log.cc:1199] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/58b14a04ff6a4e18b9daa8c22f6e7307
I20251025 08:02:24.305928 15386 ts_tablet_manager.cc:1950] T 58b14a04ff6a4e18b9daa8c22f6e7307 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.306607 15386 tablet_replica.cc:333] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.306821 15386 raft_consensus.cc:2243] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.306973 15386 raft_consensus.cc:2272] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.307461 15386 ts_tablet_manager.cc:1916] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.308833 15436 tablet.cc:1722] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.308894 15385 ts_tablet_manager.cc:1916] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.309198 15451 tablet.cc:1722] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.310998 15385 ts_tablet_manager.cc:1929] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.311070 15385 log.cc:1199] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/1695780ae4e24c288df851c2aff7e22c
I20251025 08:02:24.311264 15385 ts_tablet_manager.cc:1950] T 1695780ae4e24c288df851c2aff7e22c P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.311872 15385 tablet_replica.cc:333] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.311980 15385 raft_consensus.cc:2243] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.312093 15385 pending_rounds.cc:70] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:24.312119 15385 pending_rounds.cc:77] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609794103746560 op_type: NO_OP noop_request { }
I20251025 08:02:24.312162 15385 raft_consensus.cc:2889] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:24.312206 15385 raft_consensus.cc:2272] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.312987 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 05be924a2b1c4f16a6cff056df2c1f71 (table default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]) successfully deleted
I20251025 08:02:24.313050 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 1695780ae4e24c288df851c2aff7e22c (table default.Table_c11d0b545be3442685df355dba9a8f12 [id=9f02c9df85ba446cbe85aa321eb93c2d]) successfully deleted
I20251025 08:02:24.313078 15248 raft_consensus.cc:1275] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251025 08:02:24.313127 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet db9202bf6e6041f28b3173580db9ad7d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db9202bf6e6041f28b3173580db9ad7d already in progress: creating tablet
W20251025 08:02:24.313158 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet d9067b563519468ca71ebfcc738462b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9067b563519468ca71ebfcc738462b9 already in progress: creating tablet
I20251025 08:02:24.313232 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 58b14a04ff6a4e18b9daa8c22f6e7307 (table default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]) successfully deleted
W20251025 08:02:24.313349 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 954530e1c7204e1c9d9ded2460a823be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 954530e1c7204e1c9d9ded2460a823be already in progress: creating tablet
I20251025 08:02:24.313534 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44036e636edf42b89952e23dfc1a3d4c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.313659 15385 ts_tablet_manager.cc:1916] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.313691 15245 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4608033ee2244efda81dd70a5da61c5e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.313730 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "44036e636edf42b89952e23dfc1a3d4c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.314481 15372 tablet_bootstrap.cc:492] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.314560 15372 ts_tablet_manager.cc:1403] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.002s
I20251025 08:02:24.314976 15372 raft_consensus.cc:359] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.315079 15372 raft_consensus.cc:385] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.315110 15372 raft_consensus.cc:740] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.315223 15372 consensus_queue.cc:260] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.315503 15372 ts_tablet_manager.cc:1434] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:24.315685 15372 tablet_bootstrap.cc:492] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.316579 15372 tablet_bootstrap.cc:654] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.317294 15386 ts_tablet_manager.cc:1929] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.317404 15386 log.cc:1199] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/28d12c168eac49b8ba08e38d9880c798
I20251025 08:02:24.317652 15386 ts_tablet_manager.cc:1950] T 28d12c168eac49b8ba08e38d9880c798 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.318310 15385 ts_tablet_manager.cc:1929] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:24.318424 15385 log.cc:1199] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/28d12c168eac49b8ba08e38d9880c798
I20251025 08:02:24.318699 15385 ts_tablet_manager.cc:1950] T 28d12c168eac49b8ba08e38d9880c798 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.318668 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 2757cfa1345c4085b232e93ec32c8188 (DEFAULT_TABLE table=default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.318923 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2757cfa1345c4085b232e93ec32c8188. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.321348 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 28d12c168eac49b8ba08e38d9880c798 (table default.Table_cccb10034b9549bc84a9019610866553 [id=3a6fcff5488b4ee698661c7e51f754ea]) successfully deleted
W20251025 08:02:24.321782 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet d458ae384ebd4c33bfc74e7657772fa6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d458ae384ebd4c33bfc74e7657772fa6 already in progress: creating tablet
W20251025 08:02:24.322391 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 954530e1c7204e1c9d9ded2460a823be because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 954530e1c7204e1c9d9ded2460a823be already in progress: creating tablet
I20251025 08:02:24.322366 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 2757cfa1345c4085b232e93ec32c8188 (DEFAULT_TABLE table=default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:24.323004 15049 leader_election.cc:343] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:24.323169 15049 leader_election.cc:343] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.323232 15049 leader_election.cc:304] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.323356 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 2757cfa1345c4085b232e93ec32c8188 (DEFAULT_TABLE table=default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:24.323421 15049 leader_election.cc:343] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.323642 15380 consensus_queue.cc:1048] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.323870 15380 raft_consensus.cc:2749] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.323977 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 28d12c168eac49b8ba08e38d9880c798 (table default.Table_cccb10034b9549bc84a9019610866553 [id=3a6fcff5488b4ee698661c7e51f754ea]) successfully deleted
W20251025 08:02:24.324098 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet d9067b563519468ca71ebfcc738462b9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d9067b563519468ca71ebfcc738462b9 already in progress: creating tablet
W20251025 08:02:24.324203 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet d458ae384ebd4c33bfc74e7657772fa6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d458ae384ebd4c33bfc74e7657772fa6 already in progress: creating tablet
W20251025 08:02:24.325093 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 1695780ae4e24c288df851c2aff7e22c because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1695780ae4e24c288df851c2aff7e22c already in progress: creating tablet
I20251025 08:02:24.326687 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2757cfa1345c4085b232e93ec32c8188. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.285523 15369 raft_consensus.cc:385] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.327591 15369 raft_consensus.cc:740] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.327705 15369 consensus_queue.cc:260] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.328797 15464 raft_consensus.cc:493] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.328874 15464 raft_consensus.cc:515] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.329263 15464 leader_election.cc:290] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.329820 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ccb533134db94f29a781095e7fb55e04" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:24.329918 15113 raft_consensus.cc:2468] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.330263 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ccb533134db94f29a781095e7fb55e04" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.330358 15247 raft_consensus.cc:2468] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.330672 14915 leader_election.cc:304] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:24.331473 15464 raft_consensus.cc:2804] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.331525 15464 raft_consensus.cc:493] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.331560 15464 raft_consensus.cc:3060] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.332378 15464 raft_consensus.cc:515] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.332701 15464 leader_election.cc:290] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.333479 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ccb533134db94f29a781095e7fb55e04" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:24.333575 15113 raft_consensus.cc:3060] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.334450 15113 raft_consensus.cc:2468] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.334522 15369 ts_tablet_manager.cc:1434] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.050s user 0.001s sys 0.000s
I20251025 08:02:24.334705 14915 leader_election.cc:304] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:24.334867 15464 raft_consensus.cc:2804] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.334848 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ccb533134db94f29a781095e7fb55e04" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.334942 15247 raft_consensus.cc:3060] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.334931 15464 raft_consensus.cc:697] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:24.335063 15464 consensus_queue.cc:237] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.335778 15247 raft_consensus.cc:2468] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.337616 15369 tablet_bootstrap.cc:492] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.338079 15437 tablet.cc:1722] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.338637 15369 tablet_bootstrap.cc:654] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.340723 15372 tablet_bootstrap.cc:492] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.340806 15372 ts_tablet_manager.cc:1403] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.001s
I20251025 08:02:24.341264 15372 raft_consensus.cc:359] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.341360 15372 raft_consensus.cc:385] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.341398 15372 raft_consensus.cc:740] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.341468 14652 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_63514c27831b42fb86426281df03df7d" } new_table_name: "default.Table_0d8dd510c9054bf68417584232937996" modify_external_catalogs: true
I20251025 08:02:24.341511 15372 consensus_queue.cc:260] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.341770 15372 ts_tablet_manager.cc:1434] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.341928 15372 tablet_bootstrap.cc:492] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.342947 15372 tablet_bootstrap.cc:654] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.344322 14647 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_8f74d707fd274ba48bd0f75155b2a180" } new_table_name: "default.Table_30272613d7184fb1b153ca55ed9df9e8" modify_external_catalogs: true
I20251025 08:02:24.346134 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_8436de66616b479fa1982a64ba3579d0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.346477 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8436de66616b479fa1982a64ba3579d0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:24.346951 14652 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fe4f4c8c26804aee8e45926f60b8da79 has no consensus state
I20251025 08:02:24.347143 14648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_8ec26b25f09a4804b8ac3cbca4b4ff50"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.347433 14648 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ec26b25f09a4804b8ac3cbca4b4ff50 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.348227 14651 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_89703a34a83e4da8973b625249c4a03d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.348497 14651 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89703a34a83e4da8973b625249c4a03d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.299268 15388 tablet_replica.cc:333] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.353125 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2757cfa1345c4085b232e93ec32c8188. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:24.355898 14647 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a0a2af3ed1f41fea41962db52cfe7d8 consensus state has no leader
I20251025 08:02:24.356056 15370 tablet_bootstrap.cc:492] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.356999 15370 tablet_bootstrap.cc:654] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.358376 15409 raft_consensus.cc:493] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.358449 15409 raft_consensus.cc:515] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.358727 15409 leader_election.cc:290] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.359040 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f7aa0b88b284d52a6cca064a798aa54" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:24.359243 14651 master_service.cc:954] ReplaceTablet: received request to replace tablet ccb533134db94f29a781095e7fb55e04 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.352339 15388 raft_consensus.cc:2243] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.360272 15388 raft_consensus.cc:2272] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:24.360596 15642 raft_consensus.cc:670] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopped
I20251025 08:02:24.361550 14647 master_service.cc:954] ReplaceTablet: received request to replace tablet ff155cb1c7e44986bb999bb0177f8f75 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.361629 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f7aa0b88b284d52a6cca064a798aa54" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.361764 14978 raft_consensus.cc:2393] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:24.364141 15183 leader_election.cc:304] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:24.364459 15409 raft_consensus.cc:3060] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.365237 14647 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet ff155cb1c7e44986bb999bb0177f8f75
I20251025 08:02:24.365294 15409 raft_consensus.cc:2749] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.365485 14647 catalog_manager.cc:6719] ReplaceTablet: tablet ff155cb1c7e44986bb999bb0177f8f75 deleted and replaced by tablet 1ee00271d2354ae38dcb5a3289cea72f
I20251025 08:02:24.365953 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet ff155cb1c7e44986bb999bb0177f8f75 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ee00271d2354ae38dcb5a3289cea72f) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.366067 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet ff155cb1c7e44986bb999bb0177f8f75 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ee00271d2354ae38dcb5a3289cea72f) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.366233 15385 tablet_replica.cc:333] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.366351 15385 raft_consensus.cc:2243] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.366458 15385 raft_consensus.cc:2272] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.366559 15370 tablet_bootstrap.cc:492] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.366650 15370 ts_tablet_manager.cc:1403] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20251025 08:02:24.367120 15385 ts_tablet_manager.cc:1916] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.367106 15370 raft_consensus.cc:359] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.367195 15370 raft_consensus.cc:385] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.367241 15370 raft_consensus.cc:740] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.367353 15370 consensus_queue.cc:260] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.367592 15370 ts_tablet_manager.cc:1434] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.369498 15385 ts_tablet_manager.cc:1929] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.369606 15385 log.cc:1199] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/ff155cb1c7e44986bb999bb0177f8f75
I20251025 08:02:24.369906 15385 ts_tablet_manager.cc:1950] T ff155cb1c7e44986bb999bb0177f8f75 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.370275 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet ff155cb1c7e44986bb999bb0177f8f75 with delete_type TABLET_DATA_DELETED (replaced by tablet 1ee00271d2354ae38dcb5a3289cea72f) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.370642 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet ff155cb1c7e44986bb999bb0177f8f75 (table default.Table_eb789fed3e81408b8b688461884e9c5a [id=1ee33ee129d749d0bd7f26dc49fca0fe]) successfully deleted
I20251025 08:02:24.372016 15386 tablet_replica.cc:333] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.372197 15386 raft_consensus.cc:2243] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.372347 15386 raft_consensus.cc:2272] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.372705 15388 ts_tablet_manager.cc:1916] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.374203 14651 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet ccb533134db94f29a781095e7fb55e04
I20251025 08:02:24.374473 14651 catalog_manager.cc:6719] ReplaceTablet: tablet ccb533134db94f29a781095e7fb55e04 deleted and replaced by tablet 10ef8618965e438cbf6fafc0533c9bfc
I20251025 08:02:24.374611 15386 ts_tablet_manager.cc:1916] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.374783 15388 ts_tablet_manager.cc:1929] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.374814 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet ccb533134db94f29a781095e7fb55e04 with delete_type TABLET_DATA_DELETED (replaced by tablet 10ef8618965e438cbf6fafc0533c9bfc) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.375059 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet ccb533134db94f29a781095e7fb55e04 with delete_type TABLET_DATA_DELETED (replaced by tablet 10ef8618965e438cbf6fafc0533c9bfc) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.375193 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet ccb533134db94f29a781095e7fb55e04 with delete_type TABLET_DATA_DELETED (replaced by tablet 10ef8618965e438cbf6fafc0533c9bfc) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.375267 15385 tablet_replica.cc:333] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.375356 15385 raft_consensus.cc:2243] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.375485 15385 pending_rounds.cc:70] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:24.375509 15385 pending_rounds.cc:77] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609794397630464 op_type: NO_OP noop_request { }
I20251025 08:02:24.375547 15385 raft_consensus.cc:2889] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:24.375589 15385 raft_consensus.cc:2272] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.375617 15642 raft_consensus.cc:493] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.375689 15642 raft_consensus.cc:515] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.376024 15642 leader_election.cc:290] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.376289 15385 ts_tablet_manager.cc:1916] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.376435 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a0a2af3ed1f41fea41962db52cfe7d8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:24.376724 15048 leader_election.cc:343] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.376886 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a0a2af3ed1f41fea41962db52cfe7d8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:24.377336 15049 leader_election.cc:343] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.377422 15049 leader_election.cc:304] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.377496 14649 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet d8d2d5d7676f4b8096d10781cb0e5fce (table default.Table_cc4fb27276854f679d49c263e71b51bb [id=bb1d4aea5e9c4907a826f763e2c62707]). Expected version 1 got 0
I20251025 08:02:24.377617 15642 raft_consensus.cc:2749] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.377954 15385 ts_tablet_manager.cc:1929] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:24.378021 15385 log.cc:1199] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/ccb533134db94f29a781095e7fb55e04
I20251025 08:02:24.378288 15385 ts_tablet_manager.cc:1950] T ccb533134db94f29a781095e7fb55e04 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.378897 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet ccb533134db94f29a781095e7fb55e04 (table default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]) successfully deleted
I20251025 08:02:24.378872 14655 catalog_manager.cc:5649] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:24.379215 14655 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 44036e636edf42b89952e23dfc1a3d4c (table default.Table_6b8cc455bb574b30bdb9bca2ac803ae0 [id=6739c1319b784c8eb66fc75125f83056]). Expected version 1 got 0
I20251025 08:02:24.379336 14655 catalog_manager.cc:5649] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:24.381963 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 28d12c168eac49b8ba08e38d9880c798 with delete_type TABLET_DATA_DELETED (replaced by tablet 1127507b5fd54fe0b1a7e7edf936bc38) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.382073 15223 tablet_service.cc:1505] Processing CreateTablet for tablet fe4f4c8c26804aee8e45926f60b8da79 (DEFAULT_TABLE table=default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.382316 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe4f4c8c26804aee8e45926f60b8da79. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.382351 15386 ts_tablet_manager.cc:1929] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.382481 15386 log.cc:1199] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/ff155cb1c7e44986bb999bb0177f8f75
I20251025 08:02:24.382719 15386 ts_tablet_manager.cc:1950] T ff155cb1c7e44986bb999bb0177f8f75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.383225 14649 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_aba4e23ad41c4bce9e35f52388813868" } new_table_name: "default.Table_2c5d706ef36c4011901606e8ebc3bfa9" modify_external_catalogs: true
I20251025 08:02:24.383446 15386 tablet_replica.cc:333] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.383541 15386 raft_consensus.cc:2243] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.383622 15386 raft_consensus.cc:2272] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.383996 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet ff155cb1c7e44986bb999bb0177f8f75 (table default.Table_eb789fed3e81408b8b688461884e9c5a [id=1ee33ee129d749d0bd7f26dc49fca0fe]) successfully deleted
I20251025 08:02:24.374840 15388 log.cc:1199] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/d458ae384ebd4c33bfc74e7657772fa6
I20251025 08:02:24.384274 15388 ts_tablet_manager.cc:1950] T d458ae384ebd4c33bfc74e7657772fa6 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.384624 15369 tablet_bootstrap.cc:492] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.384703 15369 ts_tablet_manager.cc:1403] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.000s
I20251025 08:02:24.384797 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet d458ae384ebd4c33bfc74e7657772fa6 (table default.Table_40e75fd0e39f4ae69856bde4bfd62a45 [id=739dffe08d69409aa126a14a2c413ad5]) successfully deleted
I20251025 08:02:24.384888 15386 ts_tablet_manager.cc:1916] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.384974 15388 tablet_replica.cc:333] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.385090 15388 raft_consensus.cc:2243] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.385139 15369 raft_consensus.cc:359] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.385229 15369 raft_consensus.cc:385] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.385258 15369 raft_consensus.cc:740] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.385267 15388 raft_consensus.cc:2272] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.386416 14955 tablet_service.cc:1505] Processing CreateTablet for tablet fe4f4c8c26804aee8e45926f60b8da79 (DEFAULT_TABLE table=default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.386554 15093 tablet_service.cc:1505] Processing CreateTablet for tablet fe4f4c8c26804aee8e45926f60b8da79 (DEFAULT_TABLE table=default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.386619 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe4f4c8c26804aee8e45926f60b8da79. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.386734 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe4f4c8c26804aee8e45926f60b8da79. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.388348 15370 tablet_bootstrap.cc:492] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.388482 15223 tablet_service.cc:1505] Processing CreateTablet for tablet e2b014e0f49c4f7da8e65b7d4c98ea63 (DEFAULT_TABLE table=default.Table_e95c804d7eab4d979aa8b83cf41e6acc [id=7fe739c2f676459d8c73632266babedb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.388682 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2b014e0f49c4f7da8e65b7d4c98ea63. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.389156 15370 tablet_bootstrap.cc:654] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.389397 14647 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_d91ac83609a0452680e6ef9a726b5f31" } modify_external_catalogs: true
I20251025 08:02:24.389482 14647 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_d91ac83609a0452680e6ef9a726b5f31" } modify_external_catalogs: true
I20251025 08:02:24.390285 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 1695780ae4e24c288df851c2aff7e22c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.390321 14648 catalog_manager.cc:5649] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:24.390479 14648 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 44036e636edf42b89952e23dfc1a3d4c (table default.Table_6b8cc455bb574b30bdb9bca2ac803ae0 [id=6739c1319b784c8eb66fc75125f83056]). Expected version 1 got 0
I20251025 08:02:24.390524 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet ccb533134db94f29a781095e7fb55e04 with delete_type TABLET_DATA_DELETED (replaced by tablet 10ef8618965e438cbf6fafc0533c9bfc) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.390563 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 28d12c168eac49b8ba08e38d9880c798 with delete_type TABLET_DATA_DELETED (replaced by tablet 1127507b5fd54fe0b1a7e7edf936bc38) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.390604 14648 catalog_manager.cc:5649] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:24.390746 14648 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet d8d2d5d7676f4b8096d10781cb0e5fce (table default.Table_cc4fb27276854f679d49c263e71b51bb [id=bb1d4aea5e9c4907a826f763e2c62707]). Expected version 1 got 0
W20251025 08:02:24.390939 14640 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 1695780ae4e24c288df851c2aff7e22c because the tablet was not found. No further retry: Not found: Tablet not found: 1695780ae4e24c288df851c2aff7e22c
I20251025 08:02:24.391034 14655 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_daaba07bb09e480f8ac48910bfb55d24" } modify_external_catalogs: true
I20251025 08:02:24.391104 14655 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_daaba07bb09e480f8ac48910bfb55d24" } modify_external_catalogs: true
W20251025 08:02:24.391414 14640 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet ccb533134db94f29a781095e7fb55e04 because the tablet was not found. No further retry: Not found: Tablet not found: ccb533134db94f29a781095e7fb55e04
W20251025 08:02:24.391549 14640 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 28d12c168eac49b8ba08e38d9880c798 because the tablet was not found. No further retry: Not found: Tablet not found: 28d12c168eac49b8ba08e38d9880c798
W20251025 08:02:24.393221 14649 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed713c293e7f4b99a5d56f064db4b7b6 consensus state has no leader
I20251025 08:02:24.396986 14647 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 7807e7f1d49c4eda8ab4fa123d0398ac
I20251025 08:02:24.397506 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 7807e7f1d49c4eda8ab4fa123d0398ac with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.397814 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 7807e7f1d49c4eda8ab4fa123d0398ac with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:24.397890 14640 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 7807e7f1d49c4eda8ab4fa123d0398ac because the tablet was not found. No further retry: Not found: Tablet not found: 7807e7f1d49c4eda8ab4fa123d0398ac
I20251025 08:02:24.397920 15409 raft_consensus.cc:493] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.397981 15409 raft_consensus.cc:515] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.398303 15388 ts_tablet_manager.cc:1916] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.398367 15409 leader_election.cc:290] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.398535 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 7807e7f1d49c4eda8ab4fa123d0398ac with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.398550 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9d37ec643294d4fb8a715596f078599" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.398628 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b9d37ec643294d4fb8a715596f078599" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:24.398663 14978 raft_consensus.cc:2393] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:24.398924 15185 leader_election.cc:304] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:24.399077 15409 raft_consensus.cc:3060] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.399866 15409 raft_consensus.cc:2749] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.399847 14955 tablet_service.cc:1505] Processing CreateTablet for tablet e2b014e0f49c4f7da8e65b7d4c98ea63 (DEFAULT_TABLE table=default.Table_e95c804d7eab4d979aa8b83cf41e6acc [id=7fe739c2f676459d8c73632266babedb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.400082 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2b014e0f49c4f7da8e65b7d4c98ea63. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.400264 15093 tablet_service.cc:1505] Processing CreateTablet for tablet e2b014e0f49c4f7da8e65b7d4c98ea63 (DEFAULT_TABLE table=default.Table_e95c804d7eab4d979aa8b83cf41e6acc [id=7fe739c2f676459d8c73632266babedb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.400506 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 54ea861dbc8c46129df50fc5060739b3 (DEFAULT_TABLE table=default.Table_9a3a6f5c45104e33a5a455d911ce8927 [id=15a38bbafe4045e9991cb846ec9e452c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.400588 15369 consensus_queue.cc:260] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.401039 15369 ts_tablet_manager.cc:1434] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.016s user 0.001s sys 0.000s
I20251025 08:02:24.401319 15369 tablet_bootstrap.cc:492] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.401526 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 54ea861dbc8c46129df50fc5060739b3 (DEFAULT_TABLE table=default.Table_9a3a6f5c45104e33a5a455d911ce8927 [id=15a38bbafe4045e9991cb846ec9e452c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.401729 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 7807e7f1d49c4eda8ab4fa123d0398ac (DEFAULT_TABLE table=default.Table_d91ac83609a0452680e6ef9a726b5f31 [id=d1011dde28dd4c37975ae35fba06bc01]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.401898 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ea861dbc8c46129df50fc5060739b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.403450 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2b014e0f49c4f7da8e65b7d4c98ea63. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.403506 15388 ts_tablet_manager.cc:1929] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.403550 15388 log.cc:1199] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/ff155cb1c7e44986bb999bb0177f8f75
I20251025 08:02:24.403770 15388 ts_tablet_manager.cc:1950] T ff155cb1c7e44986bb999bb0177f8f75 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.403821 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ea861dbc8c46129df50fc5060739b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.404368 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet ff155cb1c7e44986bb999bb0177f8f75 (table default.Table_eb789fed3e81408b8b688461884e9c5a [id=1ee33ee129d749d0bd7f26dc49fca0fe]) successfully deleted
I20251025 08:02:24.405668 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7807e7f1d49c4eda8ab4fa123d0398ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.406230 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 7807e7f1d49c4eda8ab4fa123d0398ac (DEFAULT_TABLE table=default.Table_d91ac83609a0452680e6ef9a726b5f31 [id=d1011dde28dd4c37975ae35fba06bc01]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.406419 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7807e7f1d49c4eda8ab4fa123d0398ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.407538 14655 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 1f7a26c306f748aea3ccd888b95ebc67
I20251025 08:02:24.408233 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 1f7a26c306f748aea3ccd888b95ebc67 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.408371 15385 tablet_replica.cc:333] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.408501 15385 raft_consensus.cc:2243] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.408571 14646 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 44036e636edf42b89952e23dfc1a3d4c (table default.Table_6b8cc455bb574b30bdb9bca2ac803ae0 [id=6739c1319b784c8eb66fc75125f83056]). Expected version 1 got 0
I20251025 08:02:24.408651 15385 raft_consensus.cc:2272] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.409126 15385 ts_tablet_manager.cc:1916] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.409483 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 81e7695e1a0d47c881f2851d97ada61b (DEFAULT_TABLE table=default.Table_88cacd70c6c14947b18a8d94bc761229 [id=dfe9146b50254c54ad1b75080a2ee201]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.409658 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e7695e1a0d47c881f2851d97ada61b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.410058 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 7807e7f1d49c4eda8ab4fa123d0398ac (DEFAULT_TABLE table=default.Table_d91ac83609a0452680e6ef9a726b5f31 [id=d1011dde28dd4c37975ae35fba06bc01]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.410316 14647 master_service.cc:954] ReplaceTablet: received request to replace tablet 2757cfa1345c4085b232e93ec32c8188 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.410342 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 81e7695e1a0d47c881f2851d97ada61b (DEFAULT_TABLE table=default.Table_88cacd70c6c14947b18a8d94bc761229 [id=dfe9146b50254c54ad1b75080a2ee201]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.410629 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7807e7f1d49c4eda8ab4fa123d0398ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.410709 15385 ts_tablet_manager.cc:1929] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:24.410763 15385 log.cc:1199] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/1f7a26c306f748aea3ccd888b95ebc67
I20251025 08:02:24.405272 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 54ea861dbc8c46129df50fc5060739b3 (DEFAULT_TABLE table=default.Table_9a3a6f5c45104e33a5a455d911ce8927 [id=15a38bbafe4045e9991cb846ec9e452c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.410996 15385 ts_tablet_manager.cc:1950] T 1f7a26c306f748aea3ccd888b95ebc67 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.411017 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ea861dbc8c46129df50fc5060739b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.411334 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet db9202bf6e6041f28b3173580db9ad7d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.411607 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 1f7a26c306f748aea3ccd888b95ebc67 (table default.Table_daaba07bb09e480f8ac48910bfb55d24 [id=7e4c09fa093f415c99aed131b156bd2c]) successfully deleted
I20251025 08:02:24.411859 15369 tablet_bootstrap.cc:654] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.412549 15372 tablet_bootstrap.cc:492] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.412621 15372 ts_tablet_manager.cc:1403] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.071s user 0.002s sys 0.000s
I20251025 08:02:24.413060 15386 ts_tablet_manager.cc:1929] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.413465 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e7695e1a0d47c881f2851d97ada61b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.415158 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 1f7a26c306f748aea3ccd888b95ebc67 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.416411 15388 tablet_replica.cc:333] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.416517 15388 raft_consensus.cc:2243] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.416518 14651 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 44036e636edf42b89952e23dfc1a3d4c (table default.Table_6b8cc455bb574b30bdb9bca2ac803ae0 [id=6739c1319b784c8eb66fc75125f83056]). Expected version 1 got 0
I20251025 08:02:24.416599 15388 raft_consensus.cc:2272] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.413091 15372 raft_consensus.cc:359] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.417099 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 1f7a26c306f748aea3ccd888b95ebc67 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.417308 15372 raft_consensus.cc:385] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.417186 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 81e7695e1a0d47c881f2851d97ada61b (DEFAULT_TABLE table=default.Table_88cacd70c6c14947b18a8d94bc761229 [id=dfe9146b50254c54ad1b75080a2ee201]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.417349 15372 raft_consensus.cc:740] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.417498 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81e7695e1a0d47c881f2851d97ada61b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.417466 15372 consensus_queue.cc:260] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.417555 15386 log.cc:1199] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/ccb533134db94f29a781095e7fb55e04
I20251025 08:02:24.417706 15372 ts_tablet_manager.cc:1434] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:24.417737 15386 ts_tablet_manager.cc:1950] T ccb533134db94f29a781095e7fb55e04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.417863 15372 tablet_bootstrap.cc:492] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.418391 15386 tablet_replica.cc:333] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.418490 15386 raft_consensus.cc:2243] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.418603 15386 raft_consensus.cc:2272] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.419055 15409 raft_consensus.cc:493] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.419123 15409 raft_consensus.cc:515] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.419180 15386 ts_tablet_manager.cc:1916] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.419417 15409 leader_election.cc:290] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.419739 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d8d2d5d7676f4b8096d10781cb0e5fce" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:24.419919 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet ccb533134db94f29a781095e7fb55e04 (table default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]) successfully deleted
W20251025 08:02:24.420044 14641 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 28d12c168eac49b8ba08e38d9880c798 because the tablet was not found. No further retry: Not found: Tablet not found: 28d12c168eac49b8ba08e38d9880c798
I20251025 08:02:24.419739 15370 tablet_bootstrap.cc:492] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.420145 15370 ts_tablet_manager.cc:1403] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.001s
W20251025 08:02:24.420154 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 7807e7f1d49c4eda8ab4fa123d0398ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7807e7f1d49c4eda8ab4fa123d0398ac already in progress: creating tablet
I20251025 08:02:24.420557 15370 raft_consensus.cc:359] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.420571 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d8d2d5d7676f4b8096d10781cb0e5fce" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.420641 15370 raft_consensus.cc:385] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.420671 15370 raft_consensus.cc:740] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.420686 14978 raft_consensus.cc:2393] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:24.420720 15388 ts_tablet_manager.cc:1916] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.420792 15370 consensus_queue.cc:260] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.421020 15370 ts_tablet_manager.cc:1434] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:24.421152 15370 tablet_bootstrap.cc:492] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.422003 15370 tablet_bootstrap.cc:654] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.422359 15388 ts_tablet_manager.cc:1929] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.422408 15388 log.cc:1199] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/ccb533134db94f29a781095e7fb55e04
I20251025 08:02:24.422577 15388 ts_tablet_manager.cc:1950] T ccb533134db94f29a781095e7fb55e04 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.423035 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet ccb533134db94f29a781095e7fb55e04 (table default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]) successfully deleted
I20251025 08:02:24.423283 15183 leader_election.cc:304] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:24.423452 15409 raft_consensus.cc:3060] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.424232 15409 raft_consensus.cc:2749] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.424865 15369 tablet_bootstrap.cc:492] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.424924 15369 ts_tablet_manager.cc:1403] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20251025 08:02:24.425244 15372 tablet_bootstrap.cc:654] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.425238 15369 raft_consensus.cc:359] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.425302 15369 raft_consensus.cc:385] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.425323 15369 raft_consensus.cc:740] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.425400 15369 consensus_queue.cc:260] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.426385 15369 ts_tablet_manager.cc:1434] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.426523 15369 tablet_bootstrap.cc:492] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:24.426832 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 7807e7f1d49c4eda8ab4fa123d0398ac because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7807e7f1d49c4eda8ab4fa123d0398ac already in progress: creating tablet
I20251025 08:02:24.428278 15369 tablet_bootstrap.cc:654] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.428444 15388 tablet_replica.cc:333] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.428548 15388 raft_consensus.cc:2243] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.428629 15388 raft_consensus.cc:2272] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.429824 15388 ts_tablet_manager.cc:1916] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.430094 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 0fa8e1e7a015466699c3b98dd0647cce (DEFAULT_TABLE table=default.Table_40e75fd0e39f4ae69856bde4bfd62a45 [id=739dffe08d69409aa126a14a2c413ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.430371 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa8e1e7a015466699c3b98dd0647cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.430419 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 0fa8e1e7a015466699c3b98dd0647cce (DEFAULT_TABLE table=default.Table_40e75fd0e39f4ae69856bde4bfd62a45 [id=739dffe08d69409aa126a14a2c413ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.430642 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa8e1e7a015466699c3b98dd0647cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.430656 15386 ts_tablet_manager.cc:1929] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:24.430714 15386 log.cc:1199] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/1f7a26c306f748aea3ccd888b95ebc67
I20251025 08:02:24.430943 15386 ts_tablet_manager.cc:1950] T 1f7a26c306f748aea3ccd888b95ebc67 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.431794 15388 ts_tablet_manager.cc:1929] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.431849 15388 log.cc:1199] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/db9202bf6e6041f28b3173580db9ad7d
I20251025 08:02:24.432008 15388 ts_tablet_manager.cc:1950] T db9202bf6e6041f28b3173580db9ad7d P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.432031 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 1f7a26c306f748aea3ccd888b95ebc67 (table default.Table_daaba07bb09e480f8ac48910bfb55d24 [id=7e4c09fa093f415c99aed131b156bd2c]) successfully deleted
I20251025 08:02:24.432430 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet db9202bf6e6041f28b3173580db9ad7d (table default.Table_2d86a1e7ec904a128454ea0cf0839ed6 [id=f5c6646ac8924dd18f06bd714d116aa7]) successfully deleted
I20251025 08:02:24.434119 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 0fa8e1e7a015466699c3b98dd0647cce (DEFAULT_TABLE table=default.Table_40e75fd0e39f4ae69856bde4bfd62a45 [id=739dffe08d69409aa126a14a2c413ad5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.434233 14647 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 2757cfa1345c4085b232e93ec32c8188
I20251025 08:02:24.434345 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa8e1e7a015466699c3b98dd0647cce. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.434767 14647 catalog_manager.cc:6719] ReplaceTablet: tablet 2757cfa1345c4085b232e93ec32c8188 deleted and replaced by tablet 35eb28e4cabf4e59b8245fa3adc57872
I20251025 08:02:24.435580 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 2757cfa1345c4085b232e93ec32c8188 with delete_type TABLET_DATA_DELETED (replaced by tablet 35eb28e4cabf4e59b8245fa3adc57872) from {username='slave'} at 127.0.0.1:37198
W20251025 08:02:24.436039 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 2757cfa1345c4085b232e93ec32c8188 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2757cfa1345c4085b232e93ec32c8188 already in progress: creating tablet
I20251025 08:02:24.436201 14646 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_8b233422b57e405daba765b7619adfad [id=a5a019b836864161a3da06f611e4272e] alter complete (version 1)
I20251025 08:02:24.436373 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 2757cfa1345c4085b232e93ec32c8188 with delete_type TABLET_DATA_DELETED (replaced by tablet 35eb28e4cabf4e59b8245fa3adc57872) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.436390 15370 tablet_bootstrap.cc:492] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.436487 15370 ts_tablet_manager.cc:1403] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20251025 08:02:24.436905 15370 raft_consensus.cc:359] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.436996 15370 raft_consensus.cc:385] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.437028 15370 raft_consensus.cc:740] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.437141 15370 consensus_queue.cc:260] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.437325 15388 tablet_replica.cc:333] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.437389 15370 ts_tablet_manager.cc:1434] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.437418 15388 raft_consensus.cc:2243] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.437495 15388 raft_consensus.cc:2272] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.437528 15370 tablet_bootstrap.cc:492] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.438577 15388 ts_tablet_manager.cc:1916] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.438660 15370 tablet_bootstrap.cc:654] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.439281 15369 tablet_bootstrap.cc:492] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.439355 15369 ts_tablet_manager.cc:1403] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20251025 08:02:24.439337 14648 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet fe4f4c8c26804aee8e45926f60b8da79 (table default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]). Expected version 1 got 0
I20251025 08:02:24.439728 15369 raft_consensus.cc:359] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.439805 15369 raft_consensus.cc:385] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.439829 15369 raft_consensus.cc:740] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.439971 15369 consensus_queue.cc:260] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.440176 15388 ts_tablet_manager.cc:1929] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:24.440227 15388 log.cc:1199] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/1f7a26c306f748aea3ccd888b95ebc67
I20251025 08:02:24.440440 15388 ts_tablet_manager.cc:1950] T 1f7a26c306f748aea3ccd888b95ebc67 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.440840 15388 tablet_replica.cc:333] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.440940 15388 raft_consensus.cc:2243] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.441025 15388 raft_consensus.cc:2272] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.441167 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 1f7a26c306f748aea3ccd888b95ebc67 (table default.Table_daaba07bb09e480f8ac48910bfb55d24 [id=7e4c09fa093f415c99aed131b156bd2c]) successfully deleted
I20251025 08:02:24.441282 15369 ts_tablet_manager.cc:1434] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:24.441434 15369 tablet_bootstrap.cc:492] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.443145 15369 tablet_bootstrap.cc:654] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.443449 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet d458ae384ebd4c33bfc74e7657772fa6 with delete_type TABLET_DATA_DELETED (replaced by tablet 0fa8e1e7a015466699c3b98dd0647cce) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.443608 15385 tablet_replica.cc:333] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.443701 15385 raft_consensus.cc:2243] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.443784 15385 raft_consensus.cc:2272] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.444190 15385 ts_tablet_manager.cc:1916] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.445789 15385 ts_tablet_manager.cc:1929] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.445845 15385 log.cc:1199] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/d458ae384ebd4c33bfc74e7657772fa6
I20251025 08:02:24.446033 15385 ts_tablet_manager.cc:1950] T d458ae384ebd4c33bfc74e7657772fa6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.446300 14646 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 2a0a2af3ed1f41fea41962db52cfe7d8 (table default.Table_30272613d7184fb1b153ca55ed9df9e8 [id=1e1120fd790b44569595d67fea5165c2]). Expected version 1 got 0
I20251025 08:02:24.446568 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet d458ae384ebd4c33bfc74e7657772fa6 (table default.Table_40e75fd0e39f4ae69856bde4bfd62a45 [id=739dffe08d69409aa126a14a2c413ad5]) successfully deleted
I20251025 08:02:24.446919 15409 raft_consensus.cc:493] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.446995 15409 raft_consensus.cc:515] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.447037 15372 tablet_bootstrap.cc:492] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.447095 15372 ts_tablet_manager.cc:1403] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20251025 08:02:24.447381 15409 leader_election.cc:290] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.447425 15372 raft_consensus.cc:359] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.447501 15372 raft_consensus.cc:385] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251025 08:02:24.447780 15185 leader_election.cc:343] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 1695780ae4e24c288df851c2aff7e22c
I20251025 08:02:24.447523 15372 raft_consensus.cc:740] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.447904 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 954530e1c7204e1c9d9ded2460a823be with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.447917 15372 consensus_queue.cc:260] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.448045 15385 tablet_replica.cc:333] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.448134 15372 ts_tablet_manager.cc:1434] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.448140 15385 raft_consensus.cc:2243] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.448218 15385 raft_consensus.cc:2272] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.448688 15372 tablet_bootstrap.cc:492] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.449925 15372 tablet_bootstrap.cc:654] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.450663 15385 ts_tablet_manager.cc:1916] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.450985 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet ccb533134db94f29a781095e7fb55e04 with delete_type TABLET_DATA_DELETED (replaced by tablet 10ef8618965e438cbf6fafc0533c9bfc) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.451032 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet 1695780ae4e24c288df851c2aff7e22c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.451458 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 2757cfa1345c4085b232e93ec32c8188 with delete_type TABLET_DATA_DELETED (replaced by tablet 35eb28e4cabf4e59b8245fa3adc57872) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.451577 15386 tablet_replica.cc:333] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.451673 15386 raft_consensus.cc:2243] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.451736 15370 tablet_bootstrap.cc:492] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.451749 15386 raft_consensus.cc:2272] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.451805 15370 ts_tablet_manager.cc:1403] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20251025 08:02:24.452260 15386 ts_tablet_manager.cc:1916] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.452234 15370 raft_consensus.cc:359] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.452324 15370 raft_consensus.cc:385] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.452353 15370 raft_consensus.cc:740] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.452383 15385 ts_tablet_manager.cc:1929] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.452435 15385 log.cc:1199] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/954530e1c7204e1c9d9ded2460a823be
I20251025 08:02:24.452458 15370 consensus_queue.cc:260] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.452596 15385 ts_tablet_manager.cc:1950] T 954530e1c7204e1c9d9ded2460a823be P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.452689 15370 ts_tablet_manager.cc:1434] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.452842 15370 tablet_bootstrap.cc:492] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.454001 15386 ts_tablet_manager.cc:1929] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.454063 15386 log.cc:1199] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/1695780ae4e24c288df851c2aff7e22c
I20251025 08:02:24.454293 15386 ts_tablet_manager.cc:1950] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.454566 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 954530e1c7204e1c9d9ded2460a823be (table default.Table_4960c3071f8247149c201f2d6c65090f [id=667f1e14021446d3bf165c34f9f0567d]) successfully deleted
I20251025 08:02:24.454689 15370 tablet_bootstrap.cc:654] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.457156 15370 tablet_bootstrap.cc:492] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.457229 15370 ts_tablet_manager.cc:1403] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:24.457603 15370 raft_consensus.cc:359] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.457693 15370 raft_consensus.cc:385] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.457732 15370 raft_consensus.cc:740] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.457829 15370 consensus_queue.cc:260] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.458069 15370 ts_tablet_manager.cc:1434] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.459621 15370 tablet_bootstrap.cc:492] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.460427 15370 tablet_bootstrap.cc:654] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.460741 15372 tablet_bootstrap.cc:492] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.460801 15372 ts_tablet_manager.cc:1403] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20251025 08:02:24.461268 15370 tablet_bootstrap.cc:492] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.461241 15372 raft_consensus.cc:359] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.461314 15372 raft_consensus.cc:385] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.461326 15370 ts_tablet_manager.cc:1403] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:24.461339 15372 raft_consensus.cc:740] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.461427 15372 consensus_queue.cc:260] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.461618 15372 ts_tablet_manager.cc:1434] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:24.461668 15370 raft_consensus.cc:359] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.461740 15370 raft_consensus.cc:385] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.461743 15372 tablet_bootstrap.cc:492] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.461767 15370 raft_consensus.cc:740] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.461854 15370 consensus_queue.cc:260] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.462067 15370 ts_tablet_manager.cc:1434] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.462227 15370 tablet_bootstrap.cc:492] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.462572 15372 tablet_bootstrap.cc:654] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.463186 15370 tablet_bootstrap.cc:654] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.463836 15667 mvcc.cc:204] Tried to move back new op lower bound from 7214609793507110912 to 7214609789501599744. Current Snapshot: MvccSnapshot[applied={T|T < 7214609793507110912 or (T in {7214609793507110912})}]
I20251025 08:02:24.464797 15369 tablet_bootstrap.cc:492] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.464861 15369 ts_tablet_manager.cc:1403] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.000s
I20251025 08:02:24.465265 15369 raft_consensus.cc:359] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.465353 15369 raft_consensus.cc:385] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.465384 15369 raft_consensus.cc:740] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.465483 15369 consensus_queue.cc:260] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.465715 15369 ts_tablet_manager.cc:1434] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.465878 15369 tablet_bootstrap.cc:492] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.466725 15369 tablet_bootstrap.cc:654] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.467489 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet db9202bf6e6041f28b3173580db9ad7d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.467628 15385 tablet_replica.cc:333] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.467717 15385 raft_consensus.cc:2243] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.468582 15385 raft_consensus.cc:2272] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.469134 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 7807e7f1d49c4eda8ab4fa123d0398ac with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.469205 15385 ts_tablet_manager.cc:1916] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.470806 15385 ts_tablet_manager.cc:1929] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.470856 15385 log.cc:1199] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/db9202bf6e6041f28b3173580db9ad7d
I20251025 08:02:24.470877 15370 tablet_bootstrap.cc:492] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.470942 15370 ts_tablet_manager.cc:1403] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:24.471025 15385 ts_tablet_manager.cc:1950] T db9202bf6e6041f28b3173580db9ad7d P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.471347 15370 raft_consensus.cc:359] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.471428 15370 raft_consensus.cc:385] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.471457 15370 raft_consensus.cc:740] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.471513 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet db9202bf6e6041f28b3173580db9ad7d (table default.Table_2d86a1e7ec904a128454ea0cf0839ed6 [id=f5c6646ac8924dd18f06bd714d116aa7]) successfully deleted
I20251025 08:02:24.471551 15370 consensus_queue.cc:260] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.471781 15370 ts_tablet_manager.cc:1434] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.474020 15369 tablet_bootstrap.cc:492] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.474093 15369 ts_tablet_manager.cc:1403] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251025 08:02:24.474128 14647 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_2c5d706ef36c4011901606e8ebc3bfa9" } modify_external_catalogs: true
I20251025 08:02:24.474270 14647 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_2c5d706ef36c4011901606e8ebc3bfa9" } modify_external_catalogs: true
I20251025 08:02:24.474467 15369 raft_consensus.cc:359] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.474552 15369 raft_consensus.cc:385] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.474586 15369 raft_consensus.cc:740] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.474685 15369 consensus_queue.cc:260] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.474913 15369 ts_tablet_manager.cc:1434] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.475068 15369 tablet_bootstrap.cc:492] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.475718 15369 tablet_bootstrap.cc:654] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.475981 14655 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_742a7811d8054888be95298c1febef0d" } modify_external_catalogs: true
I20251025 08:02:24.476066 14655 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_742a7811d8054888be95298c1febef0d" } modify_external_catalogs: true
I20251025 08:02:24.477172 14652 master_service.cc:954] ReplaceTablet: received request to replace tablet 3545cf3efbef403aa897a8ddd7896c6f from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.477593 15372 tablet_bootstrap.cc:492] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.477669 15372 ts_tablet_manager.cc:1403] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.001s
I20251025 08:02:24.478068 15372 raft_consensus.cc:359] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.478168 15372 raft_consensus.cc:385] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.478219 15372 raft_consensus.cc:740] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.478327 15372 consensus_queue.cc:260] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.478585 15372 ts_tablet_manager.cc:1434] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.478645 15369 tablet_bootstrap.cc:492] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.478719 15369 ts_tablet_manager.cc:1403] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:24.478746 15372 tablet_bootstrap.cc:492] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.479115 15369 raft_consensus.cc:359] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.479197 15369 raft_consensus.cc:385] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.479154 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_d6e61e9e78464c9096cbb26d6eb98c2e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.479238 15369 raft_consensus.cc:740] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.479332 15369 consensus_queue.cc:260] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.479552 15369 ts_tablet_manager.cc:1434] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20251025 08:02:24.479575 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d6e61e9e78464c9096cbb26d6eb98c2e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.479619 15372 tablet_bootstrap.cc:654] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.479693 15369 tablet_bootstrap.cc:492] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.480545 15369 tablet_bootstrap.cc:654] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.482601 14649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_09620cf7ff864ac09cbad24b3ad7b5f7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.482913 14649 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_09620cf7ff864ac09cbad24b3ad7b5f7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.482966 14654 master_service.cc:954] ReplaceTablet: received request to replace tablet 44036e636edf42b89952e23dfc1a3d4c from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.483901 15369 tablet_bootstrap.cc:492] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.483979 15369 ts_tablet_manager.cc:1403] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:24.485347 15369 raft_consensus.cc:359] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.485435 15369 raft_consensus.cc:385] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.485467 15369 raft_consensus.cc:740] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.485594 15369 consensus_queue.cc:260] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.486369 15369 ts_tablet_manager.cc:1434] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:24.486753 15372 tablet_bootstrap.cc:492] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.486824 15372 ts_tablet_manager.cc:1403] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20251025 08:02:24.487274 15372 raft_consensus.cc:359] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.487372 15372 raft_consensus.cc:385] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.487409 15372 raft_consensus.cc:740] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.487514 15372 consensus_queue.cc:260] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.487757 15372 ts_tablet_manager.cc:1434] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.487917 15372 tablet_bootstrap.cc:492] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.488554 14651 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_0f289526bf514ddc90a5622136145bff" } modify_external_catalogs: true
I20251025 08:02:24.488644 14651 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_0f289526bf514ddc90a5622136145bff" } modify_external_catalogs: true
I20251025 08:02:24.488781 15372 tablet_bootstrap.cc:654] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.490271 15369 tablet_bootstrap.cc:492] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.491158 15369 tablet_bootstrap.cc:654] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.491336 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet d9067b563519468ca71ebfcc738462b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.491483 15385 tablet_replica.cc:333] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.491581 15385 raft_consensus.cc:2243] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.491663 15385 raft_consensus.cc:2272] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.492084 15385 ts_tablet_manager.cc:1916] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.493971 15385 ts_tablet_manager.cc:1929] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.494024 15385 log.cc:1199] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/d9067b563519468ca71ebfcc738462b9
I20251025 08:02:24.494221 15385 ts_tablet_manager.cc:1950] T d9067b563519468ca71ebfcc738462b9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.494809 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet d9067b563519468ca71ebfcc738462b9 (table default.Table_4a5a1f334fef444b959ee1c82ed0d5a0 [id=33c97f69fa104ce1bff69626847a5b68]) successfully deleted
W20251025 08:02:24.494833 15183 leader_election.cc:343] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 1695780ae4e24c288df851c2aff7e22c
I20251025 08:02:24.494923 15183 leader_election.cc:304] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
W20251025 08:02:24.495012 15183 raft_consensus.cc:2686] T 1695780ae4e24c288df851c2aff7e22c P f0f2f8ce3e9f4d9ba3f3f02813397c31: unable to run election callback: Service unavailable: Thread pool token was shut down
W20251025 08:02:24.495350 14641 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet ccb533134db94f29a781095e7fb55e04 because the tablet was not found. No further retry: Not found: Tablet not found: ccb533134db94f29a781095e7fb55e04
I20251025 08:02:24.495635 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 1695780ae4e24c288df851c2aff7e22c (table default.Table_c11d0b545be3442685df355dba9a8f12 [id=9f02c9df85ba446cbe85aa321eb93c2d]) successfully deleted
W20251025 08:02:24.495863 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 2757cfa1345c4085b232e93ec32c8188 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2757cfa1345c4085b232e93ec32c8188 already in progress: creating tablet
I20251025 08:02:24.496425 15642 consensus_queue.cc:1048] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.497479 15372 tablet_bootstrap.cc:492] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.497560 15372 ts_tablet_manager.cc:1403] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.001s
I20251025 08:02:24.498003 15372 raft_consensus.cc:359] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.498088 15372 raft_consensus.cc:385] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.498116 15372 raft_consensus.cc:740] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.498226 15372 consensus_queue.cc:260] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.498462 15372 ts_tablet_manager.cc:1434] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.498589 15372 tablet_bootstrap.cc:492] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.499413 15372 tablet_bootstrap.cc:654] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.500363 15372 tablet_bootstrap.cc:492] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.500420 15372 ts_tablet_manager.cc:1403] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:24.500782 15372 raft_consensus.cc:359] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.500852 15372 raft_consensus.cc:385] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.500895 15372 raft_consensus.cc:740] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.500999 15372 consensus_queue.cc:260] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.501200 15372 ts_tablet_manager.cc:1434] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.501325 15372 tablet_bootstrap.cc:492] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.502544 15372 tablet_bootstrap.cc:654] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.503014 14653 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_beb1f6ec236e4f3b96df6b5201581c79" } new_table_name: "default.Table_ab1d4169df5a4c438c761aaabe15488e" modify_external_catalogs: true
I20251025 08:02:24.503607 14648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_cd66db813b934963acab38c81d9fd793"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.503937 14648 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd66db813b934963acab38c81d9fd793 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.509742 14647 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet ed713c293e7f4b99a5d56f064db4b7b6
I20251025 08:02:24.512105 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet ed713c293e7f4b99a5d56f064db4b7b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.512332 15247 raft_consensus.cc:1275] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.512358 14978 raft_consensus.cc:1275] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.512729 15642 consensus_queue.cc:1048] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:24.512794 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet ed713c293e7f4b99a5d56f064db4b7b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed713c293e7f4b99a5d56f064db4b7b6 already in progress: creating tablet
I20251025 08:02:24.514503 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet ed713c293e7f4b99a5d56f064db4b7b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.514721 15372 tablet_bootstrap.cc:492] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.514806 15372 ts_tablet_manager.cc:1403] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20251025 08:02:24.514899 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 5022f9beb59449828f59dca9d14caa50 (DEFAULT_TABLE table=default.Table_3e2c7c94e9d94339863b1848f4d0bb6c [id=ce6a220ddfc540dbb17e28bc74b66449]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.515161 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5022f9beb59449828f59dca9d14caa50. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.515225 15372 raft_consensus.cc:359] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.515337 15372 raft_consensus.cc:385] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.515377 15372 raft_consensus.cc:740] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.515478 15372 consensus_queue.cc:260] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.515719 15372 ts_tablet_manager.cc:1434] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:24.515779 14979 raft_consensus.cc:1275] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.515897 15372 tablet_bootstrap.cc:492] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.516470 15642 consensus_queue.cc:1048] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.516736 15372 tablet_bootstrap.cc:654] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.518059 15642 raft_consensus.cc:493] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.518144 15642 raft_consensus.cc:515] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.518523 15642 leader_election.cc:290] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:24.518777 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fa8e1e7a015466699c3b98dd0647cce" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:24.519121 15048 leader_election.cc:343] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.520985 15388 ts_tablet_manager.cc:1916] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.523247 15388 ts_tablet_manager.cc:1929] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.523324 15388 log.cc:1199] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/2757cfa1345c4085b232e93ec32c8188
I20251025 08:02:24.523526 15388 ts_tablet_manager.cc:1950] T 2757cfa1345c4085b232e93ec32c8188 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.523940 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0fa8e1e7a015466699c3b98dd0647cce" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.524047 15388 tablet_replica.cc:333] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.524179 15388 raft_consensus.cc:2243] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.524286 15388 raft_consensus.cc:2272] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.524600 15247 raft_consensus.cc:3060] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.525377 15247 raft_consensus.cc:1275] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.525604 15642 raft_consensus.cc:493] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251025 08:02:24.525677 15049 leader_election.cc:343] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.525750 15049 leader_election.cc:304] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.525686 15380 consensus_queue.cc:1048] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.525676 15642 raft_consensus.cc:515] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.525983 15380 raft_consensus.cc:2749] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.526058 15380 consensus_queue.cc:1048] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.526095 15642 leader_election.cc:290] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.526361 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 2757cfa1345c4085b232e93ec32c8188 (table default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]) successfully deleted
I20251025 08:02:24.526594 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe4f4c8c26804aee8e45926f60b8da79" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.526654 15388 ts_tablet_manager.cc:1916] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.526810 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe4f4c8c26804aee8e45926f60b8da79" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:24.527135 15048 leader_election.cc:343] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:24.527868 15049 leader_election.cc:343] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.527936 15049 leader_election.cc:304] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.528112 15380 raft_consensus.cc:2749] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.529784 15388 ts_tablet_manager.cc:1929] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.529850 15388 log.cc:1199] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/7807e7f1d49c4eda8ab4fa123d0398ac
I20251025 08:02:24.529850 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 5022f9beb59449828f59dca9d14caa50 (DEFAULT_TABLE table=default.Table_3e2c7c94e9d94339863b1848f4d0bb6c [id=ce6a220ddfc540dbb17e28bc74b66449]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.530069 15388 ts_tablet_manager.cc:1950] T 7807e7f1d49c4eda8ab4fa123d0398ac P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.530109 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5022f9beb59449828f59dca9d14caa50. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.530644 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 7807e7f1d49c4eda8ab4fa123d0398ac (table default.Table_d91ac83609a0452680e6ef9a726b5f31 [id=d1011dde28dd4c37975ae35fba06bc01]) successfully deleted
I20251025 08:02:24.530908 15388 tablet_replica.cc:333] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.531046 15388 raft_consensus.cc:2243] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.531133 15388 raft_consensus.cc:2272] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.531652 15436 tablet.cc:1722] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.533412 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 1127507b5fd54fe0b1a7e7edf936bc38 (DEFAULT_TABLE table=default.Table_cccb10034b9549bc84a9019610866553 [id=3a6fcff5488b4ee698661c7e51f754ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.533619 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1127507b5fd54fe0b1a7e7edf936bc38. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.533737 15437 tablet.cc:1722] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.536324 15376 raft_consensus.cc:493] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.536401 15376 raft_consensus.cc:515] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.536754 15376 leader_election.cc:290] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.537348 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3545cf3efbef403aa897a8ddd7896c6f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.537458 14977 raft_consensus.cc:2468] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:24.537711 15048 leader_election.cc:304] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:24.537850 15376 raft_consensus.cc:2804] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.537894 15376 raft_consensus.cc:493] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.537928 15376 raft_consensus.cc:3060] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.538771 15376 raft_consensus.cc:515] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.539089 15376 leader_election.cc:290] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.539382 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 5a70808199034508833e4d2e5550b29b (DEFAULT_TABLE table=default.Table_49352274aacf479292f43c128367eeb0 [id=a788bc4f491d4d7580a83895797f5651]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.539409 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3545cf3efbef403aa897a8ddd7896c6f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.539499 15248 raft_consensus.cc:2468] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:24.539587 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a70808199034508833e4d2e5550b29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.540107 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 5a70808199034508833e4d2e5550b29b (DEFAULT_TABLE table=default.Table_49352274aacf479292f43c128367eeb0 [id=a788bc4f491d4d7580a83895797f5651]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.540311 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a70808199034508833e4d2e5550b29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.540271 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 5a70808199034508833e4d2e5550b29b (DEFAULT_TABLE table=default.Table_49352274aacf479292f43c128367eeb0 [id=a788bc4f491d4d7580a83895797f5651]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.540490 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a70808199034508833e4d2e5550b29b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.542011 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet ed713c293e7f4b99a5d56f064db4b7b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.542333 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3545cf3efbef403aa897a8ddd7896c6f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.542419 15248 raft_consensus.cc:3060] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.542462 15370 tablet_bootstrap.cc:492] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.542850 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 1127507b5fd54fe0b1a7e7edf936bc38 (DEFAULT_TABLE table=default.Table_cccb10034b9549bc84a9019610866553 [id=3a6fcff5488b4ee698661c7e51f754ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.543067 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1127507b5fd54fe0b1a7e7edf936bc38. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.543244 15248 raft_consensus.cc:2468] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:24.543464 15370 tablet_bootstrap.cc:654] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:24.543735 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet ed713c293e7f4b99a5d56f064db4b7b6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ed713c293e7f4b99a5d56f064db4b7b6 already in progress: creating tablet
I20251025 08:02:24.544484 15370 tablet_bootstrap.cc:492] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.544550 15370 ts_tablet_manager.cc:1403] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:24.544912 15049 leader_election.cc:304] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.544932 15370 raft_consensus.cc:359] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.545013 15370 raft_consensus.cc:385] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.545040 15370 raft_consensus.cc:740] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.545156 15370 consensus_queue.cc:260] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.545238 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 1127507b5fd54fe0b1a7e7edf936bc38 (DEFAULT_TABLE table=default.Table_cccb10034b9549bc84a9019610866553 [id=3a6fcff5488b4ee698661c7e51f754ea]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.545415 15370 ts_tablet_manager.cc:1434] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.545441 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1127507b5fd54fe0b1a7e7edf936bc38. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.545552 15370 tablet_bootstrap.cc:492] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.545043 15376 raft_consensus.cc:2804] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.546326 15376 raft_consensus.cc:697] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:24.546422 15376 consensus_queue.cc:237] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.547052 15370 tablet_bootstrap.cc:654] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.550042 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 5022f9beb59449828f59dca9d14caa50 (DEFAULT_TABLE table=default.Table_3e2c7c94e9d94339863b1848f4d0bb6c [id=ce6a220ddfc540dbb17e28bc74b66449]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.550256 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5022f9beb59449828f59dca9d14caa50. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.550271 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3545cf3efbef403aa897a8ddd7896c6f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:24.550354 14977 raft_consensus.cc:3060] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.551224 14977 raft_consensus.cc:2468] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:24.553442 15388 ts_tablet_manager.cc:1916] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.554973 15370 tablet_bootstrap.cc:492] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.555043 15370 ts_tablet_manager.cc:1403] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:24.555251 15388 ts_tablet_manager.cc:1929] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.555307 15388 log.cc:1199] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/ed713c293e7f4b99a5d56f064db4b7b6
I20251025 08:02:24.555431 15370 raft_consensus.cc:359] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.555490 15388 ts_tablet_manager.cc:1950] T ed713c293e7f4b99a5d56f064db4b7b6 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.555510 15370 raft_consensus.cc:385] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.555541 15370 raft_consensus.cc:740] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.555646 15370 consensus_queue.cc:260] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.555869 15370 ts_tablet_manager.cc:1434] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:24.556159 15370 tablet_bootstrap.cc:492] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.556985 15370 tablet_bootstrap.cc:654] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.557492 15409 raft_consensus.cc:493] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.557557 15409 raft_consensus.cc:515] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.557840 15409 leader_election.cc:290] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:24.558413 15185 leader_election.cc:343] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 954530e1c7204e1c9d9ded2460a823be
W20251025 08:02:24.558501 15183 leader_election.cc:343] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 954530e1c7204e1c9d9ded2460a823be
I20251025 08:02:24.558564 15183 leader_election.cc:304] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:24.558880 15409 raft_consensus.cc:2749] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.559167 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet ed713c293e7f4b99a5d56f064db4b7b6 (table default.Table_2c5d706ef36c4011901606e8ebc3bfa9 [id=b973c3ff7da44afea7909410938e2c50]) successfully deleted
I20251025 08:02:24.559643 14647 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_00008a9b750c4657a17eb05a159e1b2c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.560032 14647 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00008a9b750c4657a17eb05a159e1b2c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.560750 15370 tablet_bootstrap.cc:492] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.560815 15370 ts_tablet_manager.cc:1403] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:24.561199 15370 raft_consensus.cc:359] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.561290 15370 raft_consensus.cc:385] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.561316 15370 raft_consensus.cc:740] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.561417 15370 consensus_queue.cc:260] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.561832 15370 ts_tablet_manager.cc:1434] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.562831 14652 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 3545cf3efbef403aa897a8ddd7896c6f
I20251025 08:02:24.562891 14655 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet b9d37ec643294d4fb8a715596f078599
I20251025 08:02:24.563066 14652 catalog_manager.cc:6719] ReplaceTablet: tablet 3545cf3efbef403aa897a8ddd7896c6f deleted and replaced by tablet 997c8c5921ad4ec18914fd50c97fc33e
I20251025 08:02:24.563633 14653 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_6b8cc455bb574b30bdb9bca2ac803ae0" } new_table_name: "default.Table_98f6b9698b9b45549d8016116c31c85a" modify_external_catalogs: true
I20251025 08:02:24.563989 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet b9d37ec643294d4fb8a715596f078599 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.564157 15385 tablet_replica.cc:333] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.564254 15385 raft_consensus.cc:2243] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.564347 15385 raft_consensus.cc:2272] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.564374 14654 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 44036e636edf42b89952e23dfc1a3d4c
I20251025 08:02:24.564627 14654 catalog_manager.cc:6719] ReplaceTablet: tablet 44036e636edf42b89952e23dfc1a3d4c deleted and replaced by tablet 06b3cc87826249ccb1f84c29df09f802
I20251025 08:02:24.564697 15385 ts_tablet_manager.cc:1916] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.564812 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_bd3b1a4a23a447bead9ce165c79693e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.565116 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd3b1a4a23a447bead9ce165c79693e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.566061 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet 44036e636edf42b89952e23dfc1a3d4c with delete_type TABLET_DATA_DELETED (replaced by tablet 06b3cc87826249ccb1f84c29df09f802) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.566241 15386 tablet_replica.cc:333] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.566340 15386 raft_consensus.cc:2243] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.566433 15386 raft_consensus.cc:2272] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.566669 14652 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet d8d2d5d7676f4b8096d10781cb0e5fce (table default.Table_cc4fb27276854f679d49c263e71b51bb [id=bb1d4aea5e9c4907a826f763e2c62707]). Expected version 1 got 0
I20251025 08:02:24.566740 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 44036e636edf42b89952e23dfc1a3d4c with delete_type TABLET_DATA_DELETED (replaced by tablet 06b3cc87826249ccb1f84c29df09f802) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.566831 15385 ts_tablet_manager.cc:1929] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.566917 15385 log.cc:1199] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/b9d37ec643294d4fb8a715596f078599
I20251025 08:02:24.567162 15385 ts_tablet_manager.cc:1950] T b9d37ec643294d4fb8a715596f078599 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.567451 15386 ts_tablet_manager.cc:1916] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.567624 14649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_802f081e7d2c4fe4b0d34d798171708d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.567802 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 44036e636edf42b89952e23dfc1a3d4c with delete_type TABLET_DATA_DELETED (replaced by tablet 06b3cc87826249ccb1f84c29df09f802) from {username='slave'} at 127.0.0.1:37198
W20251025 08:02:24.567924 14649 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_802f081e7d2c4fe4b0d34d798171708d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.567934 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet b9d37ec643294d4fb8a715596f078599 (table default.Table_742a7811d8054888be95298c1febef0d [id=9ca80f87609a4cb789c6164e313f3f20]) successfully deleted
I20251025 08:02:24.568161 15385 tablet_replica.cc:333] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.568274 15385 raft_consensus.cc:2243] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.568348 15385 pending_rounds.cc:70] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 2 pending ops.
I20251025 08:02:24.568374 15385 pending_rounds.cc:77] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7214609795127050240 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "44036e636edf42b89952e23dfc1a3d4c" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_6b8cc455bb574b30bdb9bca2ac803ae0" dest_uuid: "e51a2be794f04642b89386067ecbc77e" new_extra_config { } }
I20251025 08:02:24.568526 15385 pending_rounds.cc:77] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609794252005376 op_type: NO_OP noop_request { }
I20251025 08:02:24.568584 15385 raft_consensus.cc:2889] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:24.568637 15385 raft_consensus.cc:2272] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.563941 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 3545cf3efbef403aa897a8ddd7896c6f with delete_type TABLET_DATA_DELETED (replaced by tablet 997c8c5921ad4ec18914fd50c97fc33e) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.568912 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet b9d37ec643294d4fb8a715596f078599 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.569386 15386 ts_tablet_manager.cc:1929] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.569442 15386 log.cc:1199] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/44036e636edf42b89952e23dfc1a3d4c
I20251025 08:02:24.569656 15386 ts_tablet_manager.cc:1950] T 44036e636edf42b89952e23dfc1a3d4c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.570115 15386 tablet_replica.cc:333] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.570348 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 44036e636edf42b89952e23dfc1a3d4c (table default.Table_6b8cc455bb574b30bdb9bca2ac803ae0 [id=6739c1319b784c8eb66fc75125f83056]) successfully deleted
I20251025 08:02:24.570995 15386 raft_consensus.cc:2243] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.571082 15386 pending_rounds.cc:70] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 1 pending ops.
I20251025 08:02:24.571036 14650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_d397fc560379473eaaf32d983dd63291"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.571103 15386 pending_rounds.cc:77] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609793279246336 op_type: NO_OP noop_request { }
I20251025 08:02:24.571144 15386 raft_consensus.cc:2889] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:24.571187 15386 raft_consensus.cc:2272] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:24.571317 14650 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d397fc560379473eaaf32d983dd63291 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.573168 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 3545cf3efbef403aa897a8ddd7896c6f with delete_type TABLET_DATA_DELETED (replaced by tablet 997c8c5921ad4ec18914fd50c97fc33e) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.573323 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet b9d37ec643294d4fb8a715596f078599 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.574165 14977 raft_consensus.cc:1275] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.574424 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet d458ae384ebd4c33bfc74e7657772fa6 with delete_type TABLET_DATA_DELETED (replaced by tablet 0fa8e1e7a015466699c3b98dd0647cce) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.574425 14651 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 24a584d6039d4041941f7c53bfcd9f2f
I20251025 08:02:24.574631 15248 raft_consensus.cc:1275] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.574848 14651 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_8ec26b25f09a4804b8ac3cbca4b4ff50" } new_table_name: "default.Table_797e00e4076d46a595a7149d7ff9b1d7" modify_external_catalogs: true
I20251025 08:02:24.575137 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 24a584d6039d4041941f7c53bfcd9f2f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.575302 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 24a584d6039d4041941f7c53bfcd9f2f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.575317 15497 consensus_queue.cc:1048] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.575531 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 24a584d6039d4041941f7c53bfcd9f2f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:24.575770 15735 consensus_queue.cc:1175] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ab02c9d78a9d42f193755d436c8d44b2" status { last_received { term: 1 index: 2 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 2 } }
I20251025 08:02:24.575809 15436 tablet.cc:1722] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.575862 14648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_3a925a6333c342289286ca5667f5f19d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.576124 14648 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a925a6333c342289286ca5667f5f19d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.576298 15385 ts_tablet_manager.cc:1916] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.576758 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 3545cf3efbef403aa897a8ddd7896c6f with delete_type TABLET_DATA_DELETED (replaced by tablet 997c8c5921ad4ec18914fd50c97fc33e) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.577598 15451 tablet.cc:1722] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.578362 15388 tablet_replica.cc:333] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.578473 15388 raft_consensus.cc:2243] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.578673 15388 raft_consensus.cc:2272] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.580929 15376 consensus_queue.cc:1048] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.581303 14647 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_d5f1669745ce40c9afcd65029292ea51"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.581604 14647 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d5f1669745ce40c9afcd65029292ea51 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.583585 15388 ts_tablet_manager.cc:1916] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:24.585294 14651 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0553b245e4404132b0bfe178bf4074c3 has no consensus state
I20251025 08:02:24.585522 14651 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_30272613d7184fb1b153ca55ed9df9e8" } new_table_name: "default.Table_0db7fc431dff4c7f85007159dd715e19" modify_external_catalogs: true
I20251025 08:02:24.586529 15385 ts_tablet_manager.cc:1929] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.586591 15385 log.cc:1199] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/44036e636edf42b89952e23dfc1a3d4c
I20251025 08:02:24.586743 15388 ts_tablet_manager.cc:1929] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.586791 15388 log.cc:1199] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/44036e636edf42b89952e23dfc1a3d4c
I20251025 08:02:24.586830 15385 ts_tablet_manager.cc:1950] T 44036e636edf42b89952e23dfc1a3d4c P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.586972 15388 ts_tablet_manager.cc:1950] T 44036e636edf42b89952e23dfc1a3d4c P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.587342 15385 tablet_replica.cc:333] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.587438 15385 raft_consensus.cc:2243] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.587452 15388 tablet_replica.cc:333] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.587517 15385 raft_consensus.cc:2272] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.587529 15388 raft_consensus.cc:2243] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.587589 15388 pending_rounds.cc:70] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:24.587604 15388 pending_rounds.cc:77] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609793279246336 op_type: NO_OP noop_request { }
I20251025 08:02:24.587636 15388 raft_consensus.cc:2889] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:24.587668 15388 raft_consensus.cc:2272] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:24.587867 14653 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 06b3cc87826249ccb1f84c29df09f802 has no consensus state
I20251025 08:02:24.587906 15385 ts_tablet_manager.cc:1916] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.587949 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 44036e636edf42b89952e23dfc1a3d4c (table default.Table_98f6b9698b9b45549d8016116c31c85a [id=6739c1319b784c8eb66fc75125f83056]) successfully deleted
I20251025 08:02:24.588083 14653 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_643cee182de94bbf9718fb59a00cf85c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.588347 15388 ts_tablet_manager.cc:1916] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:24.588374 14653 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_643cee182de94bbf9718fb59a00cf85c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.589376 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 44036e636edf42b89952e23dfc1a3d4c (table default.Table_98f6b9698b9b45549d8016116c31c85a [id=6739c1319b784c8eb66fc75125f83056]) successfully deleted
I20251025 08:02:24.589713 15385 ts_tablet_manager.cc:1929] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.589771 15385 log.cc:1199] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/3545cf3efbef403aa897a8ddd7896c6f
I20251025 08:02:24.589866 15388 ts_tablet_manager.cc:1929] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:24.589922 15388 log.cc:1199] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/b9d37ec643294d4fb8a715596f078599
I20251025 08:02:24.589985 15385 ts_tablet_manager.cc:1950] T 3545cf3efbef403aa897a8ddd7896c6f P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.590003 14655 master_service.cc:954] ReplaceTablet: received request to replace tablet fe4f4c8c26804aee8e45926f60b8da79 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.590162 15388 ts_tablet_manager.cc:1950] T b9d37ec643294d4fb8a715596f078599 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.590574 15388 tablet_replica.cc:333] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.590687 15388 raft_consensus.cc:2243] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.590838 15388 raft_consensus.cc:2272] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.591464 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 44036e636edf42b89952e23dfc1a3d4c with delete_type TABLET_DATA_DELETED (replaced by tablet 06b3cc87826249ccb1f84c29df09f802) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.591732 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet b9d37ec643294d4fb8a715596f078599 (table default.Table_742a7811d8054888be95298c1febef0d [id=9ca80f87609a4cb789c6164e313f3f20]) successfully deleted
I20251025 08:02:24.592341 15388 ts_tablet_manager.cc:1916] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.593029 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 44036e636edf42b89952e23dfc1a3d4c with delete_type TABLET_DATA_DELETED (replaced by tablet 06b3cc87826249ccb1f84c29df09f802) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.594434 14650 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_797e00e4076d46a595a7149d7ff9b1d7" } new_table_name: "default.Table_10d54e05b641473088190175b4007184" modify_external_catalogs: true
I20251025 08:02:24.595055 15497 raft_consensus.cc:493] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.595134 15497 raft_consensus.cc:515] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.595441 15497 leader_election.cc:290] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.598359 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bf286568e8343b7921ac256a9313e63" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.598462 15248 raft_consensus.cc:2468] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:24.598987 15436 tablet.cc:1722] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.600241 14647 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_f398b0ec52b14af5889821d6f4bc881d" } modify_external_catalogs: true
I20251025 08:02:24.600337 14647 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_f398b0ec52b14af5889821d6f4bc881d" } modify_external_catalogs: true
I20251025 08:02:24.600433 15388 ts_tablet_manager.cc:1929] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.600486 15388 log.cc:1199] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/24a584d6039d4041941f7c53bfcd9f2f
I20251025 08:02:24.601136 15437 tablet.cc:1722] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.602386 15388 ts_tablet_manager.cc:1950] T 24a584d6039d4041941f7c53bfcd9f2f P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.602653 15385 tablet_replica.cc:333] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.602764 15385 raft_consensus.cc:2243] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.602869 15385 raft_consensus.cc:2272] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.602895 15049 leader_election.cc:304] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.603166 15380 raft_consensus.cc:2804] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.603235 15380 raft_consensus.cc:493] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.603279 15380 raft_consensus.cc:3060] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.603349 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 3545cf3efbef403aa897a8ddd7896c6f (table default.Table_e7d81e9e21714341be16ee46af55cde8 [id=cb9294ed7c474aae989ac13159ec3166]) successfully deleted
W20251025 08:02:24.603509 15730 consensus_queue.cc:1175] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20251025 08:02:24.603646 15369 tablet_bootstrap.cc:492] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.603714 15369 ts_tablet_manager.cc:1403] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.114s user 0.000s sys 0.001s
I20251025 08:02:24.604107 15372 tablet_bootstrap.cc:492] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.604182 15372 ts_tablet_manager.cc:1403] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.088s user 0.001s sys 0.000s
I20251025 08:02:24.604148 15380 raft_consensus.cc:515] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.604194 15369 raft_consensus.cc:359] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.604277 15369 raft_consensus.cc:385] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.604307 15369 raft_consensus.cc:740] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.604349 15388 tablet_replica.cc:333] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.604419 15369 consensus_queue.cc:260] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.604477 15380 leader_election.cc:290] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.604491 15388 raft_consensus.cc:2243] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.604607 15388 pending_rounds.cc:70] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:24.604635 15388 pending_rounds.cc:77] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609795263184896 op_type: NO_OP noop_request { }
I20251025 08:02:24.604682 15388 raft_consensus.cc:2889] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:24.604705 15369 ts_tablet_manager.cc:1434] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.604662 15372 raft_consensus.cc:359] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.604739 15388 raft_consensus.cc:2272] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.604749 15372 raft_consensus.cc:385] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.604782 15372 raft_consensus.cc:740] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.604858 15369 tablet_bootstrap.cc:492] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.604892 15372 consensus_queue.cc:260] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.605186 15372 ts_tablet_manager.cc:1434] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:24.605368 15372 tablet_bootstrap.cc:492] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.605405 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 24a584d6039d4041941f7c53bfcd9f2f (table default.Table_0f289526bf514ddc90a5622136145bff [id=170fdc9a02124e5488b4ac3d2776ca83]) successfully deleted
I20251025 08:02:24.605783 15369 tablet_bootstrap.cc:654] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.605994 15388 ts_tablet_manager.cc:1916] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.606307 15372 tablet_bootstrap.cc:654] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.607632 15437 tablet.cc:1722] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.607762 15386 ts_tablet_manager.cc:1916] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.609222 15388 ts_tablet_manager.cc:1929] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:24.609284 15388 log.cc:1199] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/3545cf3efbef403aa897a8ddd7896c6f
I20251025 08:02:24.609519 15388 ts_tablet_manager.cc:1950] T 3545cf3efbef403aa897a8ddd7896c6f P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.609650 15385 ts_tablet_manager.cc:1916] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.609807 15386 ts_tablet_manager.cc:1929] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:24.609874 15386 log.cc:1199] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/b9d37ec643294d4fb8a715596f078599
I20251025 08:02:24.610111 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 3545cf3efbef403aa897a8ddd7896c6f (table default.Table_e7d81e9e21714341be16ee46af55cde8 [id=cb9294ed7c474aae989ac13159ec3166]) successfully deleted
I20251025 08:02:24.610143 15386 ts_tablet_manager.cc:1950] T b9d37ec643294d4fb8a715596f078599 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.610268 14649 master_service.cc:954] ReplaceTablet: received request to replace tablet dd2a01b7d5c14be0a1a6776540ef829e from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.610944 15386 tablet_replica.cc:333] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.610983 14653 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_3fa132009b464438a9f73ec8c048f294" } modify_external_catalogs: true
I20251025 08:02:24.611052 15386 raft_consensus.cc:2243] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.611083 14653 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_3fa132009b464438a9f73ec8c048f294" } modify_external_catalogs: true
I20251025 08:02:24.611138 15386 raft_consensus.cc:2272] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.611135 15464 raft_consensus.cc:493] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.611215 15464 raft_consensus.cc:515] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.611322 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet b9d37ec643294d4fb8a715596f078599 (table default.Table_742a7811d8054888be95298c1febef0d [id=9ca80f87609a4cb789c6164e313f3f20]) successfully deleted
I20251025 08:02:24.611538 15464 leader_election.cc:290] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:24.611651 15386 ts_tablet_manager.cc:1916] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.611864 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dd2a01b7d5c14be0a1a6776540ef829e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
W20251025 08:02:24.611886 14642 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 44036e636edf42b89952e23dfc1a3d4c because the tablet was not found. No further retry: Not found: Tablet not found: 44036e636edf42b89952e23dfc1a3d4c
I20251025 08:02:24.611960 15113 raft_consensus.cc:2468] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.612196 14915 leader_election.cc:304] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:24.612344 15464 raft_consensus.cc:2804] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.612382 15464 raft_consensus.cc:493] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.612422 15464 raft_consensus.cc:3060] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.613286 15464 raft_consensus.cc:515] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.613353 15386 ts_tablet_manager.cc:1929] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.613404 15386 log.cc:1199] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/3545cf3efbef403aa897a8ddd7896c6f
I20251025 08:02:24.613601 15386 ts_tablet_manager.cc:1950] T 3545cf3efbef403aa897a8ddd7896c6f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.613639 15464 leader_election.cc:290] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:24.613735 15385 ts_tablet_manager.cc:1929] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.613794 15385 log.cc:1199] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/24a584d6039d4041941f7c53bfcd9f2f
I20251025 08:02:24.614023 15245 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dd2a01b7d5c14be0a1a6776540ef829e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.614070 15385 ts_tablet_manager.cc:1950] T 24a584d6039d4041941f7c53bfcd9f2f P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.614099 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dd2a01b7d5c14be0a1a6776540ef829e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.614121 15245 raft_consensus.cc:2468] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.614131 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dd2a01b7d5c14be0a1a6776540ef829e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:24.614274 15113 raft_consensus.cc:3060] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.614409 15386 tablet_replica.cc:333] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.614513 15386 raft_consensus.cc:2243] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.614513 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 3545cf3efbef403aa897a8ddd7896c6f (table default.Table_e7d81e9e21714341be16ee46af55cde8 [id=cb9294ed7c474aae989ac13159ec3166]) successfully deleted
I20251025 08:02:24.614591 15386 raft_consensus.cc:2272] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.614771 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 24a584d6039d4041941f7c53bfcd9f2f (table default.Table_0f289526bf514ddc90a5622136145bff [id=170fdc9a02124e5488b4ac3d2776ca83]) successfully deleted
W20251025 08:02:24.614909 14640 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 44036e636edf42b89952e23dfc1a3d4c because the tablet was not found. No further retry: Not found: Tablet not found: 44036e636edf42b89952e23dfc1a3d4c
I20251025 08:02:24.614979 15386 ts_tablet_manager.cc:1916] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.615095 15369 tablet_bootstrap.cc:492] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.615089 15113 raft_consensus.cc:2468] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.615157 15369 ts_tablet_manager.cc:1403] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:24.615375 14915 leader_election.cc:304] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:24.615511 15464 raft_consensus.cc:2804] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.615581 15464 raft_consensus.cc:697] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:24.615548 15369 raft_consensus.cc:359] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.615638 15369 raft_consensus.cc:385] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.615675 15369 raft_consensus.cc:740] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.615689 15464 consensus_queue.cc:237] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.615789 15369 consensus_queue.cc:260] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.616043 15369 ts_tablet_manager.cc:1434] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.616200 15369 tablet_bootstrap.cc:492] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.616588 15386 ts_tablet_manager.cc:1929] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.616691 15386 log.cc:1199] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/d458ae384ebd4c33bfc74e7657772fa6
I20251025 08:02:24.616932 15386 ts_tablet_manager.cc:1950] T d458ae384ebd4c33bfc74e7657772fa6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.617027 15369 tablet_bootstrap.cc:654] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.617363 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bf286568e8343b7921ac256a9313e63" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.617475 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet d458ae384ebd4c33bfc74e7657772fa6 (table default.Table_40e75fd0e39f4ae69856bde4bfd62a45 [id=739dffe08d69409aa126a14a2c413ad5]) successfully deleted
I20251025 08:02:24.617506 15247 raft_consensus.cc:3060] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.617698 15386 tablet_replica.cc:333] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.617915 15386 raft_consensus.cc:2243] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.618083 15386 raft_consensus.cc:2272] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.618362 15247 raft_consensus.cc:2468] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:24.618706 15369 tablet_bootstrap.cc:492] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.618786 15369 ts_tablet_manager.cc:1403] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:24.619019 15049 leader_election.cc:304] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.619226 15376 raft_consensus.cc:2804] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.619307 15376 raft_consensus.cc:697] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:24.619263 15369 raft_consensus.cc:359] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.619350 15369 raft_consensus.cc:385] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.619379 15369 raft_consensus.cc:740] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.619419 15376 consensus_queue.cc:237] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.619472 15369 consensus_queue.cc:260] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.619697 15369 ts_tablet_manager.cc:1434] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.619854 15369 tablet_bootstrap.cc:492] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.620708 15369 tablet_bootstrap.cc:654] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.623172 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bf286568e8343b7921ac256a9313e63" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.623273 14978 raft_consensus.cc:2468] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:24.623423 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5bf286568e8343b7921ac256a9313e63" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:24.623469 15386 ts_tablet_manager.cc:1916] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.623507 14977 raft_consensus.cc:3060] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.624316 14977 raft_consensus.cc:2468] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:24.624456 15449 mvcc.cc:204] Tried to move back new op lower bound from 7214609795371954176 to 7214609793617203200. Current Snapshot: MvccSnapshot[applied={T|T < 7214609795371954176}]
I20251025 08:02:24.624544 14655 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet fe4f4c8c26804aee8e45926f60b8da79
I20251025 08:02:24.624560 15451 tablet.cc:1722] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.624821 14655 catalog_manager.cc:6719] ReplaceTablet: tablet fe4f4c8c26804aee8e45926f60b8da79 deleted and replaced by tablet 3eee1563ce444900a96f9f363e92e7ff
I20251025 08:02:24.625936 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet fe4f4c8c26804aee8e45926f60b8da79 with delete_type TABLET_DATA_DELETED (replaced by tablet 3eee1563ce444900a96f9f363e92e7ff) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.626057 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet fe4f4c8c26804aee8e45926f60b8da79 with delete_type TABLET_DATA_DELETED (replaced by tablet 3eee1563ce444900a96f9f363e92e7ff) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:24.626340 14650 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0553b245e4404132b0bfe178bf4074c3 has no consensus state
I20251025 08:02:24.626897 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet fe4f4c8c26804aee8e45926f60b8da79 with delete_type TABLET_DATA_DELETED (replaced by tablet 3eee1563ce444900a96f9f363e92e7ff) from {username='slave'} at 127.0.0.1:37198
W20251025 08:02:24.629379 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet fe4f4c8c26804aee8e45926f60b8da79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe4f4c8c26804aee8e45926f60b8da79 already in progress: creating tablet
I20251025 08:02:24.630538 15369 tablet_bootstrap.cc:492] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.630613 15369 ts_tablet_manager.cc:1403] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251025 08:02:24.631016 15369 raft_consensus.cc:359] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.631096 15369 raft_consensus.cc:385] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.631140 15369 raft_consensus.cc:740] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.631251 15369 consensus_queue.cc:260] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.631469 15369 ts_tablet_manager.cc:1434] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.631601 15369 tablet_bootstrap.cc:492] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.631773 14647 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet c64cf55ede2446ecbfc47be3e04eb646
I20251025 08:02:24.632007 14653 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 962889388a40485bb61b3b47e3ad3d43
I20251025 08:02:24.632617 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet c64cf55ede2446ecbfc47be3e04eb646 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.632678 15369 tablet_bootstrap.cc:654] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.632934 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet c64cf55ede2446ecbfc47be3e04eb646 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.633020 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 962889388a40485bb61b3b47e3ad3d43 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.633339 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 962889388a40485bb61b3b47e3ad3d43 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.633836 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet c64cf55ede2446ecbfc47be3e04eb646 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.633975 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 962889388a40485bb61b3b47e3ad3d43 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.634573 15385 tablet_replica.cc:333] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.634688 15385 raft_consensus.cc:2243] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.634801 15372 tablet_bootstrap.cc:492] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.634876 15372 ts_tablet_manager.cc:1403] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.001s
I20251025 08:02:24.634975 15385 pending_rounds.cc:70] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:24.635032 15385 pending_rounds.cc:77] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609794038890496 op_type: NO_OP noop_request { }
I20251025 08:02:24.635089 15385 raft_consensus.cc:2889] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:24.635147 15385 raft_consensus.cc:2272] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.635295 15372 raft_consensus.cc:359] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.635385 15372 raft_consensus.cc:385] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.635426 15372 raft_consensus.cc:740] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.635541 15372 consensus_queue.cc:260] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.635751 15372 ts_tablet_manager.cc:1434] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.635902 15372 tablet_bootstrap.cc:492] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.636705 15372 tablet_bootstrap.cc:654] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.637863 15385 ts_tablet_manager.cc:1916] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.638243 14653 master_service.cc:954] ReplaceTablet: received request to replace tablet 2d890847f8634b869d9958519c6d2b8c from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.638833 15374 raft_consensus.cc:493] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.638895 15374 raft_consensus.cc:515] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.639178 15374 leader_election.cc:290] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.639788 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe4f4c8c26804aee8e45926f60b8da79" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:24.639886 15113 raft_consensus.cc:2468] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.640161 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe4f4c8c26804aee8e45926f60b8da79" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.640179 14915 leader_election.cc:304] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
W20251025 08:02:24.640635 14914 leader_election.cc:343] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.640846 15374 raft_consensus.cc:2804] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.640897 15374 raft_consensus.cc:493] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.640931 15374 raft_consensus.cc:3060] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.641719 15374 raft_consensus.cc:515] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.642077 15374 leader_election.cc:290] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.642168 15388 tablet_replica.cc:333] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.642244 15386 ts_tablet_manager.cc:1929] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.642323 15386 log.cc:1199] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/24a584d6039d4041941f7c53bfcd9f2f
I20251025 08:02:24.642325 15388 raft_consensus.cc:2243] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.642419 15388 raft_consensus.cc:2272] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.642562 15386 ts_tablet_manager.cc:1950] T 24a584d6039d4041941f7c53bfcd9f2f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.643096 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 24a584d6039d4041941f7c53bfcd9f2f (table default.Table_0f289526bf514ddc90a5622136145bff [id=170fdc9a02124e5488b4ac3d2776ca83]) successfully deleted
I20251025 08:02:24.643301 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe4f4c8c26804aee8e45926f60b8da79" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
W20251025 08:02:24.643603 14915 leader_election.cc:343] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.643605 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fe4f4c8c26804aee8e45926f60b8da79" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:24.643697 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet fe4f4c8c26804aee8e45926f60b8da79 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fe4f4c8c26804aee8e45926f60b8da79 already in progress: creating tablet
I20251025 08:02:24.643872 15386 tablet_replica.cc:333] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
W20251025 08:02:24.643860 14914 leader_election.cc:343] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.643916 14914 leader_election.cc:304] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.643966 15386 raft_consensus.cc:2243] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.644044 15386 raft_consensus.cc:2272] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.644426 15386 ts_tablet_manager.cc:1916] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.644569 15388 ts_tablet_manager.cc:1916] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.644726 15374 raft_consensus.cc:2749] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.644847 14653 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 2d890847f8634b869d9958519c6d2b8c
I20251025 08:02:24.645125 14653 catalog_manager.cc:6719] ReplaceTablet: tablet 2d890847f8634b869d9958519c6d2b8c deleted and replaced by tablet b1ae9934b0ca403ea026233ecd952a20
I20251025 08:02:24.645660 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 2d890847f8634b869d9958519c6d2b8c with delete_type TABLET_DATA_DELETED (replaced by tablet b1ae9934b0ca403ea026233ecd952a20) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.645807 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 2d890847f8634b869d9958519c6d2b8c with delete_type TABLET_DATA_DELETED (replaced by tablet b1ae9934b0ca403ea026233ecd952a20) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.646131 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 2d890847f8634b869d9958519c6d2b8c with delete_type TABLET_DATA_DELETED (replaced by tablet b1ae9934b0ca403ea026233ecd952a20) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.646565 15388 ts_tablet_manager.cc:1929] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.646636 15388 log.cc:1199] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/fe4f4c8c26804aee8e45926f60b8da79
I20251025 08:02:24.646826 15388 ts_tablet_manager.cc:1950] T fe4f4c8c26804aee8e45926f60b8da79 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.647321 15388 tablet_replica.cc:333] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.647382 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet fe4f4c8c26804aee8e45926f60b8da79 (table default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]) successfully deleted
I20251025 08:02:24.647428 15388 raft_consensus.cc:2243] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.647513 15388 raft_consensus.cc:2272] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.647776 15388 ts_tablet_manager.cc:1916] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.648643 15386 ts_tablet_manager.cc:1929] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.648710 15386 log.cc:1199] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/c64cf55ede2446ecbfc47be3e04eb646
I20251025 08:02:24.648900 15386 ts_tablet_manager.cc:1950] T c64cf55ede2446ecbfc47be3e04eb646 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.649453 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet c64cf55ede2446ecbfc47be3e04eb646 (table default.Table_f398b0ec52b14af5889821d6f4bc881d [id=680b8d6772bf4a08a5102bba9a48f34d]) successfully deleted
I20251025 08:02:24.649467 15388 ts_tablet_manager.cc:1929] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.649526 15388 log.cc:1199] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/c64cf55ede2446ecbfc47be3e04eb646
I20251025 08:02:24.649704 15388 ts_tablet_manager.cc:1950] T c64cf55ede2446ecbfc47be3e04eb646 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.650221 15388 tablet_replica.cc:333] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.650326 15388 raft_consensus.cc:2243] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.650375 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet c64cf55ede2446ecbfc47be3e04eb646 (table default.Table_f398b0ec52b14af5889821d6f4bc881d [id=680b8d6772bf4a08a5102bba9a48f34d]) successfully deleted
I20251025 08:02:24.650485 15388 raft_consensus.cc:2272] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.650934 15388 ts_tablet_manager.cc:1916] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.651634 15224 tablet_service.cc:1505] Processing CreateTablet for tablet f61b7b4e700645a6b3d235dd1bc1c026 (DEFAULT_TABLE table=default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.651847 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61b7b4e700645a6b3d235dd1bc1c026. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.651813 14958 tablet_service.cc:1505] Processing CreateTablet for tablet f61b7b4e700645a6b3d235dd1bc1c026 (DEFAULT_TABLE table=default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.652024 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61b7b4e700645a6b3d235dd1bc1c026. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.652532 15388 ts_tablet_manager.cc:1929] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:24.652582 15388 log.cc:1199] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/962889388a40485bb61b3b47e3ad3d43
I20251025 08:02:24.652834 15388 ts_tablet_manager.cc:1950] T 962889388a40485bb61b3b47e3ad3d43 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.653285 15388 tablet_replica.cc:333] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.653373 15388 raft_consensus.cc:2243] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.653367 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 962889388a40485bb61b3b47e3ad3d43 (table default.Table_3fa132009b464438a9f73ec8c048f294 [id=394a1e6daa8f42f4a69517cb60a9a935]) successfully deleted
I20251025 08:02:24.653510 15388 raft_consensus.cc:2272] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.654027 15388 ts_tablet_manager.cc:1916] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.654222 15091 tablet_service.cc:1505] Processing CreateTablet for tablet f61b7b4e700645a6b3d235dd1bc1c026 (DEFAULT_TABLE table=default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.654433 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f61b7b4e700645a6b3d235dd1bc1c026. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.655530 15374 raft_consensus.cc:493] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.655598 15374 raft_consensus.cc:515] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.655905 15374 leader_election.cc:290] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.655948 15388 ts_tablet_manager.cc:1929] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.656004 15388 log.cc:1199] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/2d890847f8634b869d9958519c6d2b8c
I20251025 08:02:24.656221 15370 tablet_bootstrap.cc:492] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.656236 15388 ts_tablet_manager.cc:1950] T 2d890847f8634b869d9958519c6d2b8c P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.656458 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 0553b245e4404132b0bfe178bf4074c3 (DEFAULT_TABLE table=default.Table_10d54e05b641473088190175b4007184 [id=10b5567973c2480ab51946feb2be997b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.656656 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0553b245e4404132b0bfe178bf4074c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.656625 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 0553b245e4404132b0bfe178bf4074c3 (DEFAULT_TABLE table=default.Table_10d54e05b641473088190175b4007184 [id=10b5567973c2480ab51946feb2be997b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.656791 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0553b245e4404132b0bfe178bf4074c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.657080 15370 tablet_bootstrap.cc:654] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.657719 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a0a2af3ed1f41fea41962db52cfe7d8" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.657814 15247 raft_consensus.cc:2468] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.657931 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 2d890847f8634b869d9958519c6d2b8c (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]) successfully deleted
I20251025 08:02:24.657994 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a0a2af3ed1f41fea41962db52cfe7d8" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:24.658082 15113 raft_consensus.cc:2468] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.658226 14914 leader_election.cc:304] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.658475 15445 raft_consensus.cc:2804] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.658533 15445 raft_consensus.cc:493] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.658569 15445 raft_consensus.cc:3060] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.659025 15464 consensus_queue.cc:1048] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.659296 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 0553b245e4404132b0bfe178bf4074c3 (DEFAULT_TABLE table=default.Table_10d54e05b641473088190175b4007184 [id=10b5567973c2480ab51946feb2be997b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.659308 15445 raft_consensus.cc:515] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.659485 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0553b245e4404132b0bfe178bf4074c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.659590 15445 leader_election.cc:290] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.660041 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a0a2af3ed1f41fea41962db52cfe7d8" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.660131 15248 raft_consensus.cc:3060] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.660938 15248 raft_consensus.cc:2468] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.661170 14649 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet dd2a01b7d5c14be0a1a6776540ef829e
I20251025 08:02:24.661430 14649 catalog_manager.cc:6719] ReplaceTablet: tablet dd2a01b7d5c14be0a1a6776540ef829e deleted and replaced by tablet 3bf26408c98e49298ff9c738a1e26cf9
I20251025 08:02:24.661564 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet dd2a01b7d5c14be0a1a6776540ef829e with delete_type TABLET_DATA_DELETED (replaced by tablet 3bf26408c98e49298ff9c738a1e26cf9) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.661628 15372 tablet_bootstrap.cc:492] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.661691 15372 ts_tablet_manager.cc:1403] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.001s
I20251025 08:02:24.661978 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet dd2a01b7d5c14be0a1a6776540ef829e with delete_type TABLET_DATA_DELETED (replaced by tablet 3bf26408c98e49298ff9c738a1e26cf9) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.662073 15372 raft_consensus.cc:359] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.662171 15372 raft_consensus.cc:385] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.662251 15372 raft_consensus.cc:740] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.662287 14914 leader_election.cc:304] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.662369 15372 consensus_queue.cc:260] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.662427 15374 raft_consensus.cc:2804] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.662485 15374 raft_consensus.cc:697] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:24.662521 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 1ee00271d2354ae38dcb5a3289cea72f (DEFAULT_TABLE table=default.Table_eb789fed3e81408b8b688461884e9c5a [id=1ee33ee129d749d0bd7f26dc49fca0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.662581 15374 consensus_queue.cc:237] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.662636 15372 ts_tablet_manager.cc:1434] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.662680 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet dd2a01b7d5c14be0a1a6776540ef829e with delete_type TABLET_DATA_DELETED (replaced by tablet 3bf26408c98e49298ff9c738a1e26cf9) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.662770 15372 tablet_bootstrap.cc:492] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.662858 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee00271d2354ae38dcb5a3289cea72f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.662846 14648 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 3f7aa0b88b284d52a6cca064a798aa54 (table default.Table_ab1d4169df5a4c438c761aaabe15488e [id=cead87820a99412e936796998d2150dc]). Expected version 1 got 0
I20251025 08:02:24.663591 15372 tablet_bootstrap.cc:654] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.663676 14646 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet d8d2d5d7676f4b8096d10781cb0e5fce (table default.Table_cc4fb27276854f679d49c263e71b51bb [id=bb1d4aea5e9c4907a826f763e2c62707]). Expected version 1 got 0
I20251025 08:02:24.663795 14646 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 2a0a2af3ed1f41fea41962db52cfe7d8 (table default.Table_30272613d7184fb1b153ca55ed9df9e8 [id=1e1120fd790b44569595d67fea5165c2]). Expected version 1 got 0
I20251025 08:02:24.664243 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 1ee00271d2354ae38dcb5a3289cea72f (DEFAULT_TABLE table=default.Table_eb789fed3e81408b8b688461884e9c5a [id=1ee33ee129d749d0bd7f26dc49fca0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.664311 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a0a2af3ed1f41fea41962db52cfe7d8" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
W20251025 08:02:24.664333 14651 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a0a2af3ed1f41fea41962db52cfe7d8 consensus state has no leader
I20251025 08:02:24.664392 15113 raft_consensus.cc:3060] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.664451 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee00271d2354ae38dcb5a3289cea72f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.664733 14654 catalog_manager.cc:5649] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:24.665127 15113 raft_consensus.cc:2468] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.665913 15388 tablet_replica.cc:333] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.666045 15388 raft_consensus.cc:2243] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.666057 15386 tablet_replica.cc:333] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.666162 15388 raft_consensus.cc:2272] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.666345 15386 raft_consensus.cc:2243] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.666641 15388 ts_tablet_manager.cc:1916] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.666647 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet b9d37ec643294d4fb8a715596f078599 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.666783 15386 raft_consensus.cc:2272] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.666800 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet 954530e1c7204e1c9d9ded2460a823be with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.667254 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet db9202bf6e6041f28b3173580db9ad7d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.667869 15386 ts_tablet_manager.cc:1916] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.668529 15388 ts_tablet_manager.cc:1929] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.668591 15388 log.cc:1199] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/dd2a01b7d5c14be0a1a6776540ef829e
I20251025 08:02:24.668771 15388 ts_tablet_manager.cc:1950] T dd2a01b7d5c14be0a1a6776540ef829e P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.669299 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet dd2a01b7d5c14be0a1a6776540ef829e (table default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]) successfully deleted
I20251025 08:02:24.669654 15386 ts_tablet_manager.cc:1929] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:24.669724 15386 log.cc:1199] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/962889388a40485bb61b3b47e3ad3d43
I20251025 08:02:24.669975 15386 ts_tablet_manager.cc:1950] T 962889388a40485bb61b3b47e3ad3d43 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.670531 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 962889388a40485bb61b3b47e3ad3d43 (table default.Table_3fa132009b464438a9f73ec8c048f294 [id=394a1e6daa8f42f4a69517cb60a9a935]) successfully deleted
I20251025 08:02:24.671277 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 1ee00271d2354ae38dcb5a3289cea72f (DEFAULT_TABLE table=default.Table_eb789fed3e81408b8b688461884e9c5a [id=1ee33ee129d749d0bd7f26dc49fca0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.671470 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ee00271d2354ae38dcb5a3289cea72f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.671834 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 10ef8618965e438cbf6fafc0533c9bfc (DEFAULT_TABLE table=default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.672037 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ef8618965e438cbf6fafc0533c9bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.672242 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 10ef8618965e438cbf6fafc0533c9bfc (DEFAULT_TABLE table=default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.672427 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ef8618965e438cbf6fafc0533c9bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.672818 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 10ef8618965e438cbf6fafc0533c9bfc (DEFAULT_TABLE table=default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.673027 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ef8618965e438cbf6fafc0533c9bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.674932 14955 tablet_service.cc:1505] Processing CreateTablet for tablet c20947edc1f24e338cabf72b18282d24 (DEFAULT_TABLE table=default.Table_8436de66616b479fa1982a64ba3579d0 [id=cb6856b315084424836559dacbe12c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.675007 15227 tablet_service.cc:1505] Processing CreateTablet for tablet c20947edc1f24e338cabf72b18282d24 (DEFAULT_TABLE table=default.Table_8436de66616b479fa1982a64ba3579d0 [id=cb6856b315084424836559dacbe12c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.675136 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c20947edc1f24e338cabf72b18282d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.675179 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c20947edc1f24e338cabf72b18282d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.677048 15385 ts_tablet_manager.cc:1929] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:24.677114 15385 log.cc:1199] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/c64cf55ede2446ecbfc47be3e04eb646
I20251025 08:02:24.677354 15385 ts_tablet_manager.cc:1950] T c64cf55ede2446ecbfc47be3e04eb646 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.677428 15091 tablet_service.cc:1505] Processing CreateTablet for tablet c20947edc1f24e338cabf72b18282d24 (DEFAULT_TABLE table=default.Table_8436de66616b479fa1982a64ba3579d0 [id=cb6856b315084424836559dacbe12c28]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.677685 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c20947edc1f24e338cabf72b18282d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.678303 15385 tablet_replica.cc:333] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.678473 15385 raft_consensus.cc:2243] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.678578 15385 raft_consensus.cc:2272] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.678668 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 35eb28e4cabf4e59b8245fa3adc57872 (DEFAULT_TABLE table=default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.678958 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35eb28e4cabf4e59b8245fa3adc57872. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.679530 15385 ts_tablet_manager.cc:1916] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.681120 15385 ts_tablet_manager.cc:1929] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:24.681185 15385 log.cc:1199] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/962889388a40485bb61b3b47e3ad3d43
I20251025 08:02:24.681725 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet c64cf55ede2446ecbfc47be3e04eb646 (table default.Table_f398b0ec52b14af5889821d6f4bc881d [id=680b8d6772bf4a08a5102bba9a48f34d]) successfully deleted
I20251025 08:02:24.681960 14648 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_cc4fb27276854f679d49c263e71b51bb [id=bb1d4aea5e9c4907a826f763e2c62707] alter complete (version 1)
I20251025 08:02:24.682585 15369 tablet_bootstrap.cc:492] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.682670 15369 ts_tablet_manager.cc:1403] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.051s user 0.001s sys 0.000s
I20251025 08:02:24.683089 15369 raft_consensus.cc:359] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.683173 15369 raft_consensus.cc:385] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.683219 15369 raft_consensus.cc:740] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.683328 15369 consensus_queue.cc:260] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.683591 15369 ts_tablet_manager.cc:1434] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.683744 15369 tablet_bootstrap.cc:492] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.683435 15385 ts_tablet_manager.cc:1950] T 962889388a40485bb61b3b47e3ad3d43 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.684522 15385 tablet_replica.cc:333] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.684594 15369 tablet_bootstrap.cc:654] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.684633 15385 raft_consensus.cc:2243] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.684799 15385 raft_consensus.cc:2272] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.685382 15385 ts_tablet_manager.cc:1916] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.685602 15374 consensus_queue.cc:1048] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.685727 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet ed713c293e7f4b99a5d56f064db4b7b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.685768 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 2757cfa1345c4085b232e93ec32c8188 with delete_type TABLET_DATA_DELETED (replaced by tablet 35eb28e4cabf4e59b8245fa3adc57872) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.685799 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 962889388a40485bb61b3b47e3ad3d43 (table default.Table_3fa132009b464438a9f73ec8c048f294 [id=394a1e6daa8f42f4a69517cb60a9a935]) successfully deleted
I20251025 08:02:24.688241 15385 ts_tablet_manager.cc:1929] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.688331 15385 log.cc:1199] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/2d890847f8634b869d9958519c6d2b8c
I20251025 08:02:24.688568 15385 ts_tablet_manager.cc:1950] T 2d890847f8634b869d9958519c6d2b8c P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.689021 15385 tablet_replica.cc:333] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.689118 15385 raft_consensus.cc:2243] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.689239 15385 pending_rounds.cc:70] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:24.689265 15385 pending_rounds.cc:77] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609795547172864 op_type: NO_OP noop_request { }
I20251025 08:02:24.689306 15385 raft_consensus.cc:2889] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:24.689348 15385 raft_consensus.cc:2272] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.689996 15385 ts_tablet_manager.cc:1916] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.690481 15386 tablet_replica.cc:333] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.690577 15386 raft_consensus.cc:2243] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.690670 15386 raft_consensus.cc:2272] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.691058 15369 tablet_bootstrap.cc:492] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.691133 15369 ts_tablet_manager.cc:1403] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20251025 08:02:24.691547 15369 raft_consensus.cc:359] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.691635 15369 raft_consensus.cc:385] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.691665 15369 raft_consensus.cc:740] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.691761 15369 consensus_queue.cc:260] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.691943 14654 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_ab1d4169df5a4c438c761aaabe15488e [id=cead87820a99412e936796998d2150dc] alter complete (version 1)
I20251025 08:02:24.691967 15642 raft_consensus.cc:493] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.691983 15369 ts_tablet_manager.cc:1434] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.692027 15642 raft_consensus.cc:515] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.692127 15369 tablet_bootstrap.cc:492] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.692364 15642 leader_election.cc:290] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.692724 15385 ts_tablet_manager.cc:1929] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:24.692818 15385 log.cc:1199] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/dd2a01b7d5c14be0a1a6776540ef829e
I20251025 08:02:24.692997 15369 tablet_bootstrap.cc:654] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.693140 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "54ea861dbc8c46129df50fc5060739b3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.693341 15385 ts_tablet_manager.cc:1950] T dd2a01b7d5c14be0a1a6776540ef829e P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.693516 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet ed713c293e7f4b99a5d56f064db4b7b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
W20251025 08:02:24.693615 15049 leader_election.cc:343] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.693845 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "54ea861dbc8c46129df50fc5060739b3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.693944 15385 tablet_replica.cc:333] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.693946 15386 ts_tablet_manager.cc:1916] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.694036 15385 raft_consensus.cc:2243] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.694121 15385 raft_consensus.cc:2272] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.694120 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 2757cfa1345c4085b232e93ec32c8188 with delete_type TABLET_DATA_DELETED (replaced by tablet 35eb28e4cabf4e59b8245fa3adc57872) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.695139 14646 catalog_manager.cc:5649] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:24.695305 14646 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 2a0a2af3ed1f41fea41962db52cfe7d8 (table default.Table_0db7fc431dff4c7f85007159dd715e19 [id=1e1120fd790b44569595d67fea5165c2]). Expected version 2 got 0
I20251025 08:02:24.695786 15386 ts_tablet_manager.cc:1929] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.695847 15386 log.cc:1199] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/2d890847f8634b869d9958519c6d2b8c
I20251025 08:02:24.696079 15386 ts_tablet_manager.cc:1950] T 2d890847f8634b869d9958519c6d2b8c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.696295 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 2d890847f8634b869d9958519c6d2b8c (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]) successfully deleted
I20251025 08:02:24.696403 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet dd2a01b7d5c14be0a1a6776540ef829e (table default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]) successfully deleted
I20251025 08:02:24.696597 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 2d890847f8634b869d9958519c6d2b8c (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]) successfully deleted
I20251025 08:02:24.698073 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet d9067b563519468ca71ebfcc738462b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
W20251025 08:02:24.698765 15048 leader_election.cc:343] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.698828 15048 leader_election.cc:304] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.698879 15642 raft_consensus.cc:493] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.698940 15642 raft_consensus.cc:515] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.699222 15642 leader_election.cc:290] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:24.699290 15642 raft_consensus.cc:493] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.699343 15642 raft_consensus.cc:515] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.699597 15642 leader_election.cc:290] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.699677 15642 raft_consensus.cc:2749] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.699986 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 35eb28e4cabf4e59b8245fa3adc57872 (DEFAULT_TABLE table=default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.700181 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35eb28e4cabf4e59b8245fa3adc57872. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.701224 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 35eb28e4cabf4e59b8245fa3adc57872 (DEFAULT_TABLE table=default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.701427 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35eb28e4cabf4e59b8245fa3adc57872. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.702067 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1127507b5fd54fe0b1a7e7edf936bc38" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.702316 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2b014e0f49c4f7da8e65b7d4c98ea63" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.702394 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1127507b5fd54fe0b1a7e7edf936bc38" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:24.702644 15049 leader_election.cc:343] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:24.702778 15049 leader_election.cc:343] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.702888 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2b014e0f49c4f7da8e65b7d4c98ea63" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.702994 14977 raft_consensus.cc:2468] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
W20251025 08:02:24.703246 15048 leader_election.cc:343] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.703326 15048 leader_election.cc:304] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.703441 15380 raft_consensus.cc:2749] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.703538 15048 leader_election.cc:304] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.703738 15380 raft_consensus.cc:2804] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.703790 15380 raft_consensus.cc:493] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.703827 15380 raft_consensus.cc:3060] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.704749 15380 raft_consensus.cc:515] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.705080 15380 leader_election.cc:290] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.705380 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2b014e0f49c4f7da8e65b7d4c98ea63" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:24.705616 15049 leader_election.cc:343] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.705668 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet fe4f4c8c26804aee8e45926f60b8da79 with delete_type TABLET_DATA_DELETED (replaced by tablet 3eee1563ce444900a96f9f363e92e7ff) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.705870 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e2b014e0f49c4f7da8e65b7d4c98ea63" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:24.705960 14977 raft_consensus.cc:3060] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.706908 14977 raft_consensus.cc:2468] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:24.707087 15386 tablet_replica.cc:333] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.707228 15386 raft_consensus.cc:2243] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.707326 15386 raft_consensus.cc:2272] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.707752 15386 ts_tablet_manager.cc:1916] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.708032 15372 tablet_bootstrap.cc:492] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.708103 15372 ts_tablet_manager.cc:1403] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.045s user 0.000s sys 0.002s
I20251025 08:02:24.708389 15048 leader_election.cc:304] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.708523 15380 raft_consensus.cc:2804] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.708516 15372 raft_consensus.cc:359] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.708600 15372 raft_consensus.cc:385] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.708596 15380 raft_consensus.cc:697] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:24.708629 15372 raft_consensus.cc:740] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.708705 15380 consensus_queue.cc:237] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.708730 15372 consensus_queue.cc:260] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.708958 15372 ts_tablet_manager.cc:1434] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.709129 15372 tablet_bootstrap.cc:492] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.709378 15386 ts_tablet_manager.cc:1929] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.709426 15386 log.cc:1199] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/dd2a01b7d5c14be0a1a6776540ef829e
I20251025 08:02:24.709628 15386 ts_tablet_manager.cc:1950] T dd2a01b7d5c14be0a1a6776540ef829e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.710089 15372 tablet_bootstrap.cc:654] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.710541 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 7807e7f1d49c4eda8ab4fa123d0398ac with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.712365 14654 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_8b233422b57e405daba765b7619adfad" } modify_external_catalogs: true
I20251025 08:02:24.712484 14654 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_8b233422b57e405daba765b7619adfad" } modify_external_catalogs: true
I20251025 08:02:24.714433 15385 ts_tablet_manager.cc:1916] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.715919 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet dd2a01b7d5c14be0a1a6776540ef829e (table default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]) successfully deleted
I20251025 08:02:24.715989 15386 tablet_replica.cc:333] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.716084 15386 raft_consensus.cc:2243] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
W20251025 08:02:24.716089 14641 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet b9d37ec643294d4fb8a715596f078599 because the tablet was not found. No further retry: Not found: Tablet not found: b9d37ec643294d4fb8a715596f078599
I20251025 08:02:24.716164 15386 raft_consensus.cc:2272] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.716503 15386 ts_tablet_manager.cc:1916] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.717588 15385 ts_tablet_manager.cc:1929] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.717651 15385 log.cc:1199] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/ed713c293e7f4b99a5d56f064db4b7b6
I20251025 08:02:24.717833 15385 ts_tablet_manager.cc:1950] T ed713c293e7f4b99a5d56f064db4b7b6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.718482 15386 ts_tablet_manager.cc:1929] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.718953 15386 log.cc:1199] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/954530e1c7204e1c9d9ded2460a823be
I20251025 08:02:24.719038 14654 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 7922e71ecb4546dcb5c196b57ef5d3de
I20251025 08:02:24.719247 15386 ts_tablet_manager.cc:1950] T 954530e1c7204e1c9d9ded2460a823be P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.719715 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 7922e71ecb4546dcb5c196b57ef5d3de with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.719882 15386 tablet_replica.cc:333] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.720038 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 7922e71ecb4546dcb5c196b57ef5d3de with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.720052 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 954530e1c7204e1c9d9ded2460a823be (table default.Table_4960c3071f8247149c201f2d6c65090f [id=667f1e14021446d3bf165c34f9f0567d]) successfully deleted
I20251025 08:02:24.720168 15386 raft_consensus.cc:2243] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.720378 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 7922e71ecb4546dcb5c196b57ef5d3de with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.720402 15386 raft_consensus.cc:2272] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.720525 15388 tablet_replica.cc:333] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.720642 15388 raft_consensus.cc:2243] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.720794 15386 ts_tablet_manager.cc:1916] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.720809 15388 raft_consensus.cc:2272] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.721071 15372 tablet_bootstrap.cc:492] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.721138 15372 ts_tablet_manager.cc:1403] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20251025 08:02:24.721549 15372 raft_consensus.cc:359] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.721647 15372 raft_consensus.cc:385] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.721675 15372 raft_consensus.cc:740] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.721772 15372 consensus_queue.cc:260] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.721832 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet fe4f4c8c26804aee8e45926f60b8da79 with delete_type TABLET_DATA_DELETED (replaced by tablet 3eee1563ce444900a96f9f363e92e7ff) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.722301 15369 tablet_bootstrap.cc:492] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.722373 15369 ts_tablet_manager.cc:1403] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.000s
I20251025 08:02:24.722491 15386 ts_tablet_manager.cc:1929] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.722544 15386 log.cc:1199] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/db9202bf6e6041f28b3173580db9ad7d
I20251025 08:02:24.722770 15369 raft_consensus.cc:359] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.722863 15369 raft_consensus.cc:385] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.722898 15369 raft_consensus.cc:740] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.722996 15372 ts_tablet_manager.cc:1434] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:24.723017 15369 consensus_queue.cc:260] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.723152 15388 ts_tablet_manager.cc:1916] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.723271 15369 ts_tablet_manager.cc:1434] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.723531 15372 tablet_bootstrap.cc:492] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.723714 15386 ts_tablet_manager.cc:1950] T db9202bf6e6041f28b3173580db9ad7d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.724279 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet db9202bf6e6041f28b3173580db9ad7d (table default.Table_2d86a1e7ec904a128454ea0cf0839ed6 [id=f5c6646ac8924dd18f06bd714d116aa7]) successfully deleted
I20251025 08:02:24.724536 15369 tablet_bootstrap.cc:492] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.724977 15388 ts_tablet_manager.cc:1929] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.725051 15388 log.cc:1199] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/7922e71ecb4546dcb5c196b57ef5d3de
I20251025 08:02:24.725276 15372 tablet_bootstrap.cc:654] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.725296 15388 ts_tablet_manager.cc:1950] T 7922e71ecb4546dcb5c196b57ef5d3de P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.725356 15369 tablet_bootstrap.cc:654] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.726267 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 7922e71ecb4546dcb5c196b57ef5d3de (table default.Table_8b233422b57e405daba765b7619adfad [id=a5a019b836864161a3da06f611e4272e]) successfully deleted
I20251025 08:02:24.726796 15385 tablet_replica.cc:333] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.726908 15385 raft_consensus.cc:2243] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.726914 15248 raft_consensus.cc:1275] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.727003 15385 raft_consensus.cc:2272] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.727317 15113 raft_consensus.cc:1275] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.727638 15464 consensus_queue.cc:1048] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.727725 15374 consensus_queue.cc:1048] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.728264 15385 ts_tablet_manager.cc:1916] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.729339 15370 tablet_bootstrap.cc:492] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.729413 15370 ts_tablet_manager.cc:1403] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.000s
I20251025 08:02:24.729769 15370 raft_consensus.cc:359] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.729852 15370 raft_consensus.cc:385] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.729880 15370 raft_consensus.cc:740] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.730005 15370 consensus_queue.cc:260] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.730226 15370 ts_tablet_manager.cc:1434] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.730361 15370 tablet_bootstrap.cc:492] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.730772 15385 ts_tablet_manager.cc:1929] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.731216 15370 tablet_bootstrap.cc:654] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.731479 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet ed713c293e7f4b99a5d56f064db4b7b6 (table default.Table_2c5d706ef36c4011901606e8ebc3bfa9 [id=b973c3ff7da44afea7909410938e2c50]) successfully deleted
I20251025 08:02:24.731600 15385 log.cc:1199] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/2757cfa1345c4085b232e93ec32c8188
I20251025 08:02:24.732527 15385 ts_tablet_manager.cc:1950] T 2757cfa1345c4085b232e93ec32c8188 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.732676 15369 tablet_bootstrap.cc:492] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.732748 15369 ts_tablet_manager.cc:1403] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251025 08:02:24.733088 15369 raft_consensus.cc:359] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.733165 15369 raft_consensus.cc:385] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.733151 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 2757cfa1345c4085b232e93ec32c8188 (table default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]) successfully deleted
I20251025 08:02:24.733188 15369 raft_consensus.cc:740] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.733268 15369 consensus_queue.cc:260] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.733451 15369 ts_tablet_manager.cc:1434] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.733585 15369 tablet_bootstrap.cc:492] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.733994 15372 tablet_bootstrap.cc:492] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.734066 15372 ts_tablet_manager.cc:1403] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251025 08:02:24.734359 15369 tablet_bootstrap.cc:654] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.734498 15372 raft_consensus.cc:359] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.734577 15372 raft_consensus.cc:385] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.734606 15372 raft_consensus.cc:740] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.734710 15372 consensus_queue.cc:260] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.733458 15385 tablet_replica.cc:333] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.735757 15385 raft_consensus.cc:2243] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.735832 15385 raft_consensus.cc:2272] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.736445 15372 ts_tablet_manager.cc:1434] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:24.736655 15372 tablet_bootstrap.cc:492] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.737517 15372 tablet_bootstrap.cc:654] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.738662 15385 ts_tablet_manager.cc:1916] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.738720 15370 tablet_bootstrap.cc:492] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.738785 15370 ts_tablet_manager.cc:1403] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251025 08:02:24.739140 15370 raft_consensus.cc:359] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.739228 15370 raft_consensus.cc:385] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.739256 15370 raft_consensus.cc:740] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.739341 15370 consensus_queue.cc:260] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.739573 15370 ts_tablet_manager.cc:1434] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.739701 15370 tablet_bootstrap.cc:492] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.740460 15370 tablet_bootstrap.cc:654] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.740720 15385 ts_tablet_manager.cc:1929] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.740828 15385 log.cc:1199] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/fe4f4c8c26804aee8e45926f60b8da79
I20251025 08:02:24.741052 15385 ts_tablet_manager.cc:1950] T fe4f4c8c26804aee8e45926f60b8da79 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.741779 15385 tablet_replica.cc:333] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.742072 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet fe4f4c8c26804aee8e45926f60b8da79 (table default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]) successfully deleted
I20251025 08:02:24.742167 15369 tablet_bootstrap.cc:492] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.742390 15369 ts_tablet_manager.cc:1403] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:24.742775 15369 raft_consensus.cc:359] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.742849 15369 raft_consensus.cc:385] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.742874 15369 raft_consensus.cc:740] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.742959 15369 consensus_queue.cc:260] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.743160 15369 ts_tablet_manager.cc:1434] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:24.743320 15369 tablet_bootstrap.cc:492] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.743832 15386 tablet_replica.cc:333] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.743940 15386 raft_consensus.cc:2243] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.744036 15386 raft_consensus.cc:2272] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.744366 15386 ts_tablet_manager.cc:1916] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.744606 15369 tablet_bootstrap.cc:654] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.745386 15385 raft_consensus.cc:2243] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.745514 15385 raft_consensus.cc:2272] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.746693 15385 ts_tablet_manager.cc:1916] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.748256 15374 consensus_queue.cc:1048] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.750147 14646 catalog_manager.cc:5649] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:24.753086 14955 tablet_service.cc:1505] Processing CreateTablet for tablet db53440e199841c39c4003068ebb0c20 (DEFAULT_TABLE table=default.Table_00008a9b750c4657a17eb05a159e1b2c [id=18c8cd5376a34a12af35ba88bfe7b176]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.753293 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 70ac567d5918403093bf71d9d9fc99b9 (DEFAULT_TABLE table=default.Table_bd3b1a4a23a447bead9ce165c79693e6 [id=000ce64aa9d14e45ae6570f8948bb0a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.753086 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 5b49d48b94b0427aa2dcc39dae45a4eb (DEFAULT_TABLE table=default.Table_cd66db813b934963acab38c81d9fd793 [id=6c847ade4b8f485fb3353af3d2ec442b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.753490 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 70ac567d5918403093bf71d9d9fc99b9 (DEFAULT_TABLE table=default.Table_bd3b1a4a23a447bead9ce165c79693e6 [id=000ce64aa9d14e45ae6570f8948bb0a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.753574 15451 tablet.cc:1722] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:24.753700 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ac567d5918403093bf71d9d9fc99b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.754245 15436 tablet.cc:1722] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:24.755491 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 70ac567d5918403093bf71d9d9fc99b9 (DEFAULT_TABLE table=default.Table_bd3b1a4a23a447bead9ce165c79693e6 [id=000ce64aa9d14e45ae6570f8948bb0a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.755676 15090 tablet_service.cc:1505] Processing CreateTablet for tablet db53440e199841c39c4003068ebb0c20 (DEFAULT_TABLE table=default.Table_00008a9b750c4657a17eb05a159e1b2c [id=18c8cd5376a34a12af35ba88bfe7b176]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.755728 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ac567d5918403093bf71d9d9fc99b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.755854 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db53440e199841c39c4003068ebb0c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.757349 15386 ts_tablet_manager.cc:1929] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.757406 15386 log.cc:1199] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/ed713c293e7f4b99a5d56f064db4b7b6
I20251025 08:02:24.757597 15386 ts_tablet_manager.cc:1950] T ed713c293e7f4b99a5d56f064db4b7b6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.757565 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 5b49d48b94b0427aa2dcc39dae45a4eb (DEFAULT_TABLE table=default.Table_cd66db813b934963acab38c81d9fd793 [id=6c847ade4b8f485fb3353af3d2ec442b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.757769 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b49d48b94b0427aa2dcc39dae45a4eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.755498 15223 tablet_service.cc:1505] Processing CreateTablet for tablet db53440e199841c39c4003068ebb0c20 (DEFAULT_TABLE table=default.Table_00008a9b750c4657a17eb05a159e1b2c [id=18c8cd5376a34a12af35ba88bfe7b176]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.758746 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db53440e199841c39c4003068ebb0c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.759649 14654 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 0553b245e4404132b0bfe178bf4074c3 (table default.Table_10d54e05b641473088190175b4007184 [id=10b5567973c2480ab51946feb2be997b]). Expected version 2 got 0
I20251025 08:02:24.760246 14646 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 2a0a2af3ed1f41fea41962db52cfe7d8 (table default.Table_0db7fc431dff4c7f85007159dd715e19 [id=1e1120fd790b44569595d67fea5165c2]). Expected version 2 got 0
I20251025 08:02:24.758756 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 5b49d48b94b0427aa2dcc39dae45a4eb (DEFAULT_TABLE table=default.Table_cd66db813b934963acab38c81d9fd793 [id=6c847ade4b8f485fb3353af3d2ec442b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.760581 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b49d48b94b0427aa2dcc39dae45a4eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.761116 15386 tablet_replica.cc:333] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.761188 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet ed713c293e7f4b99a5d56f064db4b7b6 (table default.Table_2c5d706ef36c4011901606e8ebc3bfa9 [id=b973c3ff7da44afea7909410938e2c50]) successfully deleted
I20251025 08:02:24.761229 15386 raft_consensus.cc:2243] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.761313 15386 raft_consensus.cc:2272] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.761773 15386 ts_tablet_manager.cc:1916] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.753309 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db53440e199841c39c4003068ebb0c20. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.762655 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b49d48b94b0427aa2dcc39dae45a4eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.763352 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70ac567d5918403093bf71d9d9fc99b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.764303 15385 ts_tablet_manager.cc:1929] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.764360 15385 log.cc:1199] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/7807e7f1d49c4eda8ab4fa123d0398ac
I20251025 08:02:24.764398 15372 tablet_bootstrap.cc:492] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.764465 15372 ts_tablet_manager.cc:1403] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20251025 08:02:24.764530 15385 ts_tablet_manager.cc:1950] T 7807e7f1d49c4eda8ab4fa123d0398ac P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.764899 15372 raft_consensus.cc:359] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.764998 15372 raft_consensus.cc:385] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.765031 15372 raft_consensus.cc:740] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.765134 15372 consensus_queue.cc:260] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.765379 15372 ts_tablet_manager.cc:1434] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.765544 15372 tablet_bootstrap.cc:492] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.766391 15385 tablet_replica.cc:333] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.766409 15372 tablet_bootstrap.cc:654] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.766666 15385 raft_consensus.cc:2243] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.766764 15385 raft_consensus.cc:2272] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.767311 15385 ts_tablet_manager.cc:1916] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.767450 14651 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_40e75fd0e39f4ae69856bde4bfd62a45" } modify_external_catalogs: true
I20251025 08:02:24.767541 14651 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_40e75fd0e39f4ae69856bde4bfd62a45" } modify_external_catalogs: true
I20251025 08:02:24.767804 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 7807e7f1d49c4eda8ab4fa123d0398ac (table default.Table_d91ac83609a0452680e6ef9a726b5f31 [id=d1011dde28dd4c37975ae35fba06bc01]) successfully deleted
I20251025 08:02:24.768152 14649 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_eb789fed3e81408b8b688461884e9c5a" } new_table_name: "default.Table_8fd6304d02a6478fa31556344ab157ae" modify_external_catalogs: true
I20251025 08:02:24.770255 15385 ts_tablet_manager.cc:1929] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.770323 15385 log.cc:1199] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/7922e71ecb4546dcb5c196b57ef5d3de
I20251025 08:02:24.770540 15385 ts_tablet_manager.cc:1950] T 7922e71ecb4546dcb5c196b57ef5d3de P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.771852 14653 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_fc8b1dd5aa12482895416350908e36fd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.772141 14653 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fc8b1dd5aa12482895416350908e36fd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.773020 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 7922e71ecb4546dcb5c196b57ef5d3de (table default.Table_8b233422b57e405daba765b7619adfad [id=a5a019b836864161a3da06f611e4272e]) successfully deleted
I20251025 08:02:24.773434 14647 master_service.cc:954] ReplaceTablet: received request to replace tablet 70ac567d5918403093bf71d9d9fc99b9 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.773926 14650 master_service.cc:954] ReplaceTablet: received request to replace tablet f61b7b4e700645a6b3d235dd1bc1c026 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.774397 14654 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_0db7fc431dff4c7f85007159dd715e19 [id=1e1120fd790b44569595d67fea5165c2] alter complete (version 2)
I20251025 08:02:24.775350 15445 consensus_queue.cc:1048] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:24.775859 14649 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1ee00271d2354ae38dcb5a3289cea72f consensus state has no leader
I20251025 08:02:24.776392 14651 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 0fa8e1e7a015466699c3b98dd0647cce
I20251025 08:02:24.777380 14649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_d8110cf18c6748b092f8bf7348349f88"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.777639 14649 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d8110cf18c6748b092f8bf7348349f88 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.778824 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 0fa8e1e7a015466699c3b98dd0647cce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.778882 14648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_2f4e7934dc164dcdadd6467e1afc563a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.779119 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 0fa8e1e7a015466699c3b98dd0647cce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:24.779199 14648 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2f4e7934dc164dcdadd6467e1afc563a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.779386 15388 tablet_replica.cc:333] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.779524 15388 raft_consensus.cc:2243] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.779611 15388 raft_consensus.cc:2272] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.780110 15388 ts_tablet_manager.cc:1916] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.780718 14651 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_bd3b1a4a23a447bead9ce165c79693e6" } modify_external_catalogs: true
I20251025 08:02:24.780798 14651 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_bd3b1a4a23a447bead9ce165c79693e6" } modify_external_catalogs: true
I20251025 08:02:24.781096 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 0fa8e1e7a015466699c3b98dd0647cce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.781267 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 7807e7f1d49c4eda8ab4fa123d0398ac with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.782008 15388 ts_tablet_manager.cc:1929] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.782078 15388 log.cc:1199] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/0fa8e1e7a015466699c3b98dd0647cce
I20251025 08:02:24.782337 15388 ts_tablet_manager.cc:1950] T 0fa8e1e7a015466699c3b98dd0647cce P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.785040 15385 tablet_replica.cc:333] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.786720 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8 (DEFAULT_TABLE table=default.Table_d5f1669745ce40c9afcd65029292ea51 [id=42a26b3ac1e54d518e958e6ea0cf22c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.787416 15385 raft_consensus.cc:2243] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.787523 14646 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 2a0a2af3ed1f41fea41962db52cfe7d8 (table default.Table_0db7fc431dff4c7f85007159dd715e19 [id=1e1120fd790b44569595d67fea5165c2]). Expected version 2 got 0
I20251025 08:02:24.787734 15437 tablet.cc:1722] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:24.788182 14647 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 70ac567d5918403093bf71d9d9fc99b9
I20251025 08:02:24.788455 14647 catalog_manager.cc:6719] ReplaceTablet: tablet 70ac567d5918403093bf71d9d9fc99b9 deleted and replaced by tablet a68d3a248e944a83ba77b651793cc480
I20251025 08:02:24.788740 14650 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet f61b7b4e700645a6b3d235dd1bc1c026
I20251025 08:02:24.788915 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8 (DEFAULT_TABLE table=default.Table_d5f1669745ce40c9afcd65029292ea51 [id=42a26b3ac1e54d518e958e6ea0cf22c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.788980 14650 catalog_manager.cc:6719] ReplaceTablet: tablet f61b7b4e700645a6b3d235dd1bc1c026 deleted and replaced by tablet 834a6c675ac54dbdb5416c683384d96e
I20251025 08:02:24.789089 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 70ac567d5918403093bf71d9d9fc99b9 with delete_type TABLET_DATA_DELETED (replaced by tablet a68d3a248e944a83ba77b651793cc480) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.789180 15409 raft_consensus.cc:493] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.789248 15409 raft_consensus.cc:515] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.789263 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 3eee1563ce444900a96f9f363e92e7ff (DEFAULT_TABLE table=default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.789588 15409 leader_election.cc:290] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.787899 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.790002 15385 raft_consensus.cc:2272] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.790338 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4608033ee2244efda81dd70a5da61c5e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:24.790416 15385 ts_tablet_manager.cc:1916] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.790447 15112 raft_consensus.cc:2468] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:24.790706 15185 leader_election.cc:304] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.790843 15409 raft_consensus.cc:2804] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.790884 15409 raft_consensus.cc:493] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.790917 15409 raft_consensus.cc:3060] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.791710 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet f61b7b4e700645a6b3d235dd1bc1c026 with delete_type TABLET_DATA_DELETED (replaced by tablet 834a6c675ac54dbdb5416c683384d96e) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.791805 15409 raft_consensus.cc:515] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.792137 15409 leader_election.cc:290] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.792852 15224 tablet_service.cc:1505] Processing CreateTablet for tablet dcfb649e699748118ffd4fae0ced9546 (DEFAULT_TABLE table=default.Table_802f081e7d2c4fe4b0d34d798171708d [id=70e669319af14d04b8a3ca13f0c5bd6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.792873 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4608033ee2244efda81dd70a5da61c5e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:24.792891 14649 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_cc4fb27276854f679d49c263e71b51bb" } new_table_name: "default.Table_1ba796ba557f424995193f3cdb6d4dd9" modify_external_catalogs: true
I20251025 08:02:24.792973 15112 raft_consensus.cc:3060] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.793707 15370 tablet_bootstrap.cc:492] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.793776 15370 ts_tablet_manager.cc:1403] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.000s
I20251025 08:02:24.793855 15112 raft_consensus.cc:2468] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:24.794118 15370 raft_consensus.cc:359] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.794232 15370 raft_consensus.cc:385] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.794265 15370 raft_consensus.cc:740] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.794356 15370 consensus_queue.cc:260] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.794569 15370 ts_tablet_manager.cc:1434] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.794693 15370 tablet_bootstrap.cc:492] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.795364 14651 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet a68d3a248e944a83ba77b651793cc480
I20251025 08:02:24.795657 15370 tablet_bootstrap.cc:654] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.796142 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 3eee1563ce444900a96f9f363e92e7ff (DEFAULT_TABLE table=default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.796209 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4608033ee2244efda81dd70a5da61c5e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.796319 14977 raft_consensus.cc:2468] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:24.796348 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eee1563ce444900a96f9f363e92e7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.796510 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4608033ee2244efda81dd70a5da61c5e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:24.796587 14978 raft_consensus.cc:3060] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.796605 14958 tablet_service.cc:1505] Processing CreateTablet for tablet dcfb649e699748118ffd4fae0ced9546 (DEFAULT_TABLE table=default.Table_802f081e7d2c4fe4b0d34d798171708d [id=70e669319af14d04b8a3ca13f0c5bd6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.796803 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcfb649e699748118ffd4fae0ced9546. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.797370 14978 raft_consensus.cc:2468] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:24.798215 15185 leader_election.cc:304] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.796226 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet f61b7b4e700645a6b3d235dd1bc1c026 with delete_type TABLET_DATA_DELETED (replaced by tablet 834a6c675ac54dbdb5416c683384d96e) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.798566 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8 (DEFAULT_TABLE table=default.Table_d5f1669745ce40c9afcd65029292ea51 [id=42a26b3ac1e54d518e958e6ea0cf22c8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.798707 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 0fa8e1e7a015466699c3b98dd0647cce (table default.Table_40e75fd0e39f4ae69856bde4bfd62a45 [id=739dffe08d69409aa126a14a2c413ad5]) successfully deleted
I20251025 08:02:24.798703 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet f61b7b4e700645a6b3d235dd1bc1c026 with delete_type TABLET_DATA_DELETED (replaced by tablet 834a6c675ac54dbdb5416c683384d96e) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.798761 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.799695 15093 tablet_service.cc:1505] Processing CreateTablet for tablet dcfb649e699748118ffd4fae0ced9546 (DEFAULT_TABLE table=default.Table_802f081e7d2c4fe4b0d34d798171708d [id=70e669319af14d04b8a3ca13f0c5bd6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.799875 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcfb649e699748118ffd4fae0ced9546. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.800362 14648 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_8184815f748f4644ae04b4927d72b27b" } new_table_name: "default.Table_4c48d1da14fd4f6db57aaea031a1992e" modify_external_catalogs: true
I20251025 08:02:24.800547 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 3eee1563ce444900a96f9f363e92e7ff (DEFAULT_TABLE table=default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.800740 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eee1563ce444900a96f9f363e92e7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.801014 14650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_717f9ff4ad3846128a0a9136d894cc6a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.801342 14650 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_717f9ff4ad3846128a0a9136d894cc6a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.802076 14653 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_8f781f3f507c4a339ba15100b719fcbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.802372 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 70ac567d5918403093bf71d9d9fc99b9 with delete_type TABLET_DATA_DELETED (replaced by tablet a68d3a248e944a83ba77b651793cc480) from {username='slave'} at 127.0.0.1:37198
W20251025 08:02:24.802390 14653 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f781f3f507c4a339ba15100b719fcbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.802479 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 70ac567d5918403093bf71d9d9fc99b9 with delete_type TABLET_DATA_DELETED (replaced by tablet a68d3a248e944a83ba77b651793cc480) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.802629 14647 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_2d1acf2ab32844f2a253a5d5ab46d842"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.802896 14647 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d1acf2ab32844f2a253a5d5ab46d842 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.803079 14651 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_284c9a7e73f6495991e3883ba509d8c9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.803179 15409 raft_consensus.cc:2804] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.803253 15409 raft_consensus.cc:697] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
W20251025 08:02:24.803360 14651 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_284c9a7e73f6495991e3883ba509d8c9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.803349 15409 consensus_queue.cc:237] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.802155 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_56dd2ffb46cc402fa6a8c180e157a2db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.803937 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_56dd2ffb46cc402fa6a8c180e157a2db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.805518 15376 raft_consensus.cc:493] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.805589 15376 raft_consensus.cc:515] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.805907 15376 leader_election.cc:290] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.806631 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "81e7695e1a0d47c881f2851d97ada61b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.806792 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 932d4e9a5da84d57b92a42b67d1eaab9 (DEFAULT_TABLE table=default.Table_09620cf7ff864ac09cbad24b3ad7b5f7 [id=ff44f0c128c44faa9f36925f9477c66a]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:24.807540 15049 leader_election.cc:343] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.810073 15370 tablet_bootstrap.cc:492] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.810158 15370 ts_tablet_manager.cc:1403] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:24.810376 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 997c8c5921ad4ec18914fd50c97fc33e (DEFAULT_TABLE table=default.Table_e7d81e9e21714341be16ee46af55cde8 [id=cb9294ed7c474aae989ac13159ec3166]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.810552 15385 ts_tablet_manager.cc:1929] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.810609 15385 log.cc:1199] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/0fa8e1e7a015466699c3b98dd0647cce
I20251025 08:02:24.810627 15370 raft_consensus.cc:359] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.810721 15370 raft_consensus.cc:385] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.810758 15370 raft_consensus.cc:740] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.810807 15385 ts_tablet_manager.cc:1950] T 0fa8e1e7a015466699c3b98dd0647cce P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.810870 15370 consensus_queue.cc:260] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.811110 15370 ts_tablet_manager.cc:1434] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.811262 15370 tablet_bootstrap.cc:492] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.811228 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 932d4e9a5da84d57b92a42b67d1eaab9 (DEFAULT_TABLE table=default.Table_09620cf7ff864ac09cbad24b3ad7b5f7 [id=ff44f0c128c44faa9f36925f9477c66a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.811417 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932d4e9a5da84d57b92a42b67d1eaab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.811791 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 997c8c5921ad4ec18914fd50c97fc33e (DEFAULT_TABLE table=default.Table_e7d81e9e21714341be16ee46af55cde8 [id=cb9294ed7c474aae989ac13159ec3166]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.812007 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997c8c5921ad4ec18914fd50c97fc33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.812115 15370 tablet_bootstrap.cc:654] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.812738 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "81e7695e1a0d47c881f2851d97ada61b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.812757 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 932d4e9a5da84d57b92a42b67d1eaab9 (DEFAULT_TABLE table=default.Table_09620cf7ff864ac09cbad24b3ad7b5f7 [id=ff44f0c128c44faa9f36925f9477c66a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.812829 14978 raft_consensus.cc:2468] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:24.812932 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932d4e9a5da84d57b92a42b67d1eaab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.814353 15048 leader_election.cc:304] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.814611 15380 raft_consensus.cc:2804] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.814656 15380 raft_consensus.cc:493] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.814689 15380 raft_consensus.cc:3060] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.815001 15376 raft_consensus.cc:493] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.815060 15376 raft_consensus.cc:515] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.815323 15376 leader_election.cc:290] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.815486 15380 raft_consensus.cc:515] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.815546 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 997c8c5921ad4ec18914fd50c97fc33e (DEFAULT_TABLE table=default.Table_e7d81e9e21714341be16ee46af55cde8 [id=cb9294ed7c474aae989ac13159ec3166]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.815713 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997c8c5921ad4ec18914fd50c97fc33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.815759 15380 leader_election.cc:290] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:24.816349 15245 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5022f9beb59449828f59dca9d14caa50" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.816390 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "81e7695e1a0d47c881f2851d97ada61b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:24.816746 15049 leader_election.cc:343] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:24.816854 15049 leader_election.cc:343] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.817348 15388 tablet_replica.cc:333] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.817322 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 1a9f9a42dbe7402189df59c49b463fad (DEFAULT_TABLE table=default.Table_d6e61e9e78464c9096cbb26d6eb98c2e [id=78794c8ceec3479ca3ac3ef55594762f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.817443 15388 raft_consensus.cc:2243] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.817499 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9f9a42dbe7402189df59c49b463fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.817523 15388 raft_consensus.cc:2272] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.818077 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "81e7695e1a0d47c881f2851d97ada61b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:24.818127 15436 tablet.cc:1722] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:24.818171 14977 raft_consensus.cc:3060] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.818991 14977 raft_consensus.cc:2468] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:24.819233 15388 ts_tablet_manager.cc:1916] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.819278 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5022f9beb59449828f59dca9d14caa50" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:24.819896 15048 leader_election.cc:304] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.820058 15642 raft_consensus.cc:2804] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.820143 15642 raft_consensus.cc:697] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:24.820272 15642 consensus_queue.cc:237] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.820631 15451 tablet.cc:1722] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:24.820914 15388 ts_tablet_manager.cc:1929] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.820976 15388 log.cc:1199] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/f61b7b4e700645a6b3d235dd1bc1c026
I20251025 08:02:24.821151 15388 ts_tablet_manager.cc:1950] T f61b7b4e700645a6b3d235dd1bc1c026 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.822314 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 1a9f9a42dbe7402189df59c49b463fad (DEFAULT_TABLE table=default.Table_d6e61e9e78464c9096cbb26d6eb98c2e [id=78794c8ceec3479ca3ac3ef55594762f]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:24.820143 15048 leader_election.cc:343] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.822957 15048 leader_election.cc:304] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.823410 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet f61b7b4e700645a6b3d235dd1bc1c026 (table default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]) successfully deleted
I20251025 08:02:24.823499 15497 raft_consensus.cc:2749] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.827412 15226 tablet_service.cc:1505] Processing CreateTablet for tablet 3bf26408c98e49298ff9c738a1e26cf9 (DEFAULT_TABLE table=default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.828656 15222 tablet_service.cc:1505] Processing CreateTablet for tablet 2bda60aba9a647019adf715083ce05a5 (DEFAULT_TABLE table=default.Table_3a925a6333c342289286ca5667f5f19d [id=940bf492708245f9b5c7a9b3073a1b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.829092 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 0fa8e1e7a015466699c3b98dd0647cce (table default.Table_40e75fd0e39f4ae69856bde4bfd62a45 [id=739dffe08d69409aa126a14a2c413ad5]) successfully deleted
W20251025 08:02:24.829231 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet f61b7b4e700645a6b3d235dd1bc1c026 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f61b7b4e700645a6b3d235dd1bc1c026 already in progress: creating tablet
I20251025 08:02:24.829692 15221 tablet_service.cc:1505] Processing CreateTablet for tablet c6ee2b8cfe7743d29714910fe8060083 (DEFAULT_TABLE table=default.Table_643cee182de94bbf9718fb59a00cf85c [id=aa46eca7031242f3b4a3144dd521cc6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.830396 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 3bf26408c98e49298ff9c738a1e26cf9 (DEFAULT_TABLE table=default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.830541 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 1a9f9a42dbe7402189df59c49b463fad (DEFAULT_TABLE table=default.Table_d6e61e9e78464c9096cbb26d6eb98c2e [id=78794c8ceec3479ca3ac3ef55594762f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.830587 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf26408c98e49298ff9c738a1e26cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.830700 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9f9a42dbe7402189df59c49b463fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.830886 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 2bda60aba9a647019adf715083ce05a5 (DEFAULT_TABLE table=default.Table_3a925a6333c342289286ca5667f5f19d [id=940bf492708245f9b5c7a9b3073a1b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.831063 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bda60aba9a647019adf715083ce05a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.831146 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 3bf26408c98e49298ff9c738a1e26cf9 (DEFAULT_TABLE table=default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.831334 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf26408c98e49298ff9c738a1e26cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.831302 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 2bda60aba9a647019adf715083ce05a5 (DEFAULT_TABLE table=default.Table_3a925a6333c342289286ca5667f5f19d [id=940bf492708245f9b5c7a9b3073a1b07]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.831465 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bda60aba9a647019adf715083ce05a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.832875 15092 tablet_service.cc:1505] Processing CreateTablet for tablet c6ee2b8cfe7743d29714910fe8060083 (DEFAULT_TABLE table=default.Table_643cee182de94bbf9718fb59a00cf85c [id=aa46eca7031242f3b4a3144dd521cc6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.832929 14959 tablet_service.cc:1505] Processing CreateTablet for tablet c6ee2b8cfe7743d29714910fe8060083 (DEFAULT_TABLE table=default.Table_643cee182de94bbf9718fb59a00cf85c [id=aa46eca7031242f3b4a3144dd521cc6b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.833061 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ee2b8cfe7743d29714910fe8060083. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.833102 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ee2b8cfe7743d29714910fe8060083. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.833783 15372 tablet_bootstrap.cc:492] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.833850 15372 ts_tablet_manager.cc:1403] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.068s user 0.001s sys 0.000s
I20251025 08:02:24.834371 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 97df7606f88c4b59a722f6c0359851d9 (DEFAULT_TABLE table=default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.834565 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97df7606f88c4b59a722f6c0359851d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.834347 15372 raft_consensus.cc:359] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.834782 15372 raft_consensus.cc:385] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.834813 15372 raft_consensus.cc:740] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.834971 15372 consensus_queue.cc:260] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.836549 14655 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 1ee00271d2354ae38dcb5a3289cea72f (table default.Table_8fd6304d02a6478fa31556344ab157ae [id=1ee33ee129d749d0bd7f26dc49fca0fe]). Expected version 2 got 0
I20251025 08:02:24.837167 14655 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_de463c68e4cf4110a906098e963221eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:24.837500 14655 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de463c68e4cf4110a906098e963221eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.837571 15372 ts_tablet_manager.cc:1434] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:24.838284 15220 tablet_service.cc:1505] Processing CreateTablet for tablet 97df7606f88c4b59a722f6c0359851d9 (DEFAULT_TABLE table=default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.838593 15219 tablet_service.cc:1505] Processing CreateTablet for tablet b1ae9934b0ca403ea026233ecd952a20 (DEFAULT_TABLE table=default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.838872 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_c91b6d76e1384dd99d7e69ddee320afb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:24.838951 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 97df7606f88c4b59a722f6c0359851d9 (DEFAULT_TABLE table=default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.838996 15372 tablet_bootstrap.cc:492] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.839071 15777 tablet.cc:1722] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:24.839138 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97df7606f88c4b59a722f6c0359851d9. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:24.839148 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c91b6d76e1384dd99d7e69ddee320afb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:24.839885 15372 tablet_bootstrap.cc:654] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.840138 14649 catalog_manager.cc:5649] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:24.840903 15372 tablet_bootstrap.cc:492] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.840886 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 06b3cc87826249ccb1f84c29df09f802 (DEFAULT_TABLE table=default.Table_98f6b9698b9b45549d8016116c31c85a [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.840994 15372 ts_tablet_manager.cc:1403] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:24.841470 15372 raft_consensus.cc:359] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.841604 15372 raft_consensus.cc:385] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.841641 15372 raft_consensus.cc:740] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.841686 15370 tablet_bootstrap.cc:492] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.841756 15370 ts_tablet_manager.cc:1403] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20251025 08:02:24.841747 15372 consensus_queue.cc:260] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.842149 15370 raft_consensus.cc:359] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.842276 15370 raft_consensus.cc:385] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.842306 15370 raft_consensus.cc:740] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.842398 15370 consensus_queue.cc:260] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.842654 15370 ts_tablet_manager.cc:1434] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.842809 15370 tablet_bootstrap.cc:492] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.843317 15372 ts_tablet_manager.cc:1434] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:24.843616 15370 tablet_bootstrap.cc:654] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.844262 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 06b3cc87826249ccb1f84c29df09f802 (DEFAULT_TABLE table=default.Table_98f6b9698b9b45549d8016116c31c85a [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.844369 15370 tablet_bootstrap.cc:492] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.844442 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b3cc87826249ccb1f84c29df09f802. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.844641 15370 ts_tablet_manager.cc:1403] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:24.845171 15370 raft_consensus.cc:359] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.845270 15370 raft_consensus.cc:385] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.845299 15370 raft_consensus.cc:740] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.845394 15370 consensus_queue.cc:260] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.845634 15370 ts_tablet_manager.cc:1434] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.845775 15370 tablet_bootstrap.cc:492] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.845778 15372 tablet_bootstrap.cc:492] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.846724 15091 tablet_service.cc:1505] Processing CreateTablet for tablet b1ae9934b0ca403ea026233ecd952a20 (DEFAULT_TABLE table=default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.847055 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ae9934b0ca403ea026233ecd952a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.847160 15372 tablet_bootstrap.cc:654] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.847922 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 06b3cc87826249ccb1f84c29df09f802 (DEFAULT_TABLE table=default.Table_98f6b9698b9b45549d8016116c31c85a [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.848129 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b3cc87826249ccb1f84c29df09f802. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.848776 14955 tablet_service.cc:1505] Processing CreateTablet for tablet b1ae9934b0ca403ea026233ecd952a20 (DEFAULT_TABLE table=default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.848958 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ae9934b0ca403ea026233ecd952a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.848934 15384 raft_consensus.cc:493] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.849012 15384 raft_consensus.cc:515] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.849314 15384 leader_election.cc:290] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:24.850947 15183 leader_election.cc:343] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 0fa8e1e7a015466699c3b98dd0647cce
W20251025 08:02:24.851049 15185 leader_election.cc:343] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 0fa8e1e7a015466699c3b98dd0647cce
I20251025 08:02:24.851122 15185 leader_election.cc:304] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:24.851199 15370 tablet_bootstrap.cc:654] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.851271 15384 raft_consensus.cc:2749] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.852334 15372 tablet_bootstrap.cc:492] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.852411 15372 ts_tablet_manager.cc:1403] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251025 08:02:24.852888 15372 raft_consensus.cc:359] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.852983 15372 raft_consensus.cc:385] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.853016 15372 raft_consensus.cc:740] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.853137 15372 consensus_queue.cc:260] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.853358 15372 ts_tablet_manager.cc:1434] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:24.853510 15372 tablet_bootstrap.cc:492] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.854323 15372 tablet_bootstrap.cc:654] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.856714 14648 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_09620cf7ff864ac09cbad24b3ad7b5f7" } new_table_name: "default.Table_096e271857534077bea9b8e03894dfe0" modify_external_catalogs: true
I20251025 08:02:24.858361 14647 master_service.cc:954] ReplaceTablet: received request to replace tablet 4608033ee2244efda81dd70a5da61c5e from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.858952 14650 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_802f081e7d2c4fe4b0d34d798171708d" } modify_external_catalogs: true
I20251025 08:02:24.859038 14650 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_802f081e7d2c4fe4b0d34d798171708d" } modify_external_catalogs: true
I20251025 08:02:24.860422 14653 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_ab1d4169df5a4c438c761aaabe15488e" } modify_external_catalogs: true
I20251025 08:02:24.860476 15451 tablet.cc:1722] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.860517 14653 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_ab1d4169df5a4c438c761aaabe15488e" } modify_external_catalogs: true
I20251025 08:02:24.860991 15370 tablet_bootstrap.cc:492] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.861058 15370 ts_tablet_manager.cc:1403] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251025 08:02:24.861470 15370 raft_consensus.cc:359] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.861575 15370 raft_consensus.cc:385] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.861613 15370 raft_consensus.cc:740] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.861598 14651 master_service.cc:954] ReplaceTablet: received request to replace tablet 1a9f9a42dbe7402189df59c49b463fad from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.861713 15370 consensus_queue.cc:260] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.861959 15370 ts_tablet_manager.cc:1434] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.862345 15370 tablet_bootstrap.cc:492] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.862758 15436 tablet.cc:1722] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.863217 15370 tablet_bootstrap.cc:654] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.866583 15464 raft_consensus.cc:493] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.866653 15464 raft_consensus.cc:515] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.866930 15464 leader_election.cc:290] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.867304 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "54ea861dbc8c46129df50fc5060739b3" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:24.867424 15248 raft_consensus.cc:2468] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.867676 14914 leader_election.cc:304] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.867888 15464 raft_consensus.cc:2804] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:24.867938 15464 raft_consensus.cc:493] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:24.867986 15464 raft_consensus.cc:3060] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.868772 15464 raft_consensus.cc:515] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.869079 15464 leader_election.cc:290] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.869735 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "54ea861dbc8c46129df50fc5060739b3" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:24.869829 15113 raft_consensus.cc:2468] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:24.875849 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "54ea861dbc8c46129df50fc5060739b3" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:24.875944 15248 raft_consensus.cc:3060] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.876806 15248 raft_consensus.cc:2468] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.877125 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 932d4e9a5da84d57b92a42b67d1eaab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.877269 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06b3cc87826249ccb1f84c29df09f802. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.877393 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eee1563ce444900a96f9f363e92e7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.877570 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1ae9934b0ca403ea026233ecd952a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.877730 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcfb649e699748118ffd4fae0ced9546. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.877919 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bda60aba9a647019adf715083ce05a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.879762 15372 tablet_bootstrap.cc:492] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.879817 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 997c8c5921ad4ec18914fd50c97fc33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.879829 15372 ts_tablet_manager.cc:1403] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20251025 08:02:24.880270 15372 raft_consensus.cc:359] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.880344 15372 raft_consensus.cc:385] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.880369 15372 raft_consensus.cc:740] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.880458 15372 consensus_queue.cc:260] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.880663 15372 ts_tablet_manager.cc:1434] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:24.880797 15372 tablet_bootstrap.cc:492] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.881471 15220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97df7606f88c4b59a722f6c0359851d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.881574 15372 tablet_bootstrap.cc:654] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.882800 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bf26408c98e49298ff9c738a1e26cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.883458 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.884374 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a9f9a42dbe7402189df59c49b463fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.885221 15221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6ee2b8cfe7743d29714910fe8060083. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.889606 14914 leader_election.cc:304] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:24.890547 15386 ts_tablet_manager.cc:1929] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.890609 15386 log.cc:1199] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/2757cfa1345c4085b232e93ec32c8188
I20251025 08:02:24.893800 14646 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_88cacd70c6c14947b18a8d94bc761229" } new_table_name: "default.Table_e650e0b918954a7f8c97ff7e8e9bcffd" modify_external_catalogs: true
I20251025 08:02:24.894145 15464 raft_consensus.cc:2804] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:24.894243 15464 raft_consensus.cc:697] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
W20251025 08:02:24.894367 14648 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 932d4e9a5da84d57b92a42b67d1eaab9 consensus state has no leader
I20251025 08:02:24.894363 15464 consensus_queue.cc:237] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.894501 14648 master_service.cc:954] ReplaceTablet: received request to replace tablet 3eee1563ce444900a96f9f363e92e7ff from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:24.897389 14650 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet dcfb649e699748118ffd4fae0ced9546
I20251025 08:02:24.897979 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet dcfb649e699748118ffd4fae0ced9546 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:24.899644 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet dcfb649e699748118ffd4fae0ced9546 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dcfb649e699748118ffd4fae0ced9546 already in progress: creating tablet
I20251025 08:02:24.900697 15384 raft_consensus.cc:493] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.900775 15384 raft_consensus.cc:515] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.901124 15384 leader_election.cc:290] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:24.901280 14653 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 3f7aa0b88b284d52a6cca064a798aa54
I20251025 08:02:24.901976 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 3f7aa0b88b284d52a6cca064a798aa54 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.902048 15386 ts_tablet_manager.cc:1950] T 2757cfa1345c4085b232e93ec32c8188 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.902122 15388 tablet_replica.cc:333] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.902261 15388 raft_consensus.cc:2243] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.902323 15220 tablet_service.cc:1552] Processing DeleteTablet for tablet 3f7aa0b88b284d52a6cca064a798aa54 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
W20251025 08:02:24.902048 15185 leader_election.cc:343] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 7807e7f1d49c4eda8ab4fa123d0398ac
I20251025 08:02:24.902442 15388 raft_consensus.cc:2272] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.902590 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet dcfb649e699748118ffd4fae0ced9546 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.902851 15388 ts_tablet_manager.cc:1916] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.904759 15388 ts_tablet_manager.cc:1929] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.904831 15388 log.cc:1199] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/3f7aa0b88b284d52a6cca064a798aa54
I20251025 08:02:24.905079 15388 ts_tablet_manager.cc:1950] T 3f7aa0b88b284d52a6cca064a798aa54 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.906280 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 3f7aa0b88b284d52a6cca064a798aa54 (table default.Table_ab1d4169df5a4c438c761aaabe15488e [id=cead87820a99412e936796998d2150dc]) successfully deleted
I20251025 08:02:24.906282 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "54ea861dbc8c46129df50fc5060739b3" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:24.906380 15113 raft_consensus.cc:3060] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:24.907243 15113 raft_consensus.cc:2468] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:24.908919 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 3f7aa0b88b284d52a6cca064a798aa54 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.908984 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet dcfb649e699748118ffd4fae0ced9546 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.909112 15385 tablet_replica.cc:333] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
W20251025 08:02:24.909112 15183 leader_election.cc:343] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 7807e7f1d49c4eda8ab4fa123d0398ac
I20251025 08:02:24.909178 15183 leader_election.cc:304] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:24.909222 15385 raft_consensus.cc:2243] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.909329 15385 raft_consensus.cc:2272] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.909354 15384 raft_consensus.cc:2749] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.909816 15385 ts_tablet_manager.cc:1916] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.909832 15783 tablet.cc:1722] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:24.911787 15385 ts_tablet_manager.cc:1929] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.911859 15385 log.cc:1199] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/3f7aa0b88b284d52a6cca064a798aa54
I20251025 08:02:24.912286 15385 ts_tablet_manager.cc:1950] T 3f7aa0b88b284d52a6cca064a798aa54 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.912997 15219 tablet_service.cc:1505] Processing CreateTablet for tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65 (DEFAULT_TABLE table=default.Table_2f4e7934dc164dcdadd6467e1afc563a [id=4f1a1f84f436411db166b8c28873a27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.913224 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.914623 14654 catalog_manager.cc:5649] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:24.915580 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 834a6c675ac54dbdb5416c683384d96e (DEFAULT_TABLE table=default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.915611 14652 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_1ba796ba557f424995193f3cdb6d4dd9 [id=bb1d4aea5e9c4907a826f763e2c62707] alter complete (version 2)
I20251025 08:02:24.915803 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 834a6c675ac54dbdb5416c683384d96e. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:24.916538 14646 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 81e7695e1a0d47c881f2851d97ada61b consensus state has no leader
I20251025 08:02:24.917943 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65 (DEFAULT_TABLE table=default.Table_2f4e7934dc164dcdadd6467e1afc563a [id=4f1a1f84f436411db166b8c28873a27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.918074 15093 tablet_service.cc:1505] Processing CreateTablet for tablet c1a10ef5ab73459695e1ef772e3a5266 (DEFAULT_TABLE table=default.Table_d8110cf18c6748b092f8bf7348349f88 [id=53d57abf556c4926b02a1e265cf34c61]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.918151 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.918363 15092 tablet_service.cc:1505] Processing CreateTablet for tablet a12f1428ccda4cef8c00a34630f2e54e (DEFAULT_TABLE table=default.Table_fc8b1dd5aa12482895416350908e36fd [id=eaba715cb2c74aca915cf7d374ee17a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.918680 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 834a6c675ac54dbdb5416c683384d96e (DEFAULT_TABLE table=default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.919135 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a10ef5ab73459695e1ef772e3a5266. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.919217 15227 tablet_service.cc:1505] Processing CreateTablet for tablet c1a10ef5ab73459695e1ef772e3a5266 (DEFAULT_TABLE table=default.Table_d8110cf18c6748b092f8bf7348349f88 [id=53d57abf556c4926b02a1e265cf34c61]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.919296 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12f1428ccda4cef8c00a34630f2e54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.919440 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a10ef5ab73459695e1ef772e3a5266. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.921095 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 834a6c675ac54dbdb5416c683384d96e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.921497 14649 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_299767dfd96a4890bd29ca0bb43b79aa" } modify_external_catalogs: true
I20251025 08:02:24.921582 14649 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_299767dfd96a4890bd29ca0bb43b79aa" } modify_external_catalogs: true
I20251025 08:02:24.922250 15642 raft_consensus.cc:493] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:24.922323 15642 raft_consensus.cc:515] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.922680 15642 leader_election.cc:290] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:24.923389 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c20947edc1f24e338cabf72b18282d24" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:24.923693 15048 leader_election.cc:343] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.924340 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c20947edc1f24e338cabf72b18282d24" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:24.924635 15049 leader_election.cc:343] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:24.924691 15049 leader_election.cc:304] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:24.924876 15642 raft_consensus.cc:2749] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:24.925698 14646 catalog_manager.cc:5649] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:24.926131 14647 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 4608033ee2244efda81dd70a5da61c5e
I20251025 08:02:24.926426 14647 catalog_manager.cc:6719] ReplaceTablet: tablet 4608033ee2244efda81dd70a5da61c5e deleted and replaced by tablet 4dd72f76c950485c968409fe868266a2
I20251025 08:02:24.926785 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 4608033ee2244efda81dd70a5da61c5e with delete_type TABLET_DATA_DELETED (replaced by tablet 4dd72f76c950485c968409fe868266a2) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.926980 15219 tablet_service.cc:1505] Processing CreateTablet for tablet a12f1428ccda4cef8c00a34630f2e54e (DEFAULT_TABLE table=default.Table_fc8b1dd5aa12482895416350908e36fd [id=eaba715cb2c74aca915cf7d374ee17a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.927196 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12f1428ccda4cef8c00a34630f2e54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.927488 15388 tablet_replica.cc:333] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.927613 15388 raft_consensus.cc:2243] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.927693 15388 raft_consensus.cc:2272] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.927999 15388 ts_tablet_manager.cc:1916] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.929328 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet 4608033ee2244efda81dd70a5da61c5e with delete_type TABLET_DATA_DELETED (replaced by tablet 4dd72f76c950485c968409fe868266a2) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.929678 15388 ts_tablet_manager.cc:1929] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.929741 15388 log.cc:1199] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/4608033ee2244efda81dd70a5da61c5e
I20251025 08:02:24.929924 15388 ts_tablet_manager.cc:1950] T 4608033ee2244efda81dd70a5da61c5e P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.931106 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 4608033ee2244efda81dd70a5da61c5e (table default.Table_ba3e2cf8a7ab42a890554e661cd69684 [id=b9853b2d88cf4a96b9fc5e1099f87064]) successfully deleted
I20251025 08:02:24.934336 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 3f7aa0b88b284d52a6cca064a798aa54 (table default.Table_ab1d4169df5a4c438c761aaabe15488e [id=cead87820a99412e936796998d2150dc]) successfully deleted
I20251025 08:02:24.934350 14959 tablet_service.cc:1505] Processing CreateTablet for tablet a12f1428ccda4cef8c00a34630f2e54e (DEFAULT_TABLE table=default.Table_fc8b1dd5aa12482895416350908e36fd [id=eaba715cb2c74aca915cf7d374ee17a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.934350 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65 (DEFAULT_TABLE table=default.Table_2f4e7934dc164dcdadd6467e1afc563a [id=4f1a1f84f436411db166b8c28873a27b]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:24.934499 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet dcfb649e699748118ffd4fae0ced9546 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dcfb649e699748118ffd4fae0ced9546 already in progress: creating tablet
I20251025 08:02:24.934618 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a12f1428ccda4cef8c00a34630f2e54e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.934710 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 2757cfa1345c4085b232e93ec32c8188 (table default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]) successfully deleted
I20251025 08:02:24.934741 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.934891 15386 tablet_replica.cc:333] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.935010 15386 raft_consensus.cc:2243] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.935093 15386 raft_consensus.cc:2272] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.935139 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 834a6c675ac54dbdb5416c683384d96e (DEFAULT_TABLE table=default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.935355 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 834a6c675ac54dbdb5416c683384d96e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.936154 15370 tablet_bootstrap.cc:492] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.936237 15370 ts_tablet_manager.cc:1403] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.074s user 0.001s sys 0.000s
I20251025 08:02:24.936733 15370 raft_consensus.cc:359] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.936829 15370 raft_consensus.cc:385] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.936862 15370 raft_consensus.cc:740] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.936981 15370 consensus_queue.cc:260] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.937279 15370 ts_tablet_manager.cc:1434] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.937436 15370 tablet_bootstrap.cc:492] T 5b49d48b94b0427aa2dcc39dae45a4eb P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.938385 15370 tablet_bootstrap.cc:654] T 5b49d48b94b0427aa2dcc39dae45a4eb P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.938766 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 4608033ee2244efda81dd70a5da61c5e with delete_type TABLET_DATA_DELETED (replaced by tablet 4dd72f76c950485c968409fe868266a2) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.938903 15385 tablet_replica.cc:333] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.939002 15385 raft_consensus.cc:2243] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.939093 15385 raft_consensus.cc:2272] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.939292 15386 ts_tablet_manager.cc:1916] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.940150 15385 ts_tablet_manager.cc:1916] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.941043 14958 tablet_service.cc:1505] Processing CreateTablet for tablet c1a10ef5ab73459695e1ef772e3a5266 (DEFAULT_TABLE table=default.Table_d8110cf18c6748b092f8bf7348349f88 [id=53d57abf556c4926b02a1e265cf34c61]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.941241 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a10ef5ab73459695e1ef772e3a5266. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.941984 15385 ts_tablet_manager.cc:1929] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.942073 15385 log.cc:1199] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/4608033ee2244efda81dd70a5da61c5e
I20251025 08:02:24.942219 15386 ts_tablet_manager.cc:1929] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.942281 15385 ts_tablet_manager.cc:1950] T 4608033ee2244efda81dd70a5da61c5e P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.942289 15386 log.cc:1199] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/d9067b563519468ca71ebfcc738462b9
I20251025 08:02:24.942490 15386 ts_tablet_manager.cc:1950] T d9067b563519468ca71ebfcc738462b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.942890 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 4608033ee2244efda81dd70a5da61c5e (table default.Table_ba3e2cf8a7ab42a890554e661cd69684 [id=b9853b2d88cf4a96b9fc5e1099f87064]) successfully deleted
I20251025 08:02:24.943264 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet d9067b563519468ca71ebfcc738462b9 (table default.Table_4a5a1f334fef444b959ee1c82ed0d5a0 [id=33c97f69fa104ce1bff69626847a5b68]) successfully deleted
I20251025 08:02:24.943476 15386 tablet_replica.cc:333] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.943594 15386 raft_consensus.cc:2243] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.943701 15386 raft_consensus.cc:2272] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.944641 14648 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 3eee1563ce444900a96f9f363e92e7ff
I20251025 08:02:24.944868 14648 catalog_manager.cc:6719] ReplaceTablet: tablet 3eee1563ce444900a96f9f363e92e7ff deleted and replaced by tablet dfb4a050022d462699005fedc4323fdb
I20251025 08:02:24.945089 14651 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 1a9f9a42dbe7402189df59c49b463fad
I20251025 08:02:24.945374 14651 catalog_manager.cc:6719] ReplaceTablet: tablet 1a9f9a42dbe7402189df59c49b463fad deleted and replaced by tablet 76a906654cc44bfb96d9e1a936040e57
I20251025 08:02:24.945590 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 3eee1563ce444900a96f9f363e92e7ff with delete_type TABLET_DATA_DELETED (replaced by tablet dfb4a050022d462699005fedc4323fdb) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.945721 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 1a9f9a42dbe7402189df59c49b463fad with delete_type TABLET_DATA_DELETED (replaced by tablet 76a906654cc44bfb96d9e1a936040e57) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:24.946748 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 3eee1563ce444900a96f9f363e92e7ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3eee1563ce444900a96f9f363e92e7ff already in progress: creating tablet
W20251025 08:02:24.946861 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 1a9f9a42dbe7402189df59c49b463fad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a9f9a42dbe7402189df59c49b463fad already in progress: creating tablet
I20251025 08:02:24.947108 15370 tablet_bootstrap.cc:492] T 5b49d48b94b0427aa2dcc39dae45a4eb P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.947183 15370 ts_tablet_manager.cc:1403] T 5b49d48b94b0427aa2dcc39dae45a4eb P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:24.947572 15370 raft_consensus.cc:359] T 5b49d48b94b0427aa2dcc39dae45a4eb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.947657 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 1a9f9a42dbe7402189df59c49b463fad with delete_type TABLET_DATA_DELETED (replaced by tablet 76a906654cc44bfb96d9e1a936040e57) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.947674 15370 raft_consensus.cc:385] T 5b49d48b94b0427aa2dcc39dae45a4eb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.947711 15370 raft_consensus.cc:740] T 5b49d48b94b0427aa2dcc39dae45a4eb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.947834 15370 consensus_queue.cc:260] T 5b49d48b94b0427aa2dcc39dae45a4eb P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.948076 15370 ts_tablet_manager.cc:1434] T 5b49d48b94b0427aa2dcc39dae45a4eb P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.948258 15370 tablet_bootstrap.cc:492] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:24.948405 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 1a9f9a42dbe7402189df59c49b463fad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a9f9a42dbe7402189df59c49b463fad already in progress: creating tablet
I20251025 08:02:24.949149 15370 tablet_bootstrap.cc:654] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.951679 15369 tablet_bootstrap.cc:492] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.951761 15369 ts_tablet_manager.cc:1403] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.208s user 0.000s sys 0.002s
I20251025 08:02:24.952178 15369 raft_consensus.cc:359] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.952260 14649 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 5b4028f5238f4c428648893618587a37
I20251025 08:02:24.952306 15369 raft_consensus.cc:385] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.952337 15369 raft_consensus.cc:740] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.952436 15369 consensus_queue.cc:260] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.952698 15369 ts_tablet_manager.cc:1434] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:24.952862 15369 tablet_bootstrap.cc:492] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.953318 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 5b4028f5238f4c428648893618587a37 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.953492 15388 tablet_replica.cc:333] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.953594 15388 raft_consensus.cc:2243] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.953678 15388 raft_consensus.cc:2272] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.953766 15369 tablet_bootstrap.cc:654] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.953943 15388 ts_tablet_manager.cc:1916] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.954136 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 5b4028f5238f4c428648893618587a37 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.954285 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet 3eee1563ce444900a96f9f363e92e7ff with delete_type TABLET_DATA_DELETED (replaced by tablet dfb4a050022d462699005fedc4323fdb) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.955020 15219 tablet_service.cc:1552] Processing DeleteTablet for tablet 1a9f9a42dbe7402189df59c49b463fad with delete_type TABLET_DATA_DELETED (replaced by tablet 76a906654cc44bfb96d9e1a936040e57) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:24.955160 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 5b4028f5238f4c428648893618587a37 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.955238 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 3eee1563ce444900a96f9f363e92e7ff with delete_type TABLET_DATA_DELETED (replaced by tablet dfb4a050022d462699005fedc4323fdb) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:24.955462 15386 ts_tablet_manager.cc:1916] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.955845 15388 ts_tablet_manager.cc:1929] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:24.955870 15370 tablet_bootstrap.cc:492] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.955899 15388 log.cc:1199] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/5b4028f5238f4c428648893618587a37
I20251025 08:02:24.955926 15370 ts_tablet_manager.cc:1403] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251025 08:02:24.956122 15388 ts_tablet_manager.cc:1950] T 5b4028f5238f4c428648893618587a37 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.956226 15370 raft_consensus.cc:359] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.956310 15370 raft_consensus.cc:385] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.956341 15370 raft_consensus.cc:740] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.956441 15370 consensus_queue.cc:260] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.956661 15370 ts_tablet_manager.cc:1434] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.956861 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 5b4028f5238f4c428648893618587a37 (table default.Table_299767dfd96a4890bd29ca0bb43b79aa [id=5f9d1d9d2f904f94b00324cca656cb17]) successfully deleted
I20251025 08:02:24.957072 15370 tablet_bootstrap.cc:492] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.957962 15370 tablet_bootstrap.cc:654] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.959309 14647 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 35eb28e4cabf4e59b8245fa3adc57872 (table default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]). Expected version 3 got 0
I20251025 08:02:24.962103 15385 tablet_replica.cc:333] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:24.962253 15385 raft_consensus.cc:2243] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:24.962401 15385 raft_consensus.cc:2272] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.963904 15385 ts_tablet_manager.cc:1916] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.965277 15386 ts_tablet_manager.cc:1929] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:24.965343 15386 log.cc:1199] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/7922e71ecb4546dcb5c196b57ef5d3de
I20251025 08:02:24.965564 15386 ts_tablet_manager.cc:1950] T 7922e71ecb4546dcb5c196b57ef5d3de P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.965546 15385 ts_tablet_manager.cc:1929] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:24.965610 15385 log.cc:1199] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/5b4028f5238f4c428648893618587a37
I20251025 08:02:24.965848 15385 ts_tablet_manager.cc:1950] T 5b4028f5238f4c428648893618587a37 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:24.966023 15386 tablet_replica.cc:333] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.966104 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 7922e71ecb4546dcb5c196b57ef5d3de (table default.Table_8b233422b57e405daba765b7619adfad [id=a5a019b836864161a3da06f611e4272e]) successfully deleted
I20251025 08:02:24.966133 15386 raft_consensus.cc:2243] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.966243 15386 raft_consensus.cc:2272] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.966539 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 5b4028f5238f4c428648893618587a37 (table default.Table_299767dfd96a4890bd29ca0bb43b79aa [id=5f9d1d9d2f904f94b00324cca656cb17]) successfully deleted
W20251025 08:02:24.966703 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 3eee1563ce444900a96f9f363e92e7ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3eee1563ce444900a96f9f363e92e7ff already in progress: creating tablet
I20251025 08:02:24.966858 15369 tablet_bootstrap.cc:492] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.966934 15369 ts_tablet_manager.cc:1403] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20251025 08:02:24.967339 15369 raft_consensus.cc:359] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.967429 15369 raft_consensus.cc:385] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.967459 15369 raft_consensus.cc:740] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.967558 15369 consensus_queue.cc:260] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.967825 15369 ts_tablet_manager.cc:1434] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.967921 15386 ts_tablet_manager.cc:1916] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.968009 15369 tablet_bootstrap.cc:492] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.968890 15369 tablet_bootstrap.cc:654] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.969791 15370 tablet_bootstrap.cc:492] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.969873 15370 ts_tablet_manager.cc:1403] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20251025 08:02:24.969969 15386 ts_tablet_manager.cc:1929] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.970031 15386 log.cc:1199] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/fe4f4c8c26804aee8e45926f60b8da79
I20251025 08:02:24.970320 15370 raft_consensus.cc:359] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.970414 15370 raft_consensus.cc:385] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.970459 15370 raft_consensus.cc:740] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.970569 15370 consensus_queue.cc:260] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.970911 15386 ts_tablet_manager.cc:1950] T fe4f4c8c26804aee8e45926f60b8da79 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.971212 15372 tablet_bootstrap.cc:492] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:24.971283 15372 ts_tablet_manager.cc:1403] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.091s user 0.001s sys 0.000s
I20251025 08:02:24.971402 15386 tablet_replica.cc:333] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.971509 15386 raft_consensus.cc:2243] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.971657 15372 raft_consensus.cc:359] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.971748 15372 raft_consensus.cc:385] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.971781 15372 raft_consensus.cc:740] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.971801 15386 raft_consensus.cc:2272] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.971884 15372 consensus_queue.cc:260] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.972175 15372 ts_tablet_manager.cc:1434] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.972345 15372 tablet_bootstrap.cc:492] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:24.972759 15386 ts_tablet_manager.cc:1916] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.973104 15372 tablet_bootstrap.cc:654] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.974210 14646 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_4c48d1da14fd4f6db57aaea031a1992e [id=215b7ed86cf7422b826890834307b839] alter complete (version 1)
I20251025 08:02:24.974390 15370 ts_tablet_manager.cc:1434] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:24.974531 15386 ts_tablet_manager.cc:1929] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.974561 15370 tablet_bootstrap.cc:492] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.974587 15386 log.cc:1199] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/0fa8e1e7a015466699c3b98dd0647cce
I20251025 08:02:24.974815 15386 ts_tablet_manager.cc:1950] T 0fa8e1e7a015466699c3b98dd0647cce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:24.974928 15247 raft_consensus.cc:3060] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:24.974965 14647 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet 35eb28e4cabf4e59b8245fa3adc57872 (table default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6], current schema version=3): Not found: failed to reset TS proxy: No leader found: Tablet 35eb28e4cabf4e59b8245fa3adc57872 consensus state has no leader
I20251025 08:02:24.975273 15386 tablet_replica.cc:333] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:24.975288 15370 tablet_bootstrap.cc:654] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.975379 15386 raft_consensus.cc:2243] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.975492 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 70ac567d5918403093bf71d9d9fc99b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.975610 15386 raft_consensus.cc:2272] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.975868 15247 raft_consensus.cc:1275] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.976190 15370 tablet_bootstrap.cc:492] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:24.976255 15370 ts_tablet_manager.cc:1403] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:24.976279 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet fe4f4c8c26804aee8e45926f60b8da79 (table default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]) successfully deleted
I20251025 08:02:24.976332 15369 tablet_bootstrap.cc:492] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:24.976397 15369 ts_tablet_manager.cc:1403] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251025 08:02:24.976620 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 0fa8e1e7a015466699c3b98dd0647cce (table default.Table_40e75fd0e39f4ae69856bde4bfd62a45 [id=739dffe08d69409aa126a14a2c413ad5]) successfully deleted
I20251025 08:02:24.976598 15370 raft_consensus.cc:359] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.976684 15370 raft_consensus.cc:385] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.976714 15370 raft_consensus.cc:740] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.976802 15370 consensus_queue.cc:260] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:24.976840 15369 raft_consensus.cc:359] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.976933 15369 raft_consensus.cc:385] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:24.976965 15369 raft_consensus.cc:740] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:24.977037 15370 ts_tablet_manager.cc:1434] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:24.977085 15369 consensus_queue.cc:260] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:24.977238 15388 tablet_replica.cc:333] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.977327 15369 ts_tablet_manager.cc:1434] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:24.977329 15388 raft_consensus.cc:2243] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.977409 15388 raft_consensus.cc:2272] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.977789 15388 ts_tablet_manager.cc:1916] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.978474 15642 consensus_queue.cc:1048] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.979578 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 4134d50b613748fd9291ff245047af33 (DEFAULT_TABLE table=default.Table_de463c68e4cf4110a906098e963221eb [id=1686afc032714790a429b58ea8c0e5b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.980332 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet dcfb649e699748118ffd4fae0ced9546 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.980811 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 56263217eaaf4bb9a48a822061ddb369 (DEFAULT_TABLE table=default.Table_c91b6d76e1384dd99d7e69ddee320afb [id=244c5edd72af4af790d96dd294e8d8c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.981257 14649 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_1ba796ba557f424995193f3cdb6d4dd9" } modify_external_catalogs: true
I20251025 08:02:24.981353 15369 tablet_bootstrap.cc:492] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:24.981371 15388 ts_tablet_manager.cc:1929] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.981369 14649 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_1ba796ba557f424995193f3cdb6d4dd9" } modify_external_catalogs: true
I20251025 08:02:24.981419 15388 log.cc:1199] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/70ac567d5918403093bf71d9d9fc99b9
I20251025 08:02:24.981621 15388 ts_tablet_manager.cc:1950] T 70ac567d5918403093bf71d9d9fc99b9 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.982052 15388 tablet_replica.cc:333] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.982141 15388 raft_consensus.cc:2243] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.982154 14959 tablet_service.cc:1505] Processing CreateTablet for tablet e3cd7b63fa174ee192ff909f149e8b17 (DEFAULT_TABLE table=default.Table_284c9a7e73f6495991e3883ba509d8c9 [id=425e69ea7f8a407e8d22b735ee62c709]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.982254 15388 raft_consensus.cc:2272] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.982347 14978 raft_consensus.cc:1275] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:24.982753 15388 ts_tablet_manager.cc:1916] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.982983 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 071220f7bd334f5aad733209193244d4 (DEFAULT_TABLE table=default.Table_717f9ff4ad3846128a0a9136d894cc6a [id=c571a9bdb4d14249a27b401b9c02f644]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.983494 15497 consensus_queue.cc:1048] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:24.983618 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 4134d50b613748fd9291ff245047af33 (DEFAULT_TABLE table=default.Table_de463c68e4cf4110a906098e963221eb [id=1686afc032714790a429b58ea8c0e5b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.983645 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 70ac567d5918403093bf71d9d9fc99b9 (table default.Table_bd3b1a4a23a447bead9ce165c79693e6 [id=000ce64aa9d14e45ae6570f8948bb0a3]) successfully deleted
I20251025 08:02:24.983832 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4134d50b613748fd9291ff245047af33. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.984143 15369 tablet_bootstrap.cc:654] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.984933 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4134d50b613748fd9291ff245047af33. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.986845 15388 ts_tablet_manager.cc:1929] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:24.986917 15388 log.cc:1199] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/dcfb649e699748118ffd4fae0ced9546
I20251025 08:02:24.986899 15386 ts_tablet_manager.cc:1916] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:24.987116 15388 ts_tablet_manager.cc:1950] T dcfb649e699748118ffd4fae0ced9546 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:24.987223 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3cd7b63fa174ee192ff909f149e8b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.987504 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 56263217eaaf4bb9a48a822061ddb369 (DEFAULT_TABLE table=default.Table_c91b6d76e1384dd99d7e69ddee320afb [id=244c5edd72af4af790d96dd294e8d8c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.987709 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56263217eaaf4bb9a48a822061ddb369. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.988286 15219 tablet_service.cc:1505] Processing CreateTablet for tablet 4134d50b613748fd9291ff245047af33 (DEFAULT_TABLE table=default.Table_de463c68e4cf4110a906098e963221eb [id=1686afc032714790a429b58ea8c0e5b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.988487 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4134d50b613748fd9291ff245047af33. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.988654 15370 tablet_bootstrap.cc:492] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:24.989456 15370 tablet_bootstrap.cc:654] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:24.989580 15092 tablet_service.cc:1505] Processing CreateTablet for tablet e3cd7b63fa174ee192ff909f149e8b17 (DEFAULT_TABLE table=default.Table_284c9a7e73f6495991e3883ba509d8c9 [id=425e69ea7f8a407e8d22b735ee62c709]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.989784 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3cd7b63fa174ee192ff909f149e8b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.990559 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 56263217eaaf4bb9a48a822061ddb369 (DEFAULT_TABLE table=default.Table_c91b6d76e1384dd99d7e69ddee320afb [id=244c5edd72af4af790d96dd294e8d8c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.990713 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 3743a9de419d40689c49aae471edfa01 (DEFAULT_TABLE table=default.Table_56dd2ffb46cc402fa6a8c180e157a2db [id=7956205ae4e9408988c3d82c46db1706]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.990765 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56263217eaaf4bb9a48a822061ddb369. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.990778 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 90bb43eb01c949b09f7a4c703a99dc7e (DEFAULT_TABLE table=default.Table_2d1acf2ab32844f2a253a5d5ab46d842 [id=3abdeeb0fca0413d8af86b1c0ad383b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.990916 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3743a9de419d40689c49aae471edfa01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.991104 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 88052f79558a42eeb1c8acf44e6b48e1 (DEFAULT_TABLE table=default.Table_8f781f3f507c4a339ba15100b719fcbb [id=2283253a9522485d93d6c484c5eef6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.991295 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88052f79558a42eeb1c8acf44e6b48e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.991679 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 3eee1563ce444900a96f9f363e92e7ff with delete_type TABLET_DATA_DELETED (replaced by tablet dfb4a050022d462699005fedc4323fdb) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:24.992026 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 071220f7bd334f5aad733209193244d4 (DEFAULT_TABLE table=default.Table_717f9ff4ad3846128a0a9136d894cc6a [id=c571a9bdb4d14249a27b401b9c02f644]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.992210 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071220f7bd334f5aad733209193244d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.992674 15218 tablet_service.cc:1505] Processing CreateTablet for tablet e3cd7b63fa174ee192ff909f149e8b17 (DEFAULT_TABLE table=default.Table_284c9a7e73f6495991e3883ba509d8c9 [id=425e69ea7f8a407e8d22b735ee62c709]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.992880 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3cd7b63fa174ee192ff909f149e8b17. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.993059 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bb43eb01c949b09f7a4c703a99dc7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.994113 14654 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_e7d81e9e21714341be16ee46af55cde8" } new_table_name: "default.Table_a210a38e85814b3db16726f2a0a830b8" modify_external_catalogs: true
I20251025 08:02:24.994380 15221 tablet_service.cc:1505] Processing CreateTablet for tablet 071220f7bd334f5aad733209193244d4 (DEFAULT_TABLE table=default.Table_717f9ff4ad3846128a0a9136d894cc6a [id=c571a9bdb4d14249a27b401b9c02f644]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.994580 15221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071220f7bd334f5aad733209193244d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.996487 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 3743a9de419d40689c49aae471edfa01 (DEFAULT_TABLE table=default.Table_56dd2ffb46cc402fa6a8c180e157a2db [id=7956205ae4e9408988c3d82c46db1706]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.996675 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3743a9de419d40689c49aae471edfa01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.997495 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 071220f7bd334f5aad733209193244d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.998155 14649 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet d8d2d5d7676f4b8096d10781cb0e5fce
I20251025 08:02:24.998498 15388 tablet_replica.cc:333] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:24.998543 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 90bb43eb01c949b09f7a4c703a99dc7e (DEFAULT_TABLE table=default.Table_2d1acf2ab32844f2a253a5d5ab46d842 [id=3abdeeb0fca0413d8af86b1c0ad383b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:24.998603 15388 raft_consensus.cc:2243] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:24.998689 15388 raft_consensus.cc:2272] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:24.998732 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bb43eb01c949b09f7a4c703a99dc7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:24.999442 14649 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_cccb10034b9549bc84a9019610866553" } modify_external_catalogs: true
I20251025 08:02:24.999531 14649 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_cccb10034b9549bc84a9019610866553" } modify_external_catalogs: true
I20251025 08:02:24.999861 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56263217eaaf4bb9a48a822061ddb369. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.000628 15226 tablet_service.cc:1505] Processing CreateTablet for tablet 88052f79558a42eeb1c8acf44e6b48e1 (DEFAULT_TABLE table=default.Table_8f781f3f507c4a339ba15100b719fcbb [id=2283253a9522485d93d6c484c5eef6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.000834 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88052f79558a42eeb1c8acf44e6b48e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.001767 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_d88bbb52c74f4ce29cbf53120c30a02c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.002082 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d88bbb52c74f4ce29cbf53120c30a02c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:25.002336 14654 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 997c8c5921ad4ec18914fd50c97fc33e consensus state has no leader
I20251025 08:02:25.002807 15388 ts_tablet_manager.cc:1916] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.002926 15384 raft_consensus.cc:493] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.003008 15384 raft_consensus.cc:515] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.003271 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet dcfb649e699748118ffd4fae0ced9546 (table default.Table_802f081e7d2c4fe4b0d34d798171708d [id=70e669319af14d04b8a3ca13f0c5bd6e]) successfully deleted
I20251025 08:02:25.003338 15384 leader_election.cc:290] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.003641 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.003842 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet d8d2d5d7676f4b8096d10781cb0e5fce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:25.003927 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.005036 14647 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_4c672efab2bb448ab1dcfd4325e8c053"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.005175 15388 ts_tablet_manager.cc:1929] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.005244 15388 log.cc:1199] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/3eee1563ce444900a96f9f363e92e7ff
W20251025 08:02:25.005332 14647 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c672efab2bb448ab1dcfd4325e8c053 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.005429 15388 ts_tablet_manager.cc:1950] T 3eee1563ce444900a96f9f363e92e7ff P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.005564 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5022f9beb59449828f59dca9d14caa50" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.005658 15113 raft_consensus.cc:2468] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:25.005755 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 3eee1563ce444900a96f9f363e92e7ff (table default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]) successfully deleted
I20251025 08:02:25.005905 15185 leader_election.cc:304] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:25.005981 15388 tablet_replica.cc:333] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.006062 15384 raft_consensus.cc:2804] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.006121 15384 raft_consensus.cc:493] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.006162 15384 raft_consensus.cc:3060] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.006863 15388 raft_consensus.cc:2243] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:25.007038 15388 raft_consensus.cc:2272] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.007476 15388 ts_tablet_manager.cc:1916] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.008287 15384 raft_consensus.cc:515] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.008647 15384 leader_election.cc:290] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.009687 15369 tablet_bootstrap.cc:492] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.009682 15388 ts_tablet_manager.cc:1929] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:25.009744 15388 log.cc:1199] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/d8d2d5d7676f4b8096d10781cb0e5fce
I20251025 08:02:25.009763 15369 ts_tablet_manager.cc:1403] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20251025 08:02:25.010003 15388 ts_tablet_manager.cc:1950] T d8d2d5d7676f4b8096d10781cb0e5fce P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.010267 15369 raft_consensus.cc:359] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.010368 15369 raft_consensus.cc:385] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.010401 15369 raft_consensus.cc:740] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.010422 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5022f9beb59449828f59dca9d14caa50" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:25.010519 15113 raft_consensus.cc:3060] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.010521 15369 consensus_queue.cc:260] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.010571 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet d8d2d5d7676f4b8096d10781cb0e5fce (table default.Table_1ba796ba557f424995193f3cdb6d4dd9 [id=bb1d4aea5e9c4907a826f763e2c62707]) successfully deleted
I20251025 08:02:25.010799 15369 ts_tablet_manager.cc:1434] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.010787 14652 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_3e2c7c94e9d94339863b1848f4d0bb6c" } new_table_name: "default.Table_94e6d6f804c346ce97b427caf864614e" modify_external_catalogs: true
I20251025 08:02:25.010977 15369 tablet_bootstrap.cc:492] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.011329 15113 raft_consensus.cc:2468] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:25.011478 14653 master_service.cc:954] ReplaceTablet: received request to replace tablet 10ef8618965e438cbf6fafc0533c9bfc from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.011669 15185 leader_election.cc:304] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:25.011811 15384 raft_consensus.cc:2804] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.011888 15384 raft_consensus.cc:697] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:25.011902 15369 tablet_bootstrap.cc:654] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.011998 15384 consensus_queue.cc:237] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.012359 14648 master_service.cc:954] ReplaceTablet: received request to replace tablet 56263217eaaf4bb9a48a822061ddb369 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.013500 14651 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 81e7695e1a0d47c881f2851d97ada61b (table default.Table_e650e0b918954a7f8c97ff7e8e9bcffd [id=dfe9146b50254c54ad1b75080a2ee201]). Expected version 1 got 0
I20251025 08:02:25.015683 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5022f9beb59449828f59dca9d14caa50" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:25.015784 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 3743a9de419d40689c49aae471edfa01 (DEFAULT_TABLE table=default.Table_56dd2ffb46cc402fa6a8c180e157a2db [id=7956205ae4e9408988c3d82c46db1706]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.015836 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5022f9beb59449828f59dca9d14caa50" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.015956 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 88052f79558a42eeb1c8acf44e6b48e1 (DEFAULT_TABLE table=default.Table_8f781f3f507c4a339ba15100b719fcbb [id=2283253a9522485d93d6c484c5eef6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.016008 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3743a9de419d40689c49aae471edfa01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.015837 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 90bb43eb01c949b09f7a4c703a99dc7e (DEFAULT_TABLE table=default.Table_2d1acf2ab32844f2a253a5d5ab46d842 [id=3abdeeb0fca0413d8af86b1c0ad383b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.016156 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88052f79558a42eeb1c8acf44e6b48e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.016387 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90bb43eb01c949b09f7a4c703a99dc7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.017928 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet d8d2d5d7676f4b8096d10781cb0e5fce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.015784 14979 raft_consensus.cc:3060] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.018093 15385 tablet_replica.cc:333] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.018240 15385 raft_consensus.cc:2243] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.018328 15385 raft_consensus.cc:2272] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.018779 15497 raft_consensus.cc:493] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.018843 14979 raft_consensus.cc:2468] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:25.018859 15497 raft_consensus.cc:515] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.019155 15385 ts_tablet_manager.cc:1916] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.019178 15497 leader_election.cc:290] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:25.019668 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a70808199034508833e4d2e5550b29b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.019770 15248 raft_consensus.cc:2468] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:25.020128 15049 leader_election.cc:304] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:25.020416 15497 raft_consensus.cc:2804] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.020462 15497 raft_consensus.cc:493] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.020498 15497 raft_consensus.cc:3060] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.021091 15385 ts_tablet_manager.cc:1929] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:25.021150 15385 log.cc:1199] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/d8d2d5d7676f4b8096d10781cb0e5fce
I20251025 08:02:25.021390 15385 ts_tablet_manager.cc:1950] T d8d2d5d7676f4b8096d10781cb0e5fce P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.021337 15497 raft_consensus.cc:515] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.021673 15497 leader_election.cc:290] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:25.022150 14647 catalog_manager.cc:5649] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.022423 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 4dd72f76c950485c968409fe868266a2 (DEFAULT_TABLE table=default.Table_ba3e2cf8a7ab42a890554e661cd69684 [id=b9853b2d88cf4a96b9fc5e1099f87064]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.022644 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd72f76c950485c968409fe868266a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.022737 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a70808199034508833e4d2e5550b29b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.022835 14979 raft_consensus.cc:2468] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:25.022888 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a70808199034508833e4d2e5550b29b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:25.022989 14976 raft_consensus.cc:3060] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.023178 15369 tablet_bootstrap.cc:492] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.023258 15369 ts_tablet_manager.cc:1403] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20251025 08:02:25.023597 15369 raft_consensus.cc:359] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.023660 15369 raft_consensus.cc:385] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.023679 15369 raft_consensus.cc:740] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.023770 15369 consensus_queue.cc:260] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.023828 14976 raft_consensus.cc:2468] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:25.023991 15369 ts_tablet_manager.cc:1434] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:25.024122 15369 tablet_bootstrap.cc:492] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.024847 15369 tablet_bootstrap.cc:654] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.024861 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet d8d2d5d7676f4b8096d10781cb0e5fce with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.024871 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a70808199034508833e4d2e5550b29b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:25.025058 15248 raft_consensus.cc:3060] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.025404 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 76a906654cc44bfb96d9e1a936040e57 (DEFAULT_TABLE table=default.Table_d6e61e9e78464c9096cbb26d6eb98c2e [id=78794c8ceec3479ca3ac3ef55594762f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.025610 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a906654cc44bfb96d9e1a936040e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.025694 15048 leader_election.cc:304] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.025745 15091 tablet_service.cc:1505] Processing CreateTablet for tablet dfb4a050022d462699005fedc4323fdb (DEFAULT_TABLE table=default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.025928 15248 raft_consensus.cc:2468] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:25.025965 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb4a050022d462699005fedc4323fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.026834 15226 tablet_service.cc:1505] Processing CreateTablet for tablet 76a906654cc44bfb96d9e1a936040e57 (DEFAULT_TABLE table=default.Table_d6e61e9e78464c9096cbb26d6eb98c2e [id=78794c8ceec3479ca3ac3ef55594762f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.027070 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a906654cc44bfb96d9e1a936040e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.027189 14646 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 81e7695e1a0d47c881f2851d97ada61b (table default.Table_e650e0b918954a7f8c97ff7e8e9bcffd [id=dfe9146b50254c54ad1b75080a2ee201]). Expected version 1 got 0
I20251025 08:02:25.027267 15642 raft_consensus.cc:2804] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.027346 15642 raft_consensus.cc:697] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:25.027444 15642 consensus_queue.cc:237] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.027956 15642 consensus_queue.cc:1048] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.028334 15369 tablet_bootstrap.cc:492] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.028407 15369 ts_tablet_manager.cc:1403] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:25.028805 15369 raft_consensus.cc:359] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.028898 15369 raft_consensus.cc:385] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.028934 15369 raft_consensus.cc:740] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.029023 15369 consensus_queue.cc:260] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.029320 15369 ts_tablet_manager.cc:1434] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:25.029482 15369 tablet_bootstrap.cc:492] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.029597 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 4dd72f76c950485c968409fe868266a2 (DEFAULT_TABLE table=default.Table_ba3e2cf8a7ab42a890554e661cd69684 [id=b9853b2d88cf4a96b9fc5e1099f87064]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.029790 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd72f76c950485c968409fe868266a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.030390 15369 tablet_bootstrap.cc:654] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.031615 15369 tablet_bootstrap.cc:492] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.031689 15369 ts_tablet_manager.cc:1403] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:25.031968 14646 catalog_manager.cc:5649] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:25.032087 15369 raft_consensus.cc:359] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.032155 15369 raft_consensus.cc:385] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.032172 15369 raft_consensus.cc:740] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.032266 15369 consensus_queue.cc:260] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.032488 15369 ts_tablet_manager.cc:1434] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:25.032642 15369 tablet_bootstrap.cc:492] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.032648 15218 tablet_service.cc:1505] Processing CreateTablet for tablet dfb4a050022d462699005fedc4323fdb (DEFAULT_TABLE table=default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.032847 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb4a050022d462699005fedc4323fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.033516 15369 tablet_bootstrap.cc:654] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.034525 15369 tablet_bootstrap.cc:492] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.034605 15369 ts_tablet_manager.cc:1403] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:25.034803 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 4dd72f76c950485c968409fe868266a2 (DEFAULT_TABLE table=default.Table_ba3e2cf8a7ab42a890554e661cd69684 [id=b9853b2d88cf4a96b9fc5e1099f87064]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.034945 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 76a906654cc44bfb96d9e1a936040e57 (DEFAULT_TABLE table=default.Table_d6e61e9e78464c9096cbb26d6eb98c2e [id=78794c8ceec3479ca3ac3ef55594762f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.034977 14955 tablet_service.cc:1505] Processing CreateTablet for tablet dfb4a050022d462699005fedc4323fdb (DEFAULT_TABLE table=default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.035002 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4dd72f76c950485c968409fe868266a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.035459 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76a906654cc44bfb96d9e1a936040e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.035501 15369 raft_consensus.cc:359] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.035586 15369 raft_consensus.cc:385] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.035617 15369 raft_consensus.cc:740] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.035703 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet d8d2d5d7676f4b8096d10781cb0e5fce (table default.Table_1ba796ba557f424995193f3cdb6d4dd9 [id=bb1d4aea5e9c4907a826f763e2c62707]) successfully deleted
I20251025 08:02:25.035722 15369 consensus_queue.cc:260] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.035946 15369 ts_tablet_manager.cc:1434] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20251025 08:02:25.036592 14652 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5022f9beb59449828f59dca9d14caa50 consensus state has no leader
I20251025 08:02:25.038029 15369 tablet_bootstrap.cc:492] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.038030 15497 raft_consensus.cc:493] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.038105 15497 raft_consensus.cc:515] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.038447 15497 leader_election.cc:290] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.038573 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet f61b7b4e700645a6b3d235dd1bc1c026 with delete_type TABLET_DATA_DELETED (replaced by tablet 834a6c675ac54dbdb5416c683384d96e) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.038936 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35eb28e4cabf4e59b8245fa3adc57872" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:25.039237 15049 leader_election.cc:343] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.039371 15385 tablet_replica.cc:333] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.039475 15385 raft_consensus.cc:2243] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.039569 15385 raft_consensus.cc:2272] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.039733 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35eb28e4cabf4e59b8245fa3adc57872" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.039875 15369 tablet_bootstrap.cc:654] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.040170 15385 ts_tablet_manager.cc:1916] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:25.040560 15048 leader_election.cc:343] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.040633 15048 leader_election.cc:304] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.040766 15497 raft_consensus.cc:2749] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.041069 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfb4a050022d462699005fedc4323fdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.042726 14653 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 10ef8618965e438cbf6fafc0533c9bfc
I20251025 08:02:25.043030 14653 catalog_manager.cc:6719] ReplaceTablet: tablet 10ef8618965e438cbf6fafc0533c9bfc deleted and replaced by tablet 01d9f6636b364e3b9192ae546422de5b
I20251025 08:02:25.043967 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 10ef8618965e438cbf6fafc0533c9bfc with delete_type TABLET_DATA_DELETED (replaced by tablet 01d9f6636b364e3b9192ae546422de5b) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.044914 14648 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 56263217eaaf4bb9a48a822061ddb369
I20251025 08:02:25.045176 14648 catalog_manager.cc:6719] ReplaceTablet: tablet 56263217eaaf4bb9a48a822061ddb369 deleted and replaced by tablet a8393462039d4bb4aba66aee9e90b94a
I20251025 08:02:25.045498 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 56263217eaaf4bb9a48a822061ddb369 with delete_type TABLET_DATA_DELETED (replaced by tablet a8393462039d4bb4aba66aee9e90b94a) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.045672 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 10ef8618965e438cbf6fafc0533c9bfc with delete_type TABLET_DATA_DELETED (replaced by tablet 01d9f6636b364e3b9192ae546422de5b) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.045747 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 56263217eaaf4bb9a48a822061ddb369 with delete_type TABLET_DATA_DELETED (replaced by tablet a8393462039d4bb4aba66aee9e90b94a) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.045816 14649 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 1127507b5fd54fe0b1a7e7edf936bc38
I20251025 08:02:25.046139 15386 ts_tablet_manager.cc:1929] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.046237 15388 tablet_replica.cc:333] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.046245 15386 log.cc:1199] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/7807e7f1d49c4eda8ab4fa123d0398ac
I20251025 08:02:25.046363 15388 raft_consensus.cc:2243] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.046373 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 1127507b5fd54fe0b1a7e7edf936bc38 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.046466 15386 ts_tablet_manager.cc:1950] T 7807e7f1d49c4eda8ab4fa123d0398ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.046470 15388 raft_consensus.cc:2272] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.046715 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 1127507b5fd54fe0b1a7e7edf936bc38 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.047343 15372 tablet_bootstrap.cc:492] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.047421 15372 ts_tablet_manager.cc:1403] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.075s user 0.001s sys 0.000s
I20251025 08:02:25.047453 15388 ts_tablet_manager.cc:1916] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.047858 15372 raft_consensus.cc:359] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.047937 15372 raft_consensus.cc:385] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.047974 15372 raft_consensus.cc:740] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.048184 15370 tablet_bootstrap.cc:492] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.048269 15370 ts_tablet_manager.cc:1403] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.000s
I20251025 08:02:25.048331 15372 consensus_queue.cc:260] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.048687 15370 raft_consensus.cc:359] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.048785 15370 raft_consensus.cc:385] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.048821 15370 raft_consensus.cc:740] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.048933 15370 consensus_queue.cc:260] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.049377 15388 ts_tablet_manager.cc:1929] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.049437 15388 log.cc:1199] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/10ef8618965e438cbf6fafc0533c9bfc
I20251025 08:02:25.049633 15388 ts_tablet_manager.cc:1950] T 10ef8618965e438cbf6fafc0533c9bfc P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.050153 15372 ts_tablet_manager.cc:1434] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:25.051081 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 7807e7f1d49c4eda8ab4fa123d0398ac (table default.Table_d91ac83609a0452680e6ef9a726b5f31 [id=d1011dde28dd4c37975ae35fba06bc01]) successfully deleted
W20251025 08:02:25.051280 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet f61b7b4e700645a6b3d235dd1bc1c026 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f61b7b4e700645a6b3d235dd1bc1c026 already in progress: creating tablet
I20251025 08:02:25.051306 15436 tablet.cc:1722] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.051494 15372 tablet_bootstrap.cc:492] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.051546 15412 mvcc.cc:204] Tried to move back new op lower bound from 7214609797000396800 to 7214609796385062912. Current Snapshot: MvccSnapshot[applied={T|T < 7214609797000396800}]
I20251025 08:02:25.051702 15388 tablet_replica.cc:333] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.051792 15380 consensus_queue.cc:1048] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.051798 15388 raft_consensus.cc:2243] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.052196 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 10ef8618965e438cbf6fafc0533c9bfc (table default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]) successfully deleted
W20251025 08:02:25.052358 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 56263217eaaf4bb9a48a822061ddb369 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56263217eaaf4bb9a48a822061ddb369 already in progress: creating tablet
I20251025 08:02:25.052038 15388 raft_consensus.cc:2272] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.054616 15388 ts_tablet_manager.cc:1916] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.055787 15783 tablet.cc:1722] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.056108 15429 mvcc.cc:204] Tried to move back new op lower bound from 7214609797000396800 to 7214609796385062912. Current Snapshot: MvccSnapshot[applied={T|T < 7214609797000396800}]
I20251025 08:02:25.056363 15388 ts_tablet_manager.cc:1929] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.056420 15388 log.cc:1199] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/1127507b5fd54fe0b1a7e7edf936bc38
I20251025 08:02:25.056509 14649 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 932d4e9a5da84d57b92a42b67d1eaab9 (table default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a]). Expected version 1 got 0
I20251025 08:02:25.056598 15388 ts_tablet_manager.cc:1950] T 1127507b5fd54fe0b1a7e7edf936bc38 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.057080 15370 ts_tablet_manager.cc:1434] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:25.057261 15370 tablet_bootstrap.cc:492] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.057437 14648 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_d88bbb52c74f4ce29cbf53120c30a02c" } new_table_name: "default.Table_c9b9d2656f0d49138409d36e78f0d77f" modify_external_catalogs: true
I20251025 08:02:25.058166 15370 tablet_bootstrap.cc:654] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.058617 15372 tablet_bootstrap.cc:654] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.058787 15451 tablet.cc:1722] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.059435 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_7a2d41df4f9d4874b3403fdef1ae1e72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.059782 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a2d41df4f9d4874b3403fdef1ae1e72 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.060360 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 10ef8618965e438cbf6fafc0533c9bfc with delete_type TABLET_DATA_DELETED (replaced by tablet 01d9f6636b364e3b9192ae546422de5b) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.060591 15226 tablet_service.cc:1552] Processing DeleteTablet for tablet 1127507b5fd54fe0b1a7e7edf936bc38 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.061039 14653 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_7814293c383d4c8dbb1d384665c7c381"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.061323 14653 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7814293c383d4c8dbb1d384665c7c381 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.062181 15445 raft_consensus.cc:493] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.062387 15445 raft_consensus.cc:515] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.062634 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 56263217eaaf4bb9a48a822061ddb369 with delete_type TABLET_DATA_DELETED (replaced by tablet a8393462039d4bb4aba66aee9e90b94a) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.062723 15445 leader_election.cc:290] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.062794 14652 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 932d4e9a5da84d57b92a42b67d1eaab9 (table default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a]). Expected version 1 got 0
I20251025 08:02:25.063863 14650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_b2214744ef8c4a4cb1c28ab1689ddbdb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.064170 14650 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2214744ef8c4a4cb1c28ab1689ddbdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.064729 14651 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_4a4b1eeaa5674710a1a13d7f0f395737"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.065035 14651 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4a4b1eeaa5674710a1a13d7f0f395737 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.065276 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0553b245e4404132b0bfe178bf4074c3" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.065596 15386 tablet_replica.cc:333] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
W20251025 08:02:25.065593 14914 leader_election.cc:343] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.065725 15386 raft_consensus.cc:2243] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.065783 15497 raft_consensus.cc:493] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.065848 15497 raft_consensus.cc:515] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.065913 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0553b245e4404132b0bfe178bf4074c3" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.065997 15113 raft_consensus.cc:2468] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:25.065961 14649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_6a446944f6d94a81bea892d25a3ed54e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.066138 15497 leader_election.cc:290] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:25.066287 14649 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a446944f6d94a81bea892d25a3ed54e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:25.067068 14648 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e54e57e850564e079db3dd383347ed30 has no consensus state
I20251025 08:02:25.068115 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ee00271d2354ae38dcb5a3289cea72f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.068245 14978 raft_consensus.cc:2468] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:25.066606 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ee00271d2354ae38dcb5a3289cea72f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.065831 15386 raft_consensus.cc:2272] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.068631 15385 ts_tablet_manager.cc:1929] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.068706 15385 log.cc:1199] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/f61b7b4e700645a6b3d235dd1bc1c026
W20251025 08:02:25.068704 15049 leader_election.cc:343] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.068912 15385 ts_tablet_manager.cc:1950] T f61b7b4e700645a6b3d235dd1bc1c026 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.069034 14915 leader_election.cc:304] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.069188 15445 raft_consensus.cc:2804] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.069228 15445 raft_consensus.cc:493] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.069265 15445 raft_consensus.cc:3060] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.069444 15385 tablet_replica.cc:333] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.069459 15386 ts_tablet_manager.cc:1916] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.069530 15385 raft_consensus.cc:2243] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.069597 15385 raft_consensus.cc:2272] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.069729 15048 leader_election.cc:304] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.071000 15385 ts_tablet_manager.cc:1916] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.071329 15445 raft_consensus.cc:515] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.071377 14652 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_e650e0b918954a7f8c97ff7e8e9bcffd [id=dfe9146b50254c54ad1b75080a2ee201] alter complete (version 1)
I20251025 08:02:25.071645 15445 leader_election.cc:290] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.071839 15497 raft_consensus.cc:2804] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.071905 15497 raft_consensus.cc:493] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.071946 15497 raft_consensus.cc:3060] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.072077 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0553b245e4404132b0bfe178bf4074c3" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:25.072397 14914 leader_election.cc:343] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.072575 15386 ts_tablet_manager.cc:1929] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.072638 15386 log.cc:1199] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/3f7aa0b88b284d52a6cca064a798aa54
I20251025 08:02:25.072641 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 1127507b5fd54fe0b1a7e7edf936bc38 (table default.Table_cccb10034b9549bc84a9019610866553 [id=3a6fcff5488b4ee698661c7e51f754ea]) successfully deleted
I20251025 08:02:25.072835 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0553b245e4404132b0bfe178bf4074c3" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:25.072863 15497 raft_consensus.cc:515] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.072922 15113 raft_consensus.cc:3060] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.073164 15497 leader_election.cc:290] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.073850 15113 raft_consensus.cc:2468] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:25.074239 14915 leader_election.cc:304] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.074433 15372 tablet_bootstrap.cc:492] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.074429 15445 raft_consensus.cc:2804] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.074496 15445 raft_consensus.cc:697] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:25.074502 15372 ts_tablet_manager.cc:1403] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20251025 08:02:25.074599 15445 consensus_queue.cc:237] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.074928 15372 raft_consensus.cc:359] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.075028 15372 raft_consensus.cc:385] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.075062 15372 raft_consensus.cc:740] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.075052 15385 ts_tablet_manager.cc:1929] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.075182 15372 consensus_queue.cc:260] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.075114 15385 log.cc:1199] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/10ef8618965e438cbf6fafc0533c9bfc
I20251025 08:02:25.075588 15385 ts_tablet_manager.cc:1950] T 10ef8618965e438cbf6fafc0533c9bfc P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.075623 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ee00271d2354ae38dcb5a3289cea72f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:25.075709 14978 raft_consensus.cc:3060] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.076131 15385 tablet_replica.cc:333] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.076238 15385 raft_consensus.cc:2243] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.076314 15385 raft_consensus.cc:2272] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.076488 14978 raft_consensus.cc:2468] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:25.076707 15385 ts_tablet_manager.cc:1916] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.076789 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ee00271d2354ae38dcb5a3289cea72f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:25.077320 15049 leader_election.cc:343] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.077551 15372 ts_tablet_manager.cc:1434] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:25.077754 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet f61b7b4e700645a6b3d235dd1bc1c026 (table default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]) successfully deleted
I20251025 08:02:25.077827 15372 tablet_bootstrap.cc:492] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.077945 15048 leader_election.cc:304] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.078305 15497 raft_consensus.cc:2804] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.078397 15497 raft_consensus.cc:697] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:25.078400 15385 ts_tablet_manager.cc:1929] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.078473 15385 log.cc:1199] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/1127507b5fd54fe0b1a7e7edf936bc38
I20251025 08:02:25.078511 15497 consensus_queue.cc:237] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.078648 15385 ts_tablet_manager.cc:1950] T 1127507b5fd54fe0b1a7e7edf936bc38 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.079973 15369 tablet_bootstrap.cc:492] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.080068 15369 ts_tablet_manager.cc:1403] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.000s
I20251025 08:02:25.080500 15369 raft_consensus.cc:359] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.080586 15369 raft_consensus.cc:385] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.080614 15369 raft_consensus.cc:740] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.080700 15369 consensus_queue.cc:260] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.080928 15369 ts_tablet_manager.cc:1434] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:25.081075 15369 tablet_bootstrap.cc:492] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.081907 15369 tablet_bootstrap.cc:654] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.083890 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 10ef8618965e438cbf6fafc0533c9bfc (table default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]) successfully deleted
W20251025 08:02:25.084072 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 56263217eaaf4bb9a48a822061ddb369 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56263217eaaf4bb9a48a822061ddb369 already in progress: creating tablet
I20251025 08:02:25.084594 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 1127507b5fd54fe0b1a7e7edf936bc38 (table default.Table_cccb10034b9549bc84a9019610866553 [id=3a6fcff5488b4ee698661c7e51f754ea]) successfully deleted
I20251025 08:02:25.084654 15369 tablet_bootstrap.cc:492] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.084717 15369 ts_tablet_manager.cc:1403] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20251025 08:02:25.085094 15369 raft_consensus.cc:359] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.085180 15369 raft_consensus.cc:385] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.085220 15369 raft_consensus.cc:740] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.085309 15369 consensus_queue.cc:260] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.085537 15369 ts_tablet_manager.cc:1434] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.085690 15369 tablet_bootstrap.cc:492] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.086608 15369 tablet_bootstrap.cc:654] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.086709 14654 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 0553b245e4404132b0bfe178bf4074c3 (table default.Table_10d54e05b641473088190175b4007184 [id=10b5567973c2480ab51946feb2be997b]). Expected version 2 got 0
I20251025 08:02:25.087646 14647 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 0553b245e4404132b0bfe178bf4074c3 (table default.Table_10d54e05b641473088190175b4007184 [id=10b5567973c2480ab51946feb2be997b]). Expected version 2 got 0
I20251025 08:02:25.089388 15369 tablet_bootstrap.cc:492] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.089473 15369 ts_tablet_manager.cc:1403] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20251025 08:02:25.089900 15369 raft_consensus.cc:359] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.090016 15369 raft_consensus.cc:385] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.090058 15369 raft_consensus.cc:740] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.090157 15369 consensus_queue.cc:260] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.090451 15369 ts_tablet_manager.cc:1434] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.090602 15369 tablet_bootstrap.cc:492] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.091461 15369 tablet_bootstrap.cc:654] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.091425 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 080d77feb2a242959fb8e375f07e5a5f (DEFAULT_TABLE table=default.Table_4c672efab2bb448ab1dcfd4325e8c053 [id=0db3af0dc90e4ea5ac9a029e3864ce58]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.091696 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 080d77feb2a242959fb8e375f07e5a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.092032 14957 tablet_service.cc:1505] Processing CreateTablet for tablet fc5f892ca7a246a28a556fe0eb3f5442 (DEFAULT_TABLE table=default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b [id=4e47e7759fc64598807f1ee3a973820f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.092231 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc5f892ca7a246a28a556fe0eb3f5442. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.092283 15091 tablet_service.cc:1505] Processing CreateTablet for tablet fc5f892ca7a246a28a556fe0eb3f5442 (DEFAULT_TABLE table=default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b [id=4e47e7759fc64598807f1ee3a973820f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.092497 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc5f892ca7a246a28a556fe0eb3f5442. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.093641 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet f61b7b4e700645a6b3d235dd1bc1c026 with delete_type TABLET_DATA_DELETED (replaced by tablet 834a6c675ac54dbdb5416c683384d96e) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.094519 14959 tablet_service.cc:1505] Processing CreateTablet for tablet e54e57e850564e079db3dd383347ed30 (DEFAULT_TABLE table=default.Table_c9b9d2656f0d49138409d36e78f0d77f [id=3e1281c3f28346a4a1dd2c4fcc990a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.094623 15094 tablet_service.cc:1505] Processing CreateTablet for tablet e54e57e850564e079db3dd383347ed30 (DEFAULT_TABLE table=default.Table_c9b9d2656f0d49138409d36e78f0d77f [id=3e1281c3f28346a4a1dd2c4fcc990a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.094733 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54e57e850564e079db3dd383347ed30. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.094808 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54e57e850564e079db3dd383347ed30. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.094769 15218 tablet_service.cc:1505] Processing CreateTablet for tablet e54e57e850564e079db3dd383347ed30 (DEFAULT_TABLE table=default.Table_c9b9d2656f0d49138409d36e78f0d77f [id=3e1281c3f28346a4a1dd2c4fcc990a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.094769 15372 tablet_bootstrap.cc:654] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.095018 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e54e57e850564e079db3dd383347ed30. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.096300 15386 ts_tablet_manager.cc:1950] T 3f7aa0b88b284d52a6cca064a798aa54 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.096684 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 080d77feb2a242959fb8e375f07e5a5f (DEFAULT_TABLE table=default.Table_4c672efab2bb448ab1dcfd4325e8c053 [id=0db3af0dc90e4ea5ac9a029e3864ce58]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.096905 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 080d77feb2a242959fb8e375f07e5a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.096830 14650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_78eba044a7854773aa0165c81e4c819f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.097050 15226 tablet_service.cc:1505] Processing CreateTablet for tablet fc5f892ca7a246a28a556fe0eb3f5442 (DEFAULT_TABLE table=default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b [id=4e47e7759fc64598807f1ee3a973820f]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:25.097185 14650 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78eba044a7854773aa0165c81e4c819f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.097249 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc5f892ca7a246a28a556fe0eb3f5442. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.097375 15386 tablet_replica.cc:333] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.097505 15386 raft_consensus.cc:2243] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:25.097620 15386 pending_rounds.cc:70] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 1 pending ops.
I20251025 08:02:25.097642 15386 pending_rounds.cc:77] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609796315754496 op_type: NO_OP noop_request { }
I20251025 08:02:25.097688 15386 raft_consensus.cc:2889] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:25.097729 15386 raft_consensus.cc:2272] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.097918 14651 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_98f6b9698b9b45549d8016116c31c85a" } new_table_name: "default.Table_f5bf4f0664c44a70aa6d2f0e9143f7a7" modify_external_catalogs: true
I20251025 08:02:25.098731 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 080d77feb2a242959fb8e375f07e5a5f (DEFAULT_TABLE table=default.Table_4c672efab2bb448ab1dcfd4325e8c053 [id=0db3af0dc90e4ea5ac9a029e3864ce58]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.098943 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 080d77feb2a242959fb8e375f07e5a5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.099200 15370 tablet_bootstrap.cc:492] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.099282 15370 ts_tablet_manager.cc:1403] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.042s user 0.000s sys 0.002s
I20251025 08:02:25.099756 15370 raft_consensus.cc:359] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.099866 15370 raft_consensus.cc:385] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.099900 15370 raft_consensus.cc:740] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.100020 15370 consensus_queue.cc:260] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.100310 15370 ts_tablet_manager.cc:1434] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.100344 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet f61b7b4e700645a6b3d235dd1bc1c026 with delete_type TABLET_DATA_DELETED (replaced by tablet 834a6c675ac54dbdb5416c683384d96e) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.100513 15370 tablet_bootstrap.cc:492] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.101478 15370 tablet_bootstrap.cc:654] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.101672 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 3f7aa0b88b284d52a6cca064a798aa54 (table default.Table_ab1d4169df5a4c438c761aaabe15488e [id=cead87820a99412e936796998d2150dc]) successfully deleted
W20251025 08:02:25.101840 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet dcfb649e699748118ffd4fae0ced9546 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dcfb649e699748118ffd4fae0ced9546 already in progress: creating tablet
I20251025 08:02:25.102226 14652 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_28db4c3dec79421c9ad752690a383ea4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.102382 15113 raft_consensus.cc:1275] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer f0f2f8ce3e9f4d9ba3f3f02813397c31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251025 08:02:25.102547 14652 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28db4c3dec79421c9ad752690a383ea4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.102767 15409 consensus_queue.cc:1048] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:25.103582 14640 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet f61b7b4e700645a6b3d235dd1bc1c026 because the tablet was not found. No further retry: Not found: Tablet not found: f61b7b4e700645a6b3d235dd1bc1c026
I20251025 08:02:25.104125 15386 ts_tablet_manager.cc:1916] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.104882 14978 raft_consensus.cc:1275] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer f0f2f8ce3e9f4d9ba3f3f02813397c31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:25.105314 15409 consensus_queue.cc:1048] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.105376 15369 tablet_bootstrap.cc:492] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.105449 15369 ts_tablet_manager.cc:1403] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251025 08:02:25.105680 14653 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_00008a9b750c4657a17eb05a159e1b2c" } modify_external_catalogs: true
I20251025 08:02:25.105772 14653 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_00008a9b750c4657a17eb05a159e1b2c" } modify_external_catalogs: true
I20251025 08:02:25.105882 15369 raft_consensus.cc:359] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.105971 15369 raft_consensus.cc:385] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.106001 15369 raft_consensus.cc:740] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.106082 14646 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_0d8dd510c9054bf68417584232937996" } modify_external_catalogs: true
I20251025 08:02:25.106159 14646 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_0d8dd510c9054bf68417584232937996" } modify_external_catalogs: true
I20251025 08:02:25.106123 15369 consensus_queue.cc:260] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.106424 15369 ts_tablet_manager.cc:1434] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.106590 15369 tablet_bootstrap.cc:492] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.107488 15369 tablet_bootstrap.cc:654] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.109385 15248 raft_consensus.cc:3060] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.110496 15783 tablet.cc:1722] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.111362 15369 tablet_bootstrap.cc:492] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.111441 15369 ts_tablet_manager.cc:1403] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251025 08:02:25.112064 15497 consensus_queue.cc:1048] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:25.112159 14651 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 06b3cc87826249ccb1f84c29df09f802 consensus state has no leader
I20251025 08:02:25.112407 15386 ts_tablet_manager.cc:1929] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:25.112478 15386 log.cc:1199] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/4608033ee2244efda81dd70a5da61c5e
I20251025 08:02:25.112747 15386 ts_tablet_manager.cc:1950] T 4608033ee2244efda81dd70a5da61c5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.112788 15369 raft_consensus.cc:359] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.112876 15369 raft_consensus.cc:385] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.112913 15369 raft_consensus.cc:740] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.113722 15451 tablet.cc:1722] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.113018 15369 consensus_queue.cc:260] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.114271 15369 ts_tablet_manager.cc:1434] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:25.114472 15369 tablet_bootstrap.cc:492] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.115388 15369 tablet_bootstrap.cc:654] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.117640 15369 tablet_bootstrap.cc:492] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.117713 15369 ts_tablet_manager.cc:1403] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:25.118112 15369 raft_consensus.cc:359] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.118264 15369 raft_consensus.cc:385] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.118304 15369 raft_consensus.cc:740] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.118438 15369 consensus_queue.cc:260] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.118708 15369 ts_tablet_manager.cc:1434] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.118856 15369 tablet_bootstrap.cc:492] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.120133 14651 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_284c9a7e73f6495991e3883ba509d8c9" } new_table_name: "default.Table_a368af9d0b8d46d78f9158b8f9949b01" modify_external_catalogs: true
I20251025 08:02:25.120409 15369 tablet_bootstrap.cc:654] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.121330 15369 tablet_bootstrap.cc:492] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.121405 15369 ts_tablet_manager.cc:1403] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:25.121781 15369 raft_consensus.cc:359] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.121879 15369 raft_consensus.cc:385] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.121912 15369 raft_consensus.cc:740] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.122028 15369 consensus_queue.cc:260] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.122323 15369 ts_tablet_manager.cc:1434] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.122490 15369 tablet_bootstrap.cc:492] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.123363 15369 tablet_bootstrap.cc:654] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.123414 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 4608033ee2244efda81dd70a5da61c5e (table default.Table_ba3e2cf8a7ab42a890554e661cd69684 [id=b9853b2d88cf4a96b9fc5e1099f87064]) successfully deleted
I20251025 08:02:25.123610 15386 tablet_replica.cc:333] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.123739 15386 raft_consensus.cc:2243] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.123859 15386 raft_consensus.cc:2272] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.124094 14647 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 0553b245e4404132b0bfe178bf4074c3 (table default.Table_10d54e05b641473088190175b4007184 [id=10b5567973c2480ab51946feb2be997b]). Expected version 2 got 0
I20251025 08:02:25.124922 14654 catalog_manager.cc:5649] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.125113 14654 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 0553b245e4404132b0bfe178bf4074c3 (table default.Table_10d54e05b641473088190175b4007184 [id=10b5567973c2480ab51946feb2be997b]). Expected version 2 got 0
I20251025 08:02:25.125263 14654 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 35eb28e4cabf4e59b8245fa3adc57872 (table default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]). Expected version 3 got 0
I20251025 08:02:25.125344 14654 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 1ee00271d2354ae38dcb5a3289cea72f (table default.Table_8fd6304d02a6478fa31556344ab157ae [id=1ee33ee129d749d0bd7f26dc49fca0fe]). Expected version 2 got 0
I20251025 08:02:25.125346 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 422e2c32a18a4e1ea9a5e371da17dfea (DEFAULT_TABLE table=default.Table_b2214744ef8c4a4cb1c28ab1689ddbdb [id=e62c2aba4e5546e2bd881c5f2ae3abd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.125600 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 422e2c32a18a4e1ea9a5e371da17dfea. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.125614 15497 raft_consensus.cc:493] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.125701 15497 raft_consensus.cc:515] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.126065 15497 leader_election.cc:290] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.126591 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "db53440e199841c39c4003068ebb0c20" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.126690 14978 raft_consensus.cc:2468] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:25.126952 15048 leader_election.cc:304] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.127316 15497 raft_consensus.cc:2804] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.127369 15497 raft_consensus.cc:493] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.127408 15497 raft_consensus.cc:3060] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.127722 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 43da3f4fc9604562a95dff59da3c574b (DEFAULT_TABLE table=default.Table_6a446944f6d94a81bea892d25a3ed54e [id=8dc21ea1bf46490388397ecd6895a031]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.127923 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43da3f4fc9604562a95dff59da3c574b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.128316 15497 raft_consensus.cc:515] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.126442 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "db53440e199841c39c4003068ebb0c20" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.128643 15497 leader_election.cc:290] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.126667 15226 tablet_service.cc:1505] Processing CreateTablet for tablet 43da3f4fc9604562a95dff59da3c574b (DEFAULT_TABLE table=default.Table_6a446944f6d94a81bea892d25a3ed54e [id=8dc21ea1bf46490388397ecd6895a031]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:25.128851 15049 leader_election.cc:343] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.128885 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43da3f4fc9604562a95dff59da3c574b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.129245 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "db53440e199841c39c4003068ebb0c20" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:25.129325 14978 raft_consensus.cc:3060] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.129835 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 422e2c32a18a4e1ea9a5e371da17dfea (DEFAULT_TABLE table=default.Table_b2214744ef8c4a4cb1c28ab1689ddbdb [id=e62c2aba4e5546e2bd881c5f2ae3abd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.130066 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 422e2c32a18a4e1ea9a5e371da17dfea. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.130152 14978 raft_consensus.cc:2468] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:25.130430 15048 leader_election.cc:304] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.130427 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "db53440e199841c39c4003068ebb0c20" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:25.130573 15497 raft_consensus.cc:2804] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.130651 15497 raft_consensus.cc:697] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:25.130775 15497 consensus_queue.cc:237] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:25.131861 15049 leader_election.cc:343] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.126955 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 422e2c32a18a4e1ea9a5e371da17dfea (DEFAULT_TABLE table=default.Table_b2214744ef8c4a4cb1c28ab1689ddbdb [id=e62c2aba4e5546e2bd881c5f2ae3abd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.132332 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 422e2c32a18a4e1ea9a5e371da17dfea. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.132622 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 43da3f4fc9604562a95dff59da3c574b (DEFAULT_TABLE table=default.Table_6a446944f6d94a81bea892d25a3ed54e [id=8dc21ea1bf46490388397ecd6895a031]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.132833 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43da3f4fc9604562a95dff59da3c574b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.134541 14650 master_service.cc:954] ReplaceTablet: received request to replace tablet 834a6c675ac54dbdb5416c683384d96e from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.134661 15386 ts_tablet_manager.cc:1916] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.135406 15094 tablet_service.cc:1505] Processing CreateTablet for tablet a8393462039d4bb4aba66aee9e90b94a (DEFAULT_TABLE table=default.Table_c91b6d76e1384dd99d7e69ddee320afb [id=244c5edd72af4af790d96dd294e8d8c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.135710 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8393462039d4bb4aba66aee9e90b94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.136438 15386 ts_tablet_manager.cc:1929] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:25.136505 15386 log.cc:1199] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/5b4028f5238f4c428648893618587a37
I20251025 08:02:25.136763 15386 ts_tablet_manager.cc:1950] T 5b4028f5238f4c428648893618587a37 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.136811 15369 tablet_bootstrap.cc:492] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.136888 15369 ts_tablet_manager.cc:1403] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20251025 08:02:25.136981 14958 tablet_service.cc:1505] Processing CreateTablet for tablet a8393462039d4bb4aba66aee9e90b94a (DEFAULT_TABLE table=default.Table_c91b6d76e1384dd99d7e69ddee320afb [id=244c5edd72af4af790d96dd294e8d8c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.137187 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8393462039d4bb4aba66aee9e90b94a. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:25.137171 14651 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e3cd7b63fa174ee192ff909f149e8b17 consensus state has no leader
I20251025 08:02:25.137305 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 5b4028f5238f4c428648893618587a37 (table default.Table_299767dfd96a4890bd29ca0bb43b79aa [id=5f9d1d9d2f904f94b00324cca656cb17]) successfully deleted
I20251025 08:02:25.137307 15369 raft_consensus.cc:359] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.137388 15369 raft_consensus.cc:385] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.137424 15369 raft_consensus.cc:740] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.137545 15369 consensus_queue.cc:260] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.137800 15369 ts_tablet_manager.cc:1434] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.137953 15369 tablet_bootstrap.cc:492] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.138343 15370 tablet_bootstrap.cc:492] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.138422 15370 ts_tablet_manager.cc:1403] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.002s
I20251025 08:02:25.138947 15369 tablet_bootstrap.cc:654] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.138991 15370 raft_consensus.cc:359] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.139089 15642 raft_consensus.cc:493] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.139097 15370 raft_consensus.cc:385] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.139156 15370 raft_consensus.cc:740] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.139168 15642 raft_consensus.cc:515] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.139264 15370 consensus_queue.cc:260] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.139484 15642 leader_election.cc:290] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.139515 15370 ts_tablet_manager.cc:1434] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.139683 15370 tablet_bootstrap.cc:492] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.140559 15370 tablet_bootstrap.cc:654] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.140576 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ba7db73d6c3469aa0fd1a78ca32c4d8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.140664 14978 raft_consensus.cc:2468] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:25.141384 15048 leader_election.cc:304] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.141667 15380 raft_consensus.cc:2804] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.141726 15380 raft_consensus.cc:493] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.141767 15380 raft_consensus.cc:3060] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.141804 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ba7db73d6c3469aa0fd1a78ca32c4d8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:25.142119 15049 leader_election.cc:343] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.142529 14958 tablet_service.cc:1505] Processing CreateTablet for tablet ff82c6ab12c844339dd387569fb85526 (DEFAULT_TABLE table=default.Table_7a2d41df4f9d4874b3403fdef1ae1e72 [id=c8b69f7419b842c18f324e0c08ba840a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.142750 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff82c6ab12c844339dd387569fb85526. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.142702 15380 raft_consensus.cc:515] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.143020 15380 leader_election.cc:290] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.143148 15369 tablet_bootstrap.cc:492] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.143225 15369 ts_tablet_manager.cc:1403] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251025 08:02:25.143637 15369 raft_consensus.cc:359] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.143740 15369 raft_consensus.cc:385] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.143779 15369 raft_consensus.cc:740] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.144230 15369 consensus_queue.cc:260] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.144505 15369 ts_tablet_manager.cc:1434] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.144659 15369 tablet_bootstrap.cc:492] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.144904 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ba7db73d6c3469aa0fd1a78ca32c4d8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:25.145181 15218 tablet_service.cc:1505] Processing CreateTablet for tablet a8393462039d4bb4aba66aee9e90b94a (DEFAULT_TABLE table=default.Table_c91b6d76e1384dd99d7e69ddee320afb [id=244c5edd72af4af790d96dd294e8d8c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.145373 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8393462039d4bb4aba66aee9e90b94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.145505 15369 tablet_bootstrap.cc:654] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:25.145946 15049 leader_election.cc:343] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.147648 15374 raft_consensus.cc:493] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.147717 15374 raft_consensus.cc:515] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.148036 15374 leader_election.cc:290] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.148801 14653 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet db53440e199841c39c4003068ebb0c20
I20251025 08:02:25.148849 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2ba7db73d6c3469aa0fd1a78ca32c4d8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:25.148934 14978 raft_consensus.cc:3060] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.149081 14646 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet dfb4a050022d462699005fedc4323fdb
I20251025 08:02:25.149757 14978 raft_consensus.cc:2468] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:25.149919 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet dfb4a050022d462699005fedc4323fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.150077 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet db53440e199841c39c4003068ebb0c20 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.150691 15048 leader_election.cc:304] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.150810 15497 consensus_queue.cc:1048] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.151019 15497 raft_consensus.cc:2804] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.151062 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet db53440e199841c39c4003068ebb0c20 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.151094 15497 raft_consensus.cc:697] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:25.151214 15497 consensus_queue.cc:237] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.151492 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet db53440e199841c39c4003068ebb0c20 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.151636 15385 tablet_replica.cc:333] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.151744 15385 raft_consensus.cc:2243] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.151832 15385 raft_consensus.cc:2272] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.151887 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "932d4e9a5da84d57b92a42b67d1eaab9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.151979 14646 master_service.cc:954] ReplaceTablet: received request to replace tablet 932d4e9a5da84d57b92a42b67d1eaab9 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.151997 15112 raft_consensus.cc:2468] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:25.152177 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet dfb4a050022d462699005fedc4323fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.151221 15388 tablet_replica.cc:333] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.152302 14647 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_94e6d6f804c346ce97b427caf864614e [id=ce6a220ddfc540dbb17e28bc74b66449] alter complete (version 1)
I20251025 08:02:25.152375 15388 raft_consensus.cc:2243] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:25.152498 15388 pending_rounds.cc:70] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:25.152519 14915 leader_election.cc:304] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.152534 15388 pending_rounds.cc:77] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609797656907776 op_type: NO_OP noop_request { }
I20251025 08:02:25.152576 15388 raft_consensus.cc:2889] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:25.152626 15388 raft_consensus.cc:2272] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.152770 15374 raft_consensus.cc:2804] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.152858 15374 raft_consensus.cc:493] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.152899 15374 raft_consensus.cc:3060] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.152935 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "932d4e9a5da84d57b92a42b67d1eaab9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.153726 15374 raft_consensus.cc:515] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.154045 15374 leader_election.cc:290] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.154270 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 01d9f6636b364e3b9192ae546422de5b (DEFAULT_TABLE table=default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.154309 14647 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_10d54e05b641473088190175b4007184" } modify_external_catalogs: true
W20251025 08:02:25.154327 14914 leader_election.cc:343] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.154481 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d9f6636b364e3b9192ae546422de5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.154822 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet dfb4a050022d462699005fedc4323fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.155334 14649 catalog_manager.cc:5649] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.155537 14649 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 1ee00271d2354ae38dcb5a3289cea72f (table default.Table_8fd6304d02a6478fa31556344ab157ae [id=1ee33ee129d749d0bd7f26dc49fca0fe]). Expected version 2 got 0
I20251025 08:02:25.155947 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "932d4e9a5da84d57b92a42b67d1eaab9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:25.156050 15112 raft_consensus.cc:3060] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.156795 15094 tablet_service.cc:1505] Processing CreateTablet for tablet ff82c6ab12c844339dd387569fb85526 (DEFAULT_TABLE table=default.Table_7a2d41df4f9d4874b3403fdef1ae1e72 [id=c8b69f7419b842c18f324e0c08ba840a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.156931 15112 raft_consensus.cc:2468] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:25.157248 14915 leader_election.cc:304] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.157213 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff82c6ab12c844339dd387569fb85526. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.158123 15445 raft_consensus.cc:2804] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.158241 15445 raft_consensus.cc:697] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:25.158354 15445 consensus_queue.cc:237] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.158775 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "932d4e9a5da84d57b92a42b67d1eaab9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:25.158124 15369 tablet_bootstrap.cc:492] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.159001 15369 ts_tablet_manager.cc:1403] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20251025 08:02:25.159492 15369 raft_consensus.cc:359] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.159598 15369 raft_consensus.cc:385] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.159643 15369 raft_consensus.cc:740] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.159749 15369 consensus_queue.cc:260] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:25.159905 14914 leader_election.cc:343] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.159924 14647 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_10d54e05b641473088190175b4007184" } modify_external_catalogs: true
I20251025 08:02:25.160005 15369 ts_tablet_manager.cc:1434] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.160161 15369 tablet_bootstrap.cc:492] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.160327 15226 tablet_service.cc:1505] Processing CreateTablet for tablet ff82c6ab12c844339dd387569fb85526 (DEFAULT_TABLE table=default.Table_7a2d41df4f9d4874b3403fdef1ae1e72 [id=c8b69f7419b842c18f324e0c08ba840a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.160542 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff82c6ab12c844339dd387569fb85526. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.161037 15369 tablet_bootstrap.cc:654] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.161406 15385 ts_tablet_manager.cc:1916] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.161689 14650 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 834a6c675ac54dbdb5416c683384d96e
I20251025 08:02:25.161916 14650 catalog_manager.cc:6719] ReplaceTablet: tablet 834a6c675ac54dbdb5416c683384d96e deleted and replaced by tablet bcb5f7e52507450c8a6f5a99a9927974
I20251025 08:02:25.162459 14646 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 932d4e9a5da84d57b92a42b67d1eaab9
I20251025 08:02:25.162719 14646 catalog_manager.cc:6719] ReplaceTablet: tablet 932d4e9a5da84d57b92a42b67d1eaab9 deleted and replaced by tablet b3fdc5bd4c7f4506a150f31137e8b091
I20251025 08:02:25.163355 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 932d4e9a5da84d57b92a42b67d1eaab9 with delete_type TABLET_DATA_DELETED (replaced by tablet b3fdc5bd4c7f4506a150f31137e8b091) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.163380 15385 ts_tablet_manager.cc:1929] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.163439 15385 log.cc:1199] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/db53440e199841c39c4003068ebb0c20
I20251025 08:02:25.163655 15385 ts_tablet_manager.cc:1950] T db53440e199841c39c4003068ebb0c20 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.163712 15226 tablet_service.cc:1552] Processing DeleteTablet for tablet 834a6c675ac54dbdb5416c683384d96e with delete_type TABLET_DATA_DELETED (replaced by tablet bcb5f7e52507450c8a6f5a99a9927974) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.164151 15226 tablet_service.cc:1552] Processing DeleteTablet for tablet 932d4e9a5da84d57b92a42b67d1eaab9 with delete_type TABLET_DATA_DELETED (replaced by tablet b3fdc5bd4c7f4506a150f31137e8b091) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.164160 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 834a6c675ac54dbdb5416c683384d96e with delete_type TABLET_DATA_DELETED (replaced by tablet bcb5f7e52507450c8a6f5a99a9927974) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.164170 14653 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 997c8c5921ad4ec18914fd50c97fc33e (table default.Table_a210a38e85814b3db16726f2a0a830b8 [id=cb9294ed7c474aae989ac13159ec3166]). Expected version 1 got 0
W20251025 08:02:25.164741 15823 consensus_queue.cc:1175] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e51a2be794f04642b89386067ecbc77e" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20251025 08:02:25.165479 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 932d4e9a5da84d57b92a42b67d1eaab9 with delete_type TABLET_DATA_DELETED (replaced by tablet b3fdc5bd4c7f4506a150f31137e8b091) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.165652 15372 tablet_bootstrap.cc:492] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.165647 15388 ts_tablet_manager.cc:1916] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.165722 15372 ts_tablet_manager.cc:1403] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.088s user 0.002s sys 0.000s
I20251025 08:02:25.165786 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet db53440e199841c39c4003068ebb0c20 (table default.Table_00008a9b750c4657a17eb05a159e1b2c [id=18c8cd5376a34a12af35ba88bfe7b176]) successfully deleted
W20251025 08:02:25.165913 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet dfb4a050022d462699005fedc4323fdb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfb4a050022d462699005fedc4323fdb already in progress: creating tablet
I20251025 08:02:25.166275 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet dcfb649e699748118ffd4fae0ced9546 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.166498 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 3eee1563ce444900a96f9f363e92e7ff with delete_type TABLET_DATA_DELETED (replaced by tablet dfb4a050022d462699005fedc4323fdb) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.166764 15385 tablet_replica.cc:333] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.166867 15385 raft_consensus.cc:2243] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:25.166147 15372 raft_consensus.cc:359] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.167002 15385 pending_rounds.cc:70] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:25.167011 15372 raft_consensus.cc:385] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.167032 15385 pending_rounds.cc:77] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609797769940992 op_type: NO_OP noop_request { }
I20251025 08:02:25.167054 15372 raft_consensus.cc:740] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.167078 15385 raft_consensus.cc:2889] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:25.167128 15385 raft_consensus.cc:2272] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.167164 15372 consensus_queue.cc:260] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.167421 15372 ts_tablet_manager.cc:1434] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
W20251025 08:02:25.167527 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 834a6c675ac54dbdb5416c683384d96e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 834a6c675ac54dbdb5416c683384d96e already in progress: creating tablet
I20251025 08:02:25.167583 15372 tablet_bootstrap.cc:492] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.167908 15388 ts_tablet_manager.cc:1929] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:25.167981 15388 log.cc:1199] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/db53440e199841c39c4003068ebb0c20
I20251025 08:02:25.168238 15388 ts_tablet_manager.cc:1950] T db53440e199841c39c4003068ebb0c20 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.168609 15388 tablet_replica.cc:333] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.168648 15372 tablet_bootstrap.cc:654] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.168716 15388 raft_consensus.cc:2243] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.168812 15388 raft_consensus.cc:2272] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.168807 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 70ac567d5918403093bf71d9d9fc99b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.169253 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 834a6c675ac54dbdb5416c683384d96e with delete_type TABLET_DATA_DELETED (replaced by tablet bcb5f7e52507450c8a6f5a99a9927974) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.169783 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet db53440e199841c39c4003068ebb0c20 (table default.Table_00008a9b750c4657a17eb05a159e1b2c [id=18c8cd5376a34a12af35ba88bfe7b176]) successfully deleted
W20251025 08:02:25.169924 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet dfb4a050022d462699005fedc4323fdb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfb4a050022d462699005fedc4323fdb already in progress: creating tablet
I20251025 08:02:25.170933 15388 ts_tablet_manager.cc:1916] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.171509 14647 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 0553b245e4404132b0bfe178bf4074c3
I20251025 08:02:25.172192 15436 tablet.cc:1722] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.172421 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 0553b245e4404132b0bfe178bf4074c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.175045 14649 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 1ee00271d2354ae38dcb5a3289cea72f (table default.Table_8fd6304d02a6478fa31556344ab157ae [id=1ee33ee129d749d0bd7f26dc49fca0fe]). Expected version 2 got 0
I20251025 08:02:25.175388 15388 ts_tablet_manager.cc:1929] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.175444 15388 log.cc:1199] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/932d4e9a5da84d57b92a42b67d1eaab9
I20251025 08:02:25.175623 15388 ts_tablet_manager.cc:1950] T 932d4e9a5da84d57b92a42b67d1eaab9 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.175992 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 0553b245e4404132b0bfe178bf4074c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.176266 15226 tablet_service.cc:1505] Processing CreateTablet for tablet 01d9f6636b364e3b9192ae546422de5b (DEFAULT_TABLE table=default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.176514 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d9f6636b364e3b9192ae546422de5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.176514 14647 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 997c8c5921ad4ec18914fd50c97fc33e (table default.Table_a210a38e85814b3db16726f2a0a830b8 [id=cb9294ed7c474aae989ac13159ec3166]). Expected version 1 got 0
I20251025 08:02:25.176646 14647 catalog_manager.cc:5649] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:25.178294 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 1a9f9a42dbe7402189df59c49b463fad with delete_type TABLET_DATA_DELETED (replaced by tablet 76a906654cc44bfb96d9e1a936040e57) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.182128 14647 master_service.cc:954] ReplaceTablet: received request to replace tablet 88052f79558a42eeb1c8acf44e6b48e1 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.182503 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 1a9f9a42dbe7402189df59c49b463fad with delete_type TABLET_DATA_DELETED (replaced by tablet 76a906654cc44bfb96d9e1a936040e57) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.183346 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 0553b245e4404132b0bfe178bf4074c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.183660 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 01d9f6636b364e3b9192ae546422de5b (DEFAULT_TABLE table=default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.184984 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 72ff369b973b4c5981ea0810e37e8562 (DEFAULT_TABLE table=default.Table_7814293c383d4c8dbb1d384665c7c381 [id=8a0e4fe9e4544c539cb23b0279c1deaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.185174 14959 tablet_service.cc:1505] Processing CreateTablet for tablet eed2815efb7e46dd8b41f5ffe60daee8 (DEFAULT_TABLE table=default.Table_4a4b1eeaa5674710a1a13d7f0f395737 [id=f9c1f298fed0456eb9fd34fe9c124190]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.185401 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed2815efb7e46dd8b41f5ffe60daee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.186070 15091 tablet_service.cc:1505] Processing CreateTablet for tablet eed2815efb7e46dd8b41f5ffe60daee8 (DEFAULT_TABLE table=default.Table_4a4b1eeaa5674710a1a13d7f0f395737 [id=f9c1f298fed0456eb9fd34fe9c124190]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.186851 15229 tablet_service.cc:1505] Processing CreateTablet for tablet eed2815efb7e46dd8b41f5ffe60daee8 (DEFAULT_TABLE table=default.Table_4a4b1eeaa5674710a1a13d7f0f395737 [id=f9c1f298fed0456eb9fd34fe9c124190]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.187075 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed2815efb7e46dd8b41f5ffe60daee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.187083 14647 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 88052f79558a42eeb1c8acf44e6b48e1
I20251025 08:02:25.187443 15372 tablet_bootstrap.cc:492] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.187554 14647 catalog_manager.cc:6719] ReplaceTablet: tablet 88052f79558a42eeb1c8acf44e6b48e1 deleted and replaced by tablet f8576553f17b49f8bd11436ecac471ed
I20251025 08:02:25.187875 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 72ff369b973b4c5981ea0810e37e8562 (DEFAULT_TABLE table=default.Table_7814293c383d4c8dbb1d384665c7c381 [id=8a0e4fe9e4544c539cb23b0279c1deaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.187916 15372 ts_tablet_manager.cc:1403] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20251025 08:02:25.188145 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72ff369b973b4c5981ea0810e37e8562. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.188338 15372 raft_consensus.cc:359] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.188446 15372 raft_consensus.cc:385] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.188503 15372 raft_consensus.cc:740] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.188613 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 88052f79558a42eeb1c8acf44e6b48e1 with delete_type TABLET_DATA_DELETED (replaced by tablet f8576553f17b49f8bd11436ecac471ed) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.188614 15372 consensus_queue.cc:260] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.188966 15372 ts_tablet_manager.cc:1434] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.189247 15372 tablet_bootstrap.cc:492] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.189424 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 88052f79558a42eeb1c8acf44e6b48e1 with delete_type TABLET_DATA_DELETED (replaced by tablet f8576553f17b49f8bd11436ecac471ed) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.189664 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 88052f79558a42eeb1c8acf44e6b48e1 with delete_type TABLET_DATA_DELETED (replaced by tablet f8576553f17b49f8bd11436ecac471ed) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.190151 15372 tablet_bootstrap.cc:654] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.190864 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 72ff369b973b4c5981ea0810e37e8562 (DEFAULT_TABLE table=default.Table_7814293c383d4c8dbb1d384665c7c381 [id=8a0e4fe9e4544c539cb23b0279c1deaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.191075 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72ff369b973b4c5981ea0810e37e8562. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.194319 15369 tablet_bootstrap.cc:492] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.194396 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 72ff369b973b4c5981ea0810e37e8562. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.194434 15369 ts_tablet_manager.cc:1403] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.000s
I20251025 08:02:25.194836 15369 raft_consensus.cc:359] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.194924 15369 raft_consensus.cc:385] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.194955 15369 raft_consensus.cc:740] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.195051 15369 consensus_queue.cc:260] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.195170 15388 tablet_replica.cc:333] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.195266 15388 raft_consensus.cc:2243] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.195317 15374 raft_consensus.cc:493] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.195353 15388 raft_consensus.cc:2272] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.195374 15374 raft_consensus.cc:515] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.195674 15374 leader_election.cc:290] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.195719 15386 tablet_replica.cc:333] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.195823 15386 raft_consensus.cc:2243] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.195909 15386 raft_consensus.cc:2272] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.196254 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eed2815efb7e46dd8b41f5ffe60daee8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.196408 15386 ts_tablet_manager.cc:1916] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:25.196473 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 1a9f9a42dbe7402189df59c49b463fad because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1a9f9a42dbe7402189df59c49b463fad already in progress: creating tablet
I20251025 08:02:25.196734 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "70ac567d5918403093bf71d9d9fc99b9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:25.196969 14914 leader_election.cc:343] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.197273 15369 ts_tablet_manager.cc:1434] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:25.197510 15369 tablet_bootstrap.cc:492] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.198412 15370 tablet_bootstrap.cc:492] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.198436 15369 tablet_bootstrap.cc:654] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.198488 15370 ts_tablet_manager.cc:1403] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.000s
I20251025 08:02:25.198827 15388 ts_tablet_manager.cc:1916] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.198872 15370 raft_consensus.cc:359] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.198957 15370 raft_consensus.cc:385] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.199002 15370 raft_consensus.cc:740] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.199091 15370 consensus_queue.cc:260] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.199133 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 932d4e9a5da84d57b92a42b67d1eaab9 (table default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a]) successfully deleted
W20251025 08:02:25.199257 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 834a6c675ac54dbdb5416c683384d96e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 834a6c675ac54dbdb5416c683384d96e already in progress: creating tablet
I20251025 08:02:25.199322 15370 ts_tablet_manager.cc:1434] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:25.199522 15370 tablet_bootstrap.cc:492] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.200385 15370 tablet_bootstrap.cc:654] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.200707 15388 ts_tablet_manager.cc:1929] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.200770 15388 log.cc:1199] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/0553b245e4404132b0bfe178bf4074c3
I20251025 08:02:25.200968 15388 ts_tablet_manager.cc:1950] T 0553b245e4404132b0bfe178bf4074c3 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
W20251025 08:02:25.201138 14915 leader_election.cc:343] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 70ac567d5918403093bf71d9d9fc99b9
I20251025 08:02:25.201193 15370 tablet_bootstrap.cc:492] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.201203 14915 leader_election.cc:304] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.201319 15374 raft_consensus.cc:2749] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.201269 15370 ts_tablet_manager.cc:1403] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:25.201550 15388 tablet_replica.cc:333] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.201646 15388 raft_consensus.cc:2243] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.201731 15388 raft_consensus.cc:2272] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.201870 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 0553b245e4404132b0bfe178bf4074c3 (table default.Table_10d54e05b641473088190175b4007184 [id=10b5567973c2480ab51946feb2be997b]) successfully deleted
I20251025 08:02:25.202042 15370 raft_consensus.cc:359] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.202142 15370 raft_consensus.cc:385] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.202173 15370 raft_consensus.cc:740] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.202438 15370 consensus_queue.cc:260] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.202702 15370 ts_tablet_manager.cc:1434] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.202786 14649 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_3a925a6333c342289286ca5667f5f19d" } modify_external_catalogs: true
I20251025 08:02:25.202848 15370 tablet_bootstrap.cc:492] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.202872 14649 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_3a925a6333c342289286ca5667f5f19d" } modify_external_catalogs: true
I20251025 08:02:25.203754 15370 tablet_bootstrap.cc:654] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.205276 15388 ts_tablet_manager.cc:1916] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.206271 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01d9f6636b364e3b9192ae546422de5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.206317 15386 ts_tablet_manager.cc:1929] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:25.206398 15386 log.cc:1199] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/d8d2d5d7676f4b8096d10781cb0e5fce
I20251025 08:02:25.207369 14654 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_c9b9d2656f0d49138409d36e78f0d77f" } new_table_name: "default.Table_7387f487853a4b608f5e5237684550d8" modify_external_catalogs: true
I20251025 08:02:25.208308 15388 ts_tablet_manager.cc:1929] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.208361 15388 log.cc:1199] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/1a9f9a42dbe7402189df59c49b463fad
I20251025 08:02:25.208531 15388 ts_tablet_manager.cc:1950] T 1a9f9a42dbe7402189df59c49b463fad P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.209118 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 1a9f9a42dbe7402189df59c49b463fad (table default.Table_d6e61e9e78464c9096cbb26d6eb98c2e [id=78794c8ceec3479ca3ac3ef55594762f]) successfully deleted
I20251025 08:02:25.209174 15386 ts_tablet_manager.cc:1950] T d8d2d5d7676f4b8096d10781cb0e5fce P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:25.209448 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 88052f79558a42eeb1c8acf44e6b48e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88052f79558a42eeb1c8acf44e6b48e1 already in progress: creating tablet
I20251025 08:02:25.209645 15386 tablet_replica.cc:333] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.209748 15386 raft_consensus.cc:2243] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.209815 15386 raft_consensus.cc:2272] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.209890 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet d8d2d5d7676f4b8096d10781cb0e5fce (table default.Table_1ba796ba557f424995193f3cdb6d4dd9 [id=bb1d4aea5e9c4907a826f763e2c62707]) successfully deleted
I20251025 08:02:25.210219 15386 ts_tablet_manager.cc:1916] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.210371 15370 tablet_bootstrap.cc:492] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.210448 15370 ts_tablet_manager.cc:1403] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20251025 08:02:25.210795 15370 raft_consensus.cc:359] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.210879 15370 raft_consensus.cc:385] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.210915 15370 raft_consensus.cc:740] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.211045 15370 consensus_queue.cc:260] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.211241 15370 ts_tablet_manager.cc:1434] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.211400 15370 tablet_bootstrap.cc:492] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.212009 15386 ts_tablet_manager.cc:1929] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.212081 15386 log.cc:1199] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/10ef8618965e438cbf6fafc0533c9bfc
I20251025 08:02:25.212129 15370 tablet_bootstrap.cc:654] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.212292 15386 ts_tablet_manager.cc:1950] T 10ef8618965e438cbf6fafc0533c9bfc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.212756 15386 tablet_replica.cc:333] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.212832 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 10ef8618965e438cbf6fafc0533c9bfc (table default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]) successfully deleted
I20251025 08:02:25.212865 15386 raft_consensus.cc:2243] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.212944 15386 raft_consensus.cc:2272] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.213312 15386 ts_tablet_manager.cc:1916] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.213640 15370 tablet_bootstrap.cc:492] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.213714 15370 ts_tablet_manager.cc:1403] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:25.213991 15370 raft_consensus.cc:359] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.214053 15370 raft_consensus.cc:385] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.214071 15370 raft_consensus.cc:740] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.214171 15370 consensus_queue.cc:260] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.214428 15370 ts_tablet_manager.cc:1434] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.214540 15370 tablet_bootstrap.cc:492] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.215013 15386 ts_tablet_manager.cc:1929] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.215077 15386 log.cc:1199] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/1127507b5fd54fe0b1a7e7edf936bc38
I20251025 08:02:25.215117 15370 tablet_bootstrap.cc:654] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.215291 15386 ts_tablet_manager.cc:1950] T 1127507b5fd54fe0b1a7e7edf936bc38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.210472 15369 tablet_bootstrap.cc:492] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.215776 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 1127507b5fd54fe0b1a7e7edf936bc38 (table default.Table_cccb10034b9549bc84a9019610866553 [id=3a6fcff5488b4ee698661c7e51f754ea]) successfully deleted
I20251025 08:02:25.215852 15369 ts_tablet_manager.cc:1403] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
W20251025 08:02:25.216063 14654 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e54e57e850564e079db3dd383347ed30 consensus state has no leader
I20251025 08:02:25.216280 15369 raft_consensus.cc:359] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.216368 15369 raft_consensus.cc:385] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.216409 15369 raft_consensus.cc:740] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.216524 15369 consensus_queue.cc:260] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.216761 15369 ts_tablet_manager.cc:1434] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.216908 15369 tablet_bootstrap.cc:492] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.217218 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_a87d1a89b11346989da36da121742fc7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.217502 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a87d1a89b11346989da36da121742fc7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.217720 15369 tablet_bootstrap.cc:654] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:25.209817 15829 consensus_queue.cc:1175] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ab02c9d78a9d42f193755d436c8d44b2" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20251025 08:02:25.218971 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_6ae5d8954fba433fa72fd9cbaa925f2a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.219242 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ae5d8954fba433fa72fd9cbaa925f2a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.219245 15385 ts_tablet_manager.cc:1916] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.219810 14650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_07dd75378eaf438d89036c48a5545591"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.220114 14650 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_07dd75378eaf438d89036c48a5545591 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.221148 15385 ts_tablet_manager.cc:1929] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:25.221246 15385 log.cc:1199] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/932d4e9a5da84d57b92a42b67d1eaab9
I20251025 08:02:25.221496 15385 ts_tablet_manager.cc:1950] T 932d4e9a5da84d57b92a42b67d1eaab9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.222064 15385 tablet_replica.cc:333] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.222051 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 932d4e9a5da84d57b92a42b67d1eaab9 (table default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a]) successfully deleted
I20251025 08:02:25.222174 15385 raft_consensus.cc:2243] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.222287 15385 raft_consensus.cc:2272] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.222669 15385 ts_tablet_manager.cc:1916] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.223230 15370 tablet_bootstrap.cc:492] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.223304 15370 ts_tablet_manager.cc:1403] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20251025 08:02:25.223699 15370 raft_consensus.cc:359] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.223791 15370 raft_consensus.cc:385] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.223827 15370 raft_consensus.cc:740] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.223923 15370 consensus_queue.cc:260] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.224165 15370 ts_tablet_manager.cc:1434] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.224328 15370 tablet_bootstrap.cc:492] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.224370 15385 ts_tablet_manager.cc:1929] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.224426 15385 log.cc:1199] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/dcfb649e699748118ffd4fae0ced9546
I20251025 08:02:25.224611 15385 ts_tablet_manager.cc:1950] T dcfb649e699748118ffd4fae0ced9546 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.225040 15385 tablet_replica.cc:333] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.225132 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet dcfb649e699748118ffd4fae0ced9546 (table default.Table_802f081e7d2c4fe4b0d34d798171708d [id=70e669319af14d04b8a3ca13f0c5bd6e]) successfully deleted
I20251025 08:02:25.225152 15385 raft_consensus.cc:2243] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.225195 15370 tablet_bootstrap.cc:654] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.225246 15385 raft_consensus.cc:2272] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.225651 15385 ts_tablet_manager.cc:1916] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.226612 15370 tablet_bootstrap.cc:492] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.226686 15370 ts_tablet_manager.cc:1403] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:25.227052 15370 raft_consensus.cc:359] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.227164 15370 raft_consensus.cc:385] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.227201 15370 raft_consensus.cc:740] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.227864 15370 consensus_queue.cc:260] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.228534 15385 ts_tablet_manager.cc:1929] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.228600 15385 log.cc:1199] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/3eee1563ce444900a96f9f363e92e7ff
I20251025 08:02:25.228775 15385 ts_tablet_manager.cc:1950] T 3eee1563ce444900a96f9f363e92e7ff P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.228845 15370 ts_tablet_manager.cc:1434] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:25.228991 15370 tablet_bootstrap.cc:492] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.229236 15386 tablet_replica.cc:333] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.229382 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 3eee1563ce444900a96f9f363e92e7ff (table default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]) successfully deleted
W20251025 08:02:25.229403 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 56263217eaaf4bb9a48a822061ddb369 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 56263217eaaf4bb9a48a822061ddb369 already in progress: creating tablet
I20251025 08:02:25.229548 15385 tablet_replica.cc:333] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.229647 15385 raft_consensus.cc:2243] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.229794 15386 raft_consensus.cc:2243] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.229898 15386 raft_consensus.cc:2272] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.229981 15385 raft_consensus.cc:2272] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.230253 15370 tablet_bootstrap.cc:654] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.230585 15385 ts_tablet_manager.cc:1916] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.231145 15370 tablet_bootstrap.cc:492] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
W20251025 08:02:25.231140 14915 consensus_peers.cc:597] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0553b245e4404132b0bfe178bf4074c3. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:25.231235 15370 ts_tablet_manager.cc:1403] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:25.231441 15247 raft_consensus.cc:3060] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.231602 15370 raft_consensus.cc:359] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:25.231648 14639 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet e3cd7b63fa174ee192ff909f149e8b17 (table default.Table_a368af9d0b8d46d78f9158b8f9949b01 [id=425e69ea7f8a407e8d22b735ee62c709], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e3cd7b63fa174ee192ff909f149e8b17 consensus state has no leader
I20251025 08:02:25.231680 15370 raft_consensus.cc:385] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.231710 15370 raft_consensus.cc:740] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.231828 15370 consensus_queue.cc:260] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.232079 15370 ts_tablet_manager.cc:1434] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.232240 15370 tablet_bootstrap.cc:492] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.232359 15247 raft_consensus.cc:1275] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:25.232833 15385 ts_tablet_manager.cc:1929] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.232889 15385 log.cc:1199] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/70ac567d5918403093bf71d9d9fc99b9
I20251025 08:02:25.233064 15385 ts_tablet_manager.cc:1950] T 70ac567d5918403093bf71d9d9fc99b9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.233104 15370 tablet_bootstrap.cc:654] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.233165 15445 consensus_queue.cc:1048] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.233372 15386 ts_tablet_manager.cc:1916] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.233597 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 70ac567d5918403093bf71d9d9fc99b9 (table default.Table_bd3b1a4a23a447bead9ce165c79693e6 [id=000ce64aa9d14e45ae6570f8948bb0a3]) successfully deleted
I20251025 08:02:25.233760 15385 tablet_replica.cc:333] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.233870 15385 raft_consensus.cc:2243] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.233956 15385 raft_consensus.cc:2272] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.234246 15370 tablet_bootstrap.cc:492] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.234313 15370 ts_tablet_manager.cc:1403] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:25.234395 15385 ts_tablet_manager.cc:1916] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.234721 15370 raft_consensus.cc:359] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.234797 15370 raft_consensus.cc:385] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.234823 15370 raft_consensus.cc:740] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.234913 15370 consensus_queue.cc:260] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.235148 15386 ts_tablet_manager.cc:1929] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.235204 15386 log.cc:1199] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/f61b7b4e700645a6b3d235dd1bc1c026
I20251025 08:02:25.235194 15370 ts_tablet_manager.cc:1434] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.235332 15370 tablet_bootstrap.cc:492] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.235378 15386 ts_tablet_manager.cc:1950] T f61b7b4e700645a6b3d235dd1bc1c026 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.236300 15370 tablet_bootstrap.cc:654] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.237149 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 4d9cd745bd3e42e98b0ae1d145007bee (DEFAULT_TABLE table=default.Table_78eba044a7854773aa0165c81e4c819f [id=abe30167767443d0b8e59f9418399d88]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.237208 15226 tablet_service.cc:1505] Processing CreateTablet for tablet 4d9cd745bd3e42e98b0ae1d145007bee (DEFAULT_TABLE table=default.Table_78eba044a7854773aa0165c81e4c819f [id=abe30167767443d0b8e59f9418399d88]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.237360 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9cd745bd3e42e98b0ae1d145007bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.237571 14650 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_ba3e2cf8a7ab42a890554e661cd69684" } new_table_name: "default.Table_2631732663a24b55a695edc159006f87" modify_external_catalogs: true
I20251025 08:02:25.237610 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 4d9cd745bd3e42e98b0ae1d145007bee (DEFAULT_TABLE table=default.Table_78eba044a7854773aa0165c81e4c819f [id=abe30167767443d0b8e59f9418399d88]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.237653 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec (DEFAULT_TABLE table=default.Table_28db4c3dec79421c9ad752690a383ea4 [id=593c3f07bdaa45d49e1c8cf97cf0c2c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.237831 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9cd745bd3e42e98b0ae1d145007bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.238788 15370 tablet_bootstrap.cc:492] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.238879 15370 ts_tablet_manager.cc:1403] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:25.239310 15370 raft_consensus.cc:359] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.239398 15370 raft_consensus.cc:385] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.239429 15370 raft_consensus.cc:740] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.239537 15370 consensus_queue.cc:260] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.239794 15370 ts_tablet_manager.cc:1434] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.236922 15385 ts_tablet_manager.cc:1929] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.239976 15370 tablet_bootstrap.cc:492] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.239979 15385 log.cc:1199] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/1a9f9a42dbe7402189df59c49b463fad
I20251025 08:02:25.240067 15372 tablet_bootstrap.cc:492] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.240139 15372 ts_tablet_manager.cc:1403] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.051s user 0.001s sys 0.000s
I20251025 08:02:25.240505 15385 ts_tablet_manager.cc:1950] T 1a9f9a42dbe7402189df59c49b463fad P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.240602 15372 raft_consensus.cc:359] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.240731 15372 raft_consensus.cc:385] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.240779 15372 raft_consensus.cc:740] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.240885 15372 consensus_queue.cc:260] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.241209 15372 ts_tablet_manager.cc:1434] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.241551 14649 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 2bda60aba9a647019adf715083ce05a5
I20251025 08:02:25.241683 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 1a9f9a42dbe7402189df59c49b463fad (table default.Table_d6e61e9e78464c9096cbb26d6eb98c2e [id=78794c8ceec3479ca3ac3ef55594762f]) successfully deleted
I20251025 08:02:25.242226 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 2bda60aba9a647019adf715083ce05a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.242221 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 2bda60aba9a647019adf715083ce05a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.241027 15370 tablet_bootstrap.cc:654] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.242640 15369 tablet_bootstrap.cc:492] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.242707 15369 ts_tablet_manager.cc:1403] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.001s
W20251025 08:02:25.243038 14650 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4dd72f76c950485c968409fe868266a2 consensus state has no leader
I20251025 08:02:25.243072 15385 tablet_replica.cc:333] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.243247 15385 raft_consensus.cc:2243] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:25.243438 15385 pending_rounds.cc:70] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 2 pending ops.
I20251025 08:02:25.243086 15369 raft_consensus.cc:359] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.243604 15369 raft_consensus.cc:385] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.243633 15369 raft_consensus.cc:740] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.243490 15385 pending_rounds.cc:77] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7214609798062301184 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "0553b245e4404132b0bfe178bf4074c3" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.Table_10d54e05b641473088190175b4007184" dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" new_extra_config { } }
I20251025 08:02:25.243726 15369 consensus_queue.cc:260] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:25.243767 15385 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37198: Aborted: Op aborted
I20251025 08:02:25.243968 15369 ts_tablet_manager.cc:1434] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.244134 15370 tablet_bootstrap.cc:492] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.244161 15369 tablet_bootstrap.cc:492] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.244208 15370 ts_tablet_manager.cc:1403] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20251025 08:02:25.244376 15385 pending_rounds.cc:77] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609797426835456 op_type: NO_OP noop_request { }
I20251025 08:02:25.244436 15385 raft_consensus.cc:2889] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:25.244482 15385 raft_consensus.cc:2272] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:25.244550 15449 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:37198: Illegal state: RaftConsensus is not running: State = Stopped
I20251025 08:02:25.244587 15370 raft_consensus.cc:359] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.244665 15370 raft_consensus.cc:385] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.244693 15370 raft_consensus.cc:740] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.244797 15370 consensus_queue.cc:260] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.244966 15369 tablet_bootstrap.cc:654] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.245043 15370 ts_tablet_manager.cc:1434] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.245159 15370 tablet_bootstrap.cc:492] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.245882 15369 tablet_bootstrap.cc:492] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.245970 15370 tablet_bootstrap.cc:654] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.245967 15369 ts_tablet_manager.cc:1403] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:25.247323 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 2bda60aba9a647019adf715083ce05a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.247852 15388 tablet_replica.cc:333] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.248003 15388 raft_consensus.cc:2243] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.248075 15388 raft_consensus.cc:2272] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.248091 14653 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet b1ae9934b0ca403ea026233ecd952a20 (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]). Expected version 1 got 0
I20251025 08:02:25.248204 14653 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 06b3cc87826249ccb1f84c29df09f802 (table default.Table_f5bf4f0664c44a70aa6d2f0e9143f7a7 [id=6739c1319b784c8eb66fc75125f83056]). Expected version 3 got 0
I20251025 08:02:25.248535 15388 ts_tablet_manager.cc:1916] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:25.249018 14653 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet b1ae9934b0ca403ea026233ecd952a20 (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet b1ae9934b0ca403ea026233ecd952a20 consensus state has no leader
I20251025 08:02:25.250121 14650 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_4c48d1da14fd4f6db57aaea031a1992e" } modify_external_catalogs: true
I20251025 08:02:25.250248 14650 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_4c48d1da14fd4f6db57aaea031a1992e" } modify_external_catalogs: true
I20251025 08:02:25.250483 15388 ts_tablet_manager.cc:1929] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.250540 15388 log.cc:1199] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/2bda60aba9a647019adf715083ce05a5
I20251025 08:02:25.250723 15388 ts_tablet_manager.cc:1950] T 2bda60aba9a647019adf715083ce05a5 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.251168 15369 raft_consensus.cc:359] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.251281 15369 raft_consensus.cc:385] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.251331 15369 raft_consensus.cc:740] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.251469 15369 consensus_queue.cc:260] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.251731 15369 ts_tablet_manager.cc:1434] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:25.252559 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec (DEFAULT_TABLE table=default.Table_28db4c3dec79421c9ad752690a383ea4 [id=593c3f07bdaa45d49e1c8cf97cf0c2c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.252753 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.252823 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 2bda60aba9a647019adf715083ce05a5 (table default.Table_3a925a6333c342289286ca5667f5f19d [id=940bf492708245f9b5c7a9b3073a1b07]) successfully deleted
I20251025 08:02:25.253170 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 834a6c675ac54dbdb5416c683384d96e with delete_type TABLET_DATA_DELETED (replaced by tablet bcb5f7e52507450c8a6f5a99a9927974) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.253463 15445 raft_consensus.cc:493] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.253530 15445 raft_consensus.cc:515] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.254312 14653 master_service.cc:954] ReplaceTablet: received request to replace tablet a12f1428ccda4cef8c00a34630f2e54e from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.254896 15369 tablet_bootstrap.cc:492] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.255504 15370 tablet_bootstrap.cc:492] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.255484 14959 tablet_service.cc:1505] Processing CreateTablet for tablet bcb5f7e52507450c8a6f5a99a9927974 (DEFAULT_TABLE table=default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.255585 15370 ts_tablet_manager.cc:1403] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:25.255699 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb5f7e52507450c8a6f5a99a9927974. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.255944 15370 raft_consensus.cc:359] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.256044 15370 raft_consensus.cc:385] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.256079 15370 raft_consensus.cc:740] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.256110 15369 tablet_bootstrap.cc:654] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.256196 15370 consensus_queue.cc:260] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.256341 15445 leader_election.cc:290] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.256438 15370 ts_tablet_manager.cc:1434] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.256634 14650 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet f2d7e4ad8c2f4915b721b77846cfc3cb
W20251025 08:02:25.256903 14915 leader_election.cc:343] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 2bda60aba9a647019adf715083ce05a5
I20251025 08:02:25.257186 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet f2d7e4ad8c2f4915b721b77846cfc3cb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.257274 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet f2d7e4ad8c2f4915b721b77846cfc3cb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.257525 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet f2d7e4ad8c2f4915b721b77846cfc3cb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.257812 15385 ts_tablet_manager.cc:1916] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.257779 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec (DEFAULT_TABLE table=default.Table_28db4c3dec79421c9ad752690a383ea4 [id=593c3f07bdaa45d49e1c8cf97cf0c2c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.257917 15369 tablet_bootstrap.cc:492] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.258038 15369 ts_tablet_manager.cc:1403] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251025 08:02:25.258417 15091 tablet_service.cc:1505] Processing CreateTablet for tablet bcb5f7e52507450c8a6f5a99a9927974 (DEFAULT_TABLE table=default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.258499 15369 raft_consensus.cc:359] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.258584 15369 raft_consensus.cc:385] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.258618 15369 raft_consensus.cc:740] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.258744 15369 consensus_queue.cc:260] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.259037 15229 tablet_service.cc:1505] Processing CreateTablet for tablet bcb5f7e52507450c8a6f5a99a9927974 (DEFAULT_TABLE table=default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.259815 15223 tablet_service.cc:1505] Processing CreateTablet for tablet b3fdc5bd4c7f4506a150f31137e8b091 (DEFAULT_TABLE table=default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.260021 15089 tablet_service.cc:1505] Processing CreateTablet for tablet b3fdc5bd4c7f4506a150f31137e8b091 (DEFAULT_TABLE table=default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.260299 15385 ts_tablet_manager.cc:1929] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.260403 15385 log.cc:1199] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/0553b245e4404132b0bfe178bf4074c3
I20251025 08:02:25.260668 15385 ts_tablet_manager.cc:1950] T 0553b245e4404132b0bfe178bf4074c3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.260841 15369 ts_tablet_manager.cc:1434] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:25.261000 15369 tablet_bootstrap.cc:492] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.261317 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 0553b245e4404132b0bfe178bf4074c3 (table default.Table_10d54e05b641473088190175b4007184 [id=10b5567973c2480ab51946feb2be997b]) successfully deleted
I20251025 08:02:25.261344 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2bda60aba9a647019adf715083ce05a5" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:25.261615 14914 leader_election.cc:343] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:25.261617 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 88052f79558a42eeb1c8acf44e6b48e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88052f79558a42eeb1c8acf44e6b48e1 already in progress: creating tablet
I20251025 08:02:25.261677 14914 leader_election.cc:304] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.261874 15385 tablet_replica.cc:333] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.261968 14653 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet a12f1428ccda4cef8c00a34630f2e54e
I20251025 08:02:25.261938 15445 raft_consensus.cc:2749] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.262226 14653 catalog_manager.cc:6719] ReplaceTablet: tablet a12f1428ccda4cef8c00a34630f2e54e deleted and replaced by tablet 0310efe286dd409ab857a92daa6ff99f
I20251025 08:02:25.261906 15369 tablet_bootstrap.cc:654] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.262377 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet a12f1428ccda4cef8c00a34630f2e54e with delete_type TABLET_DATA_DELETED (replaced by tablet 0310efe286dd409ab857a92daa6ff99f) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.262742 15221 tablet_service.cc:1552] Processing DeleteTablet for tablet a12f1428ccda4cef8c00a34630f2e54e with delete_type TABLET_DATA_DELETED (replaced by tablet 0310efe286dd409ab857a92daa6ff99f) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.262051 15385 raft_consensus.cc:2243] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.262828 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet a12f1428ccda4cef8c00a34630f2e54e with delete_type TABLET_DATA_DELETED (replaced by tablet 0310efe286dd409ab857a92daa6ff99f) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.262916 15385 raft_consensus.cc:2272] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.263000 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet f61b7b4e700645a6b3d235dd1bc1c026 (table default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]) successfully deleted
I20251025 08:02:25.263168 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d9cd745bd3e42e98b0ae1d145007bee. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.263411 15385 ts_tablet_manager.cc:1916] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.264928 15385 ts_tablet_manager.cc:1929] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.265134 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:25.265304 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet dfb4a050022d462699005fedc4323fdb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dfb4a050022d462699005fedc4323fdb already in progress: creating tablet
W20251025 08:02:25.265554 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet db53440e199841c39c4003068ebb0c20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet db53440e199841c39c4003068ebb0c20 already in progress: creating tablet
I20251025 08:02:25.265700 15386 tablet_replica.cc:333] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
W20251025 08:02:25.265702 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 834a6c675ac54dbdb5416c683384d96e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 834a6c675ac54dbdb5416c683384d96e already in progress: creating tablet
I20251025 08:02:25.265797 15386 raft_consensus.cc:2243] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
W20251025 08:02:25.265817 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 932d4e9a5da84d57b92a42b67d1eaab9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 932d4e9a5da84d57b92a42b67d1eaab9 already in progress: creating tablet
I20251025 08:02:25.265868 15386 pending_rounds.cc:70] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 2 pending ops.
I20251025 08:02:25.265893 15386 pending_rounds.cc:77] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7214609798062301184 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "0553b245e4404132b0bfe178bf4074c3" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 2 new_table_name: "default.Table_10d54e05b641473088190175b4007184" dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" new_extra_config { } }
I20251025 08:02:25.266072 15386 pending_rounds.cc:77] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609797426835456 op_type: NO_OP noop_request { }
I20251025 08:02:25.266137 15386 raft_consensus.cc:2889] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:25.266227 15386 raft_consensus.cc:2272] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.266330 15385 log.cc:1199] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/2bda60aba9a647019adf715083ce05a5
I20251025 08:02:25.266598 15385 ts_tablet_manager.cc:1950] T 2bda60aba9a647019adf715083ce05a5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.266780 15386 ts_tablet_manager.cc:1916] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.267127 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb5f7e52507450c8a6f5a99a9927974. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.267153 15385 tablet_replica.cc:333] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.267218 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 2bda60aba9a647019adf715083ce05a5 (table default.Table_3a925a6333c342289286ca5667f5f19d [id=940bf492708245f9b5c7a9b3073a1b07]) successfully deleted
I20251025 08:02:25.267237 15385 raft_consensus.cc:2243] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:25.267390 15385 raft_consensus.cc:2272] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.267829 15385 ts_tablet_manager.cc:1916] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.268098 15369 tablet_bootstrap.cc:492] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.268184 15369 ts_tablet_manager.cc:1403] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251025 08:02:25.268518 15386 ts_tablet_manager.cc:1929] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.268584 15386 log.cc:1199] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/0553b245e4404132b0bfe178bf4074c3
I20251025 08:02:25.268563 15369 raft_consensus.cc:359] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.268657 15369 raft_consensus.cc:385] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.268687 15369 raft_consensus.cc:740] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.268817 15386 ts_tablet_manager.cc:1950] T 0553b245e4404132b0bfe178bf4074c3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.268833 15369 consensus_queue.cc:260] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.269150 15369 ts_tablet_manager.cc:1434] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.269209 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 0553b245e4404132b0bfe178bf4074c3 (table default.Table_10d54e05b641473088190175b4007184 [id=10b5567973c2480ab51946feb2be997b]) successfully deleted
I20251025 08:02:25.269273 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fdc5bd4c7f4506a150f31137e8b091. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.269326 15369 tablet_bootstrap.cc:492] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.269272 15386 tablet_replica.cc:333] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.269428 15386 raft_consensus.cc:2243] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.269511 15386 raft_consensus.cc:2272] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:25.269613 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 88052f79558a42eeb1c8acf44e6b48e1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 88052f79558a42eeb1c8acf44e6b48e1 already in progress: creating tablet
W20251025 08:02:25.269739 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 2bda60aba9a647019adf715083ce05a5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2bda60aba9a647019adf715083ce05a5 already in progress: creating tablet
I20251025 08:02:25.269934 15386 ts_tablet_manager.cc:1916] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.270407 15369 tablet_bootstrap.cc:654] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.270588 15385 ts_tablet_manager.cc:1929] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.270656 15385 log.cc:1199] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/f2d7e4ad8c2f4915b721b77846cfc3cb
I20251025 08:02:25.271459 15385 ts_tablet_manager.cc:1950] T f2d7e4ad8c2f4915b721b77846cfc3cb P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.271616 15369 tablet_bootstrap.cc:492] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.271684 15369 ts_tablet_manager.cc:1403] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:25.271720 15372 tablet_bootstrap.cc:492] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.271720 15386 ts_tablet_manager.cc:1929] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.271826 15386 log.cc:1199] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/f2d7e4ad8c2f4915b721b77846cfc3cb
I20251025 08:02:25.272063 15386 ts_tablet_manager.cc:1950] T f2d7e4ad8c2f4915b721b77846cfc3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.272084 15369 raft_consensus.cc:359] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.272183 15369 raft_consensus.cc:385] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.272215 15369 raft_consensus.cc:740] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.272308 15369 consensus_queue.cc:260] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.272523 15369 ts_tablet_manager.cc:1434] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.272553 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet f2d7e4ad8c2f4915b721b77846cfc3cb (table default.Table_4c48d1da14fd4f6db57aaea031a1992e [id=215b7ed86cf7422b826890834307b839]) successfully deleted
I20251025 08:02:25.272665 15372 tablet_bootstrap.cc:654] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.272675 15369 tablet_bootstrap.cc:492] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:25.272678 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet a12f1428ccda4cef8c00a34630f2e54e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a12f1428ccda4cef8c00a34630f2e54e already in progress: creating tablet
I20251025 08:02:25.273478 15369 tablet_bootstrap.cc:654] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.273497 15372 tablet_bootstrap.cc:492] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.273546 15372 ts_tablet_manager.cc:1403] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:25.273813 15372 raft_consensus.cc:359] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.273869 15372 raft_consensus.cc:385] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.273888 15372 raft_consensus.cc:740] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.273984 15372 consensus_queue.cc:260] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.274012 15445 raft_consensus.cc:493] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.274071 15445 raft_consensus.cc:515] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.274221 15372 ts_tablet_manager.cc:1434] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.274353 15372 tablet_bootstrap.cc:492] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.274381 15445 leader_election.cc:290] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.274322 14653 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_521f904aba4a4b309e9864df54df659d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.274607 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet f2d7e4ad8c2f4915b721b77846cfc3cb (table default.Table_4c48d1da14fd4f6db57aaea031a1992e [id=215b7ed86cf7422b826890834307b839]) successfully deleted
W20251025 08:02:25.274648 14653 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_521f904aba4a4b309e9864df54df659d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:25.274745 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet a12f1428ccda4cef8c00a34630f2e54e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a12f1428ccda4cef8c00a34630f2e54e already in progress: creating tablet
I20251025 08:02:25.274935 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35eb28e4cabf4e59b8245fa3adc57872" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.275031 15113 raft_consensus.cc:2468] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:25.275050 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35eb28e4cabf4e59b8245fa3adc57872" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.275141 15247 raft_consensus.cc:2468] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:25.275161 15372 tablet_bootstrap.cc:654] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.275499 14914 leader_election.cc:304] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:25.275746 14649 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_78eba044a7854773aa0165c81e4c819f" } new_table_name: "default.Table_8540557c73a34cc2851ad08d71acac22" modify_external_catalogs: true
I20251025 08:02:25.276067 15372 tablet_bootstrap.cc:492] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.276116 15372 ts_tablet_manager.cc:1403] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:25.276504 14647 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_e22e6abaeec0420496616ee334cf07eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.276536 15372 raft_consensus.cc:359] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.276618 15372 raft_consensus.cc:385] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.276654 15372 raft_consensus.cc:740] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
W20251025 08:02:25.276798 14647 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e22e6abaeec0420496616ee334cf07eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.276785 15372 consensus_queue.cc:260] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.277069 15372 ts_tablet_manager.cc:1434] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.277362 15372 tablet_bootstrap.cc:492] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.278355 15374 raft_consensus.cc:2804] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.278424 15374 raft_consensus.cc:493] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.278463 15374 raft_consensus.cc:3060] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.278645 15372 tablet_bootstrap.cc:654] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.279253 15374 raft_consensus.cc:515] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.279435 15372 tablet_bootstrap.cc:492] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.279501 15372 ts_tablet_manager.cc:1403] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:25.279549 15374 leader_election.cc:290] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.279889 15372 raft_consensus.cc:359] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.279963 15372 raft_consensus.cc:385] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.279982 15372 raft_consensus.cc:740] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.280089 15372 consensus_queue.cc:260] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.280334 15372 ts_tablet_manager.cc:1434] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.280485 15372 tablet_bootstrap.cc:492] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.281289 15372 tablet_bootstrap.cc:654] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.281515 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35eb28e4cabf4e59b8245fa3adc57872" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:25.281555 14650 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 06b3cc87826249ccb1f84c29df09f802 (table default.Table_f5bf4f0664c44a70aa6d2f0e9143f7a7 [id=6739c1319b784c8eb66fc75125f83056]). Expected version 3 got 0
I20251025 08:02:25.281595 15247 raft_consensus.cc:3060] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.282145 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "35eb28e4cabf4e59b8245fa3adc57872" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:25.282259 15113 raft_consensus.cc:3060] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.282410 15247 raft_consensus.cc:2468] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:25.282649 14914 leader_election.cc:304] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:25.283048 15113 raft_consensus.cc:2468] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:25.283054 15374 raft_consensus.cc:2804] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.283064 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 0553b245e4404132b0bfe178bf4074c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.283146 15374 raft_consensus.cc:697] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:25.283247 15374 consensus_queue.cc:237] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:25.283566 14641 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 0553b245e4404132b0bfe178bf4074c3 because the tablet was not found. No further retry: Not found: Tablet not found: 0553b245e4404132b0bfe178bf4074c3
I20251025 08:02:25.284449 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_d9d4e09b4b4f4014847e00428c183725"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.284488 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_b2029265ed824a48b4f5db3a90b38bdf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.284713 14650 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 06b3cc87826249ccb1f84c29df09f802 (table default.Table_f5bf4f0664c44a70aa6d2f0e9143f7a7 [id=6739c1319b784c8eb66fc75125f83056]). Expected version 3 got 0
W20251025 08:02:25.284745 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2029265ed824a48b4f5db3a90b38bdf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:25.284746 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9d4e09b4b4f4014847e00428c183725 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.284816 14650 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet b1ae9934b0ca403ea026233ecd952a20 (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]). Expected version 1 got 0
I20251025 08:02:25.285678 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet a12f1428ccda4cef8c00a34630f2e54e with delete_type TABLET_DATA_DELETED (replaced by tablet 0310efe286dd409ab857a92daa6ff99f) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.285840 15385 tablet_replica.cc:333] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.285923 15385 raft_consensus.cc:2243] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.285997 15385 raft_consensus.cc:2272] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.285938 14651 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_5854b229e0af41b88196de4a1c9c0270"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.286283 14651 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5854b229e0af41b88196de4a1c9c0270 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.286818 14958 tablet_service.cc:1505] Processing CreateTablet for tablet f89313f3d7344132b2fb0fab8941bb3e (DEFAULT_TABLE table=default.Table_07dd75378eaf438d89036c48a5545591 [id=e9aa7fb3b0d74da781257782a24b37fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.287025 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f89313f3d7344132b2fb0fab8941bb3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.288404 14650 catalog_manager.cc:5649] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.288599 14650 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 35eb28e4cabf4e59b8245fa3adc57872 (table default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]). Expected version 3 got 0
I20251025 08:02:25.289266 15093 tablet_service.cc:1505] Processing CreateTablet for tablet f89313f3d7344132b2fb0fab8941bb3e (DEFAULT_TABLE table=default.Table_07dd75378eaf438d89036c48a5545591 [id=e9aa7fb3b0d74da781257782a24b37fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.289494 15229 tablet_service.cc:1505] Processing CreateTablet for tablet f08d0c3446dd4a478f81688a3259bb91 (DEFAULT_TABLE table=default.Table_a87d1a89b11346989da36da121742fc7 [id=ab926bc9b7424c45a5415c4763db2b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.289494 15090 tablet_service.cc:1505] Processing CreateTablet for tablet f08d0c3446dd4a478f81688a3259bb91 (DEFAULT_TABLE table=default.Table_a87d1a89b11346989da36da121742fc7 [id=ab926bc9b7424c45a5415c4763db2b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.289570 14958 tablet_service.cc:1505] Processing CreateTablet for tablet f08d0c3446dd4a478f81688a3259bb91 (DEFAULT_TABLE table=default.Table_a87d1a89b11346989da36da121742fc7 [id=ab926bc9b7424c45a5415c4763db2b4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.289712 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f08d0c3446dd4a478f81688a3259bb91. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.289757 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f08d0c3446dd4a478f81688a3259bb91. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.289757 14955 tablet_service.cc:1505] Processing CreateTablet for tablet d14e12c45323420b84de06d828238caa (DEFAULT_TABLE table=default.Table_6ae5d8954fba433fa72fd9cbaa925f2a [id=6b4ebc3c554648b48d6ea2f5916e1bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.289999 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14e12c45323420b84de06d828238caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.290426 15218 tablet_service.cc:1505] Processing CreateTablet for tablet d14e12c45323420b84de06d828238caa (DEFAULT_TABLE table=default.Table_6ae5d8954fba433fa72fd9cbaa925f2a [id=6b4ebc3c554648b48d6ea2f5916e1bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.290620 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14e12c45323420b84de06d828238caa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.291587 15445 raft_consensus.cc:493] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.291662 15445 raft_consensus.cc:515] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.291956 15445 leader_election.cc:290] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.292270 15223 tablet_service.cc:1505] Processing CreateTablet for tablet f89313f3d7344132b2fb0fab8941bb3e (DEFAULT_TABLE table=default.Table_07dd75378eaf438d89036c48a5545591 [id=e9aa7fb3b0d74da781257782a24b37fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.292320 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "997c8c5921ad4ec18914fd50c97fc33e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.292469 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f89313f3d7344132b2fb0fab8941bb3e. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:25.292619 14914 leader_election.cc:343] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.292761 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "997c8c5921ad4ec18914fd50c97fc33e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.292842 15113 raft_consensus.cc:2468] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:25.293175 14915 leader_election.cc:304] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.293231 15092 tablet_service.cc:1505] Processing CreateTablet for tablet d14e12c45323420b84de06d828238caa (DEFAULT_TABLE table=default.Table_6ae5d8954fba433fa72fd9cbaa925f2a [id=6b4ebc3c554648b48d6ea2f5916e1bad]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.293290 14955 tablet_service.cc:1505] Processing CreateTablet for tablet f8576553f17b49f8bd11436ecac471ed (DEFAULT_TABLE table=default.Table_8f781f3f507c4a339ba15100b719fcbb [id=2283253a9522485d93d6c484c5eef6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.293390 15445 raft_consensus.cc:2804] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.293423 15445 raft_consensus.cc:493] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.293445 15445 raft_consensus.cc:3060] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.293485 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8576553f17b49f8bd11436ecac471ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.293995 15445 raft_consensus.cc:515] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.294310 15445 leader_election.cc:290] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.294709 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "997c8c5921ad4ec18914fd50c97fc33e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:25.295006 14914 leader_election.cc:343] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.295449 15088 tablet_service.cc:1505] Processing CreateTablet for tablet f8576553f17b49f8bd11436ecac471ed (DEFAULT_TABLE table=default.Table_8f781f3f507c4a339ba15100b719fcbb [id=2283253a9522485d93d6c484c5eef6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.295508 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "997c8c5921ad4ec18914fd50c97fc33e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:25.295598 15113 raft_consensus.cc:3060] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.296415 15113 raft_consensus.cc:2468] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:25.297830 14915 leader_election.cc:304] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.298012 15229 tablet_service.cc:1505] Processing CreateTablet for tablet f8576553f17b49f8bd11436ecac471ed (DEFAULT_TABLE table=default.Table_8f781f3f507c4a339ba15100b719fcbb [id=2283253a9522485d93d6c484c5eef6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.298215 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8576553f17b49f8bd11436ecac471ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:25.299786 14649 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4d9cd745bd3e42e98b0ae1d145007bee consensus state has no leader
I20251025 08:02:25.302075 15445 raft_consensus.cc:2804] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.302158 15445 raft_consensus.cc:697] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:25.302280 15445 consensus_queue.cc:237] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.303949 14652 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 35eb28e4cabf4e59b8245fa3adc57872 (table default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]). Expected version 3 got 0
I20251025 08:02:25.305541 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 70ac567d5918403093bf71d9d9fc99b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.305675 14652 master_service.cc:954] ReplaceTablet: received request to replace tablet ff82c6ab12c844339dd387569fb85526 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.305711 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet db53440e199841c39c4003068ebb0c20 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.305898 15386 tablet_replica.cc:333] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.305995 15386 raft_consensus.cc:2243] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.306067 15386 raft_consensus.cc:2272] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.306313 15388 tablet_replica.cc:333] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.306425 15388 raft_consensus.cc:2243] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.306514 15388 raft_consensus.cc:2272] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.306609 15370 tablet_bootstrap.cc:492] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.307083 14650 catalog_manager.cc:5649] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.307272 14650 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 997c8c5921ad4ec18914fd50c97fc33e (table default.Table_a210a38e85814b3db16726f2a0a830b8 [id=cb9294ed7c474aae989ac13159ec3166]). Expected version 1 got 0
I20251025 08:02:25.307555 15370 tablet_bootstrap.cc:654] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.308214 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.308333 15388 ts_tablet_manager.cc:1916] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.310395 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcb5f7e52507450c8a6f5a99a9927974. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.310755 15445 raft_consensus.cc:493] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.310815 15445 raft_consensus.cc:515] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.311090 15445 leader_election.cc:290] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.311671 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1ae9934b0ca403ea026233ecd952a20" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.310153 15388 ts_tablet_manager.cc:1929] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.311841 15388 log.cc:1199] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/834a6c675ac54dbdb5416c683384d96e
I20251025 08:02:25.312040 15385 ts_tablet_manager.cc:1916] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.312060 15388 ts_tablet_manager.cc:1950] T 834a6c675ac54dbdb5416c683384d96e P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.312505 15388 tablet_replica.cc:333] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.312631 15388 raft_consensus.cc:2243] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.313184 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fdc5bd4c7f4506a150f31137e8b091. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.311766 15113 raft_consensus.cc:2468] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:25.313853 15385 ts_tablet_manager.cc:1929] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.313907 14915 leader_election.cc:304] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.313925 15385 log.cc:1199] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/a12f1428ccda4cef8c00a34630f2e54e
I20251025 08:02:25.314154 15374 raft_consensus.cc:2804] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.314240 15374 raft_consensus.cc:493] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.314275 15385 ts_tablet_manager.cc:1950] T a12f1428ccda4cef8c00a34630f2e54e P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.314285 15374 raft_consensus.cc:3060] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.314647 14654 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_7814293c383d4c8dbb1d384665c7c381" } new_table_name: "default.Table_4ed89f5fc452467d920d19caa6fb931a" modify_external_catalogs: true
I20251025 08:02:25.312721 15388 raft_consensus.cc:2272] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.314932 15386 ts_tablet_manager.cc:1916] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.315016 15374 raft_consensus.cc:515] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.315222 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 834a6c675ac54dbdb5416c683384d96e (table default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]) successfully deleted
I20251025 08:02:25.315361 15374 leader_election.cc:290] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.315382 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_530e7f5173d54781a219bcd014267a9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.315578 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1ae9934b0ca403ea026233ecd952a20" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:25.315665 15113 raft_consensus.cc:3060] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:25.315683 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_530e7f5173d54781a219bcd014267a9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.315681 14651 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_edf442ff1fc5473b9319e348741e3ab4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.316408 15113 raft_consensus.cc:2468] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
W20251025 08:02:25.316591 14651 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_edf442ff1fc5473b9319e348741e3ab4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.316627 14915 leader_election.cc:304] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.316741 15374 raft_consensus.cc:2804] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.316803 15374 raft_consensus.cc:697] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:25.316898 15374 consensus_queue.cc:237] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.316953 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1ae9934b0ca403ea026233ecd952a20" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:25.316987 15388 ts_tablet_manager.cc:1916] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.317224 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f89313f3d7344132b2fb0fab8941bb3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.318624 15388 ts_tablet_manager.cc:1929] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.318675 15388 log.cc:1199] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/f2d7e4ad8c2f4915b721b77846cfc3cb
I20251025 08:02:25.318883 15388 ts_tablet_manager.cc:1950] T f2d7e4ad8c2f4915b721b77846cfc3cb P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.319169 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f08d0c3446dd4a478f81688a3259bb91. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.319284 15388 tablet_replica.cc:333] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.319295 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8576553f17b49f8bd11436ecac471ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.319396 15388 raft_consensus.cc:2243] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.319466 15388 raft_consensus.cc:2272] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.319605 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet a12f1428ccda4cef8c00a34630f2e54e (table default.Table_fc8b1dd5aa12482895416350908e36fd [id=eaba715cb2c74aca915cf7d374ee17a7]) successfully deleted
I20251025 08:02:25.320525 15388 ts_tablet_manager.cc:1916] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.321151 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14e12c45323420b84de06d828238caa. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:25.321514 14914 leader_election.cc:343] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.321548 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1ae9934b0ca403ea026233ecd952a20" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:25.321815 14914 leader_election.cc:343] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.322232 15388 ts_tablet_manager.cc:1929] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.322284 15388 log.cc:1199] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/a12f1428ccda4cef8c00a34630f2e54e
I20251025 08:02:25.322453 15388 ts_tablet_manager.cc:1950] T a12f1428ccda4cef8c00a34630f2e54e P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.322996 14652 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet ff82c6ab12c844339dd387569fb85526
I20251025 08:02:25.323159 15445 raft_consensus.cc:493] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.323244 14652 catalog_manager.cc:6719] ReplaceTablet: tablet ff82c6ab12c844339dd387569fb85526 deleted and replaced by tablet 8737df10a3c8482c995ac6aadc240c42
I20251025 08:02:25.323243 15445 raft_consensus.cc:515] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.323530 15445 leader_election.cc:290] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.324059 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bf26408c98e49298ff9c738a1e26cf9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.324394 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet f2d7e4ad8c2f4915b721b77846cfc3cb (table default.Table_4c48d1da14fd4f6db57aaea031a1992e [id=215b7ed86cf7422b826890834307b839]) successfully deleted
I20251025 08:02:25.324559 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet a12f1428ccda4cef8c00a34630f2e54e (table default.Table_fc8b1dd5aa12482895416350908e36fd [id=eaba715cb2c74aca915cf7d374ee17a7]) successfully deleted
W20251025 08:02:25.324923 14914 leader_election.cc:343] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.325045 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet ff82c6ab12c844339dd387569fb85526 with delete_type TABLET_DATA_DELETED (replaced by tablet 8737df10a3c8482c995ac6aadc240c42) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.325177 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet ff82c6ab12c844339dd387569fb85526 with delete_type TABLET_DATA_DELETED (replaced by tablet 8737df10a3c8482c995ac6aadc240c42) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.325202 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet ff82c6ab12c844339dd387569fb85526 with delete_type TABLET_DATA_DELETED (replaced by tablet 8737df10a3c8482c995ac6aadc240c42) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.325269 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bf26408c98e49298ff9c738a1e26cf9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.325356 15113 raft_consensus.cc:2468] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:25.325592 15386 ts_tablet_manager.cc:1929] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.325670 15386 log.cc:1199] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/70ac567d5918403093bf71d9d9fc99b9
I20251025 08:02:25.325851 15386 ts_tablet_manager.cc:1950] T 70ac567d5918403093bf71d9d9fc99b9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.326085 15247 raft_consensus.cc:1275] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20251025 08:02:25.326488 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet ff82c6ab12c844339dd387569fb85526 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff82c6ab12c844339dd387569fb85526 already in progress: creating tablet
I20251025 08:02:25.326603 15445 consensus_queue.cc:1048] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.326858 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 70ac567d5918403093bf71d9d9fc99b9 (table default.Table_bd3b1a4a23a447bead9ce165c79693e6 [id=000ce64aa9d14e45ae6570f8948bb0a3]) successfully deleted
I20251025 08:02:25.327016 15386 tablet_replica.cc:333] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.327102 15386 raft_consensus.cc:2243] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.327176 15386 raft_consensus.cc:2272] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:25.327374 14654 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 72ff369b973b4c5981ea0810e37e8562 consensus state has no leader
I20251025 08:02:25.329154 14915 leader_election.cc:304] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.329334 15445 raft_consensus.cc:2804] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.329377 15445 raft_consensus.cc:493] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.329411 15445 raft_consensus.cc:3060] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.330206 15113 raft_consensus.cc:1275] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:25.330240 15445 raft_consensus.cc:515] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:25.330348 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet ff82c6ab12c844339dd387569fb85526 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff82c6ab12c844339dd387569fb85526 already in progress: creating tablet
I20251025 08:02:25.330529 15445 leader_election.cc:290] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.330731 15386 ts_tablet_manager.cc:1916] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.331446 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bf26408c98e49298ff9c738a1e26cf9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:25.331822 14914 leader_election.cc:343] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.331947 15445 consensus_queue.cc:1048] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.332383 15386 ts_tablet_manager.cc:1929] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.332435 15386 log.cc:1199] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/db53440e199841c39c4003068ebb0c20
I20251025 08:02:25.332593 15386 ts_tablet_manager.cc:1950] T db53440e199841c39c4003068ebb0c20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.333415 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet db53440e199841c39c4003068ebb0c20 (table default.Table_00008a9b750c4657a17eb05a159e1b2c [id=18c8cd5376a34a12af35ba88bfe7b176]) successfully deleted
I20251025 08:02:25.334050 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3bf26408c98e49298ff9c738a1e26cf9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:25.334127 15113 raft_consensus.cc:3060] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.334097 15445 consensus_queue.cc:1048] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.334883 15113 raft_consensus.cc:2468] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:25.334893 14959 tablet_service.cc:1505] Processing CreateTablet for tablet b3fdc5bd4c7f4506a150f31137e8b091 (DEFAULT_TABLE table=default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.335100 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3fdc5bd4c7f4506a150f31137e8b091. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.335146 14915 leader_election.cc:304] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.335330 15445 raft_consensus.cc:2804] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.335414 15445 raft_consensus.cc:697] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:25.335511 15445 consensus_queue.cc:237] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:25.336848 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet ff82c6ab12c844339dd387569fb85526 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ff82c6ab12c844339dd387569fb85526 already in progress: creating tablet
I20251025 08:02:25.339596 14651 catalog_manager.cc:5649] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.339794 14651 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet b1ae9934b0ca403ea026233ecd952a20 (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]). Expected version 1 got 0
I20251025 08:02:25.340236 14650 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 35eb28e4cabf4e59b8245fa3adc57872 (table default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]). Expected version 3 got 0
I20251025 08:02:25.341818 15464 consensus_queue.cc:1048] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.342254 14652 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 35eb28e4cabf4e59b8245fa3adc57872 (table default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]). Expected version 3 got 0
I20251025 08:02:25.342367 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 0310efe286dd409ab857a92daa6ff99f (DEFAULT_TABLE table=default.Table_fc8b1dd5aa12482895416350908e36fd [id=eaba715cb2c74aca915cf7d374ee17a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.342561 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0310efe286dd409ab857a92daa6ff99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.343207 15464 raft_consensus.cc:493] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.343273 15464 raft_consensus.cc:515] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.343621 15464 leader_election.cc:290] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.343932 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "97df7606f88c4b59a722f6c0359851d9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:25.344233 14914 leader_election.cc:343] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.344977 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 0310efe286dd409ab857a92daa6ff99f (DEFAULT_TABLE table=default.Table_fc8b1dd5aa12482895416350908e36fd [id=eaba715cb2c74aca915cf7d374ee17a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.345027 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "97df7606f88c4b59a722f6c0359851d9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.345124 15114 raft_consensus.cc:2468] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:25.345178 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0310efe286dd409ab857a92daa6ff99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.345342 14915 leader_election.cc:304] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.345356 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 0310efe286dd409ab857a92daa6ff99f (DEFAULT_TABLE table=default.Table_fc8b1dd5aa12482895416350908e36fd [id=eaba715cb2c74aca915cf7d374ee17a7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.345551 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0310efe286dd409ab857a92daa6ff99f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.345535 15464 raft_consensus.cc:2804] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.345579 15464 raft_consensus.cc:493] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.345611 15464 raft_consensus.cc:3060] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.346417 15464 raft_consensus.cc:515] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.346697 15464 leader_election.cc:290] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.347043 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "97df7606f88c4b59a722f6c0359851d9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:25.347340 14914 leader_election.cc:343] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.347499 14650 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_edf442ff1fc5473b9319e348741e3ab4" } new_table_name: "default.Table_142559297ae1426890d283339068330a" modify_external_catalogs: true
I20251025 08:02:25.347898 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "97df7606f88c4b59a722f6c0359851d9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:25.348001 15114 raft_consensus.cc:3060] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.348759 15114 raft_consensus.cc:2468] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:25.349149 14915 leader_election.cc:304] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.349736 15374 raft_consensus.cc:2804] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.349802 15374 raft_consensus.cc:697] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:25.349903 15374 consensus_queue.cc:237] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.350813 15451 tablet.cc:1722] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:25.351802 15783 tablet.cc:1722] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:25.353312 14646 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_de463c68e4cf4110a906098e963221eb" } modify_external_catalogs: true
I20251025 08:02:25.353396 14646 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_de463c68e4cf4110a906098e963221eb" } modify_external_catalogs: true
I20251025 08:02:25.354557 15436 tablet.cc:1722] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:25.356148 14652 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_d5f1669745ce40c9afcd65029292ea51" } modify_external_catalogs: true
I20251025 08:02:25.356240 14652 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_d5f1669745ce40c9afcd65029292ea51" } modify_external_catalogs: true
W20251025 08:02:25.360883 14650 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bcf414d04305456b80b2ec5dd8fb0ba7 has no consensus state
I20251025 08:02:25.365460 14652 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8
I20251025 08:02:25.366462 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.366488 14652 master_service.cc:954] ReplaceTablet: received request to replace tablet 81e7695e1a0d47c881f2851d97ada61b from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.366515 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.366567 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.366708 15388 tablet_replica.cc:333] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.366714 15385 tablet_replica.cc:333] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
W20251025 08:02:25.366792 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8 already in progress: creating tablet
I20251025 08:02:25.366817 15388 raft_consensus.cc:2243] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:25.366827 15385 raft_consensus.cc:2243] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.366925 15385 raft_consensus.cc:2272] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.366952 15388 pending_rounds.cc:70] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:25.366994 15388 pending_rounds.cc:77] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609797740703744 op_type: NO_OP noop_request { }
I20251025 08:02:25.367038 15388 raft_consensus.cc:2889] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:25.367089 15388 raft_consensus.cc:2272] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.367699 15385 ts_tablet_manager.cc:1916] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.368940 15369 tablet_bootstrap.cc:492] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.369081 15369 ts_tablet_manager.cc:1403] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.096s user 0.002s sys 0.000s
I20251025 08:02:25.369406 15385 ts_tablet_manager.cc:1929] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.369470 15385 log.cc:1199] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/2ba7db73d6c3469aa0fd1a78ca32c4d8
I20251025 08:02:25.369529 15369 raft_consensus.cc:359] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.369638 15369 raft_consensus.cc:385] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.369691 15369 raft_consensus.cc:740] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.369799 15369 consensus_queue.cc:260] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.369959 15370 tablet_bootstrap.cc:492] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.370036 15370 ts_tablet_manager.cc:1403] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.063s user 0.001s sys 0.000s
I20251025 08:02:25.370078 15369 ts_tablet_manager.cc:1434] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.370265 15369 tablet_bootstrap.cc:492] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.370479 15370 raft_consensus.cc:359] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.370576 15370 raft_consensus.cc:385] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.370620 15370 raft_consensus.cc:740] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.370774 15370 consensus_queue.cc:260] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.371039 15370 ts_tablet_manager.cc:1434] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.371244 15370 tablet_bootstrap.cc:492] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.371256 15369 tablet_bootstrap.cc:654] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.372238 15370 tablet_bootstrap.cc:654] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.369655 15385 ts_tablet_manager.cc:1950] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.375037 14978 raft_consensus.cc:1275] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:25.375486 15388 ts_tablet_manager.cc:1916] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.375517 15380 consensus_queue.cc:1048] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.375934 14650 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_fc8b1dd5aa12482895416350908e36fd" } modify_external_catalogs: true
I20251025 08:02:25.375993 15247 raft_consensus.cc:3060] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.376047 14650 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_fc8b1dd5aa12482895416350908e36fd" } modify_external_catalogs: true
I20251025 08:02:25.376910 15247 raft_consensus.cc:1275] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:25.376988 15370 tablet_bootstrap.cc:492] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.377050 15370 ts_tablet_manager.cc:1403] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251025 08:02:25.377233 15388 ts_tablet_manager.cc:1929] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:25.377291 15388 log.cc:1199] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/2ba7db73d6c3469aa0fd1a78ca32c4d8
I20251025 08:02:25.377362 15380 consensus_queue.cc:1048] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.377519 15388 ts_tablet_manager.cc:1950] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.377854 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8 (table default.Table_d5f1669745ce40c9afcd65029292ea51 [id=42a26b3ac1e54d518e958e6ea0cf22c8]) successfully deleted
I20251025 08:02:25.378171 15370 raft_consensus.cc:359] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.378276 15370 raft_consensus.cc:385] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.378306 15370 raft_consensus.cc:740] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.378603 15370 consensus_queue.cc:260] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.379446 15370 ts_tablet_manager.cc:1434] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:25.379720 15370 tablet_bootstrap.cc:492] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.381551 14649 master_service.cc:954] ReplaceTablet: received request to replace tablet 0310efe286dd409ab857a92daa6ff99f from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.381829 14652 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 81e7695e1a0d47c881f2851d97ada61b
I20251025 08:02:25.382150 14652 catalog_manager.cc:6719] ReplaceTablet: tablet 81e7695e1a0d47c881f2851d97ada61b deleted and replaced by tablet 5e605f701a474fff80688533f3a398e7
I20251025 08:02:25.382439 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 81e7695e1a0d47c881f2851d97ada61b with delete_type TABLET_DATA_DELETED (replaced by tablet 5e605f701a474fff80688533f3a398e7) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.382448 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 81e7695e1a0d47c881f2851d97ada61b with delete_type TABLET_DATA_DELETED (replaced by tablet 5e605f701a474fff80688533f3a398e7) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.382691 15386 tablet_replica.cc:333] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.382804 15386 raft_consensus.cc:2243] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.382849 15436 tablet.cc:1722] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:25.382905 15386 raft_consensus.cc:2272] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.384804 14651 catalog_manager.cc:5649] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.385154 15386 ts_tablet_manager.cc:1916] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.385107 14651 catalog_manager.cc:5649] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.385270 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 81e7695e1a0d47c881f2851d97ada61b with delete_type TABLET_DATA_DELETED (replaced by tablet 5e605f701a474fff80688533f3a398e7) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.383191 15370 tablet_bootstrap.cc:654] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.385680 15388 tablet_replica.cc:333] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.385778 15388 raft_consensus.cc:2243] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:25.385782 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 45be7daf50e741c9b6f1eeedccae8c8e (DEFAULT_TABLE table=default.Table_5854b229e0af41b88196de4a1c9c0270 [id=e95f72536b1242469fd4dad2c4d1c276]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.385936 15388 raft_consensus.cc:2272] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.386022 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45be7daf50e741c9b6f1eeedccae8c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.386109 15090 tablet_service.cc:1505] Processing CreateTablet for tablet f585455b77df49738b44c31a3d7adb71 (DEFAULT_TABLE table=default.Table_d9d4e09b4b4f4014847e00428c183725 [id=37373d664cc54e57bed0f09a7c12c8e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.386335 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f585455b77df49738b44c31a3d7adb71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.386929 15088 tablet_service.cc:1505] Processing CreateTablet for tablet cf5008728a6241c096c9a76f8e374ceb (DEFAULT_TABLE table=default.Table_b2029265ed824a48b4f5db3a90b38bdf [id=025400eac2f746d7afc76aa78cd49c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.387069 15386 ts_tablet_manager.cc:1929] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.387118 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf5008728a6241c096c9a76f8e374ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.387127 15386 log.cc:1199] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/81e7695e1a0d47c881f2851d97ada61b
I20251025 08:02:25.387382 15386 ts_tablet_manager.cc:1950] T 81e7695e1a0d47c881f2851d97ada61b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.388214 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 74d87666abb643899a7b1e576e6cc840 (DEFAULT_TABLE table=default.Table_521f904aba4a4b309e9864df54df659d [id=a95abf5644c64177afde71baad186bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.388392 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d87666abb643899a7b1e576e6cc840. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.388563 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 45be7daf50e741c9b6f1eeedccae8c8e (DEFAULT_TABLE table=default.Table_5854b229e0af41b88196de4a1c9c0270 [id=e95f72536b1242469fd4dad2c4d1c276]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.388761 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45be7daf50e741c9b6f1eeedccae8c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.389120 15226 tablet_service.cc:1505] Processing CreateTablet for tablet 74d87666abb643899a7b1e576e6cc840 (DEFAULT_TABLE table=default.Table_521f904aba4a4b309e9864df54df659d [id=a95abf5644c64177afde71baad186bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.389276 15388 ts_tablet_manager.cc:1916] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.389331 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d87666abb643899a7b1e576e6cc840. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.390296 15229 tablet_service.cc:1505] Processing CreateTablet for tablet f585455b77df49738b44c31a3d7adb71 (DEFAULT_TABLE table=default.Table_d9d4e09b4b4f4014847e00428c183725 [id=37373d664cc54e57bed0f09a7c12c8e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.390368 15218 tablet_service.cc:1505] Processing CreateTablet for tablet cf5008728a6241c096c9a76f8e374ceb (DEFAULT_TABLE table=default.Table_b2029265ed824a48b4f5db3a90b38bdf [id=025400eac2f746d7afc76aa78cd49c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.390480 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f585455b77df49738b44c31a3d7adb71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.390780 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf5008728a6241c096c9a76f8e374ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.391867 15388 ts_tablet_manager.cc:1929] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.391927 15388 log.cc:1199] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/81e7695e1a0d47c881f2851d97ada61b
I20251025 08:02:25.392392 15388 ts_tablet_manager.cc:1950] T 81e7695e1a0d47c881f2851d97ada61b P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.392714 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 81e7695e1a0d47c881f2851d97ada61b (table default.Table_e650e0b918954a7f8c97ff7e8e9bcffd [id=dfe9146b50254c54ad1b75080a2ee201]) successfully deleted
I20251025 08:02:25.393770 15783 tablet.cc:1722] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:25.394233 15464 raft_consensus.cc:493] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.394304 15464 raft_consensus.cc:515] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.394598 15464 leader_election.cc:290] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.395402 15221 tablet_service.cc:1505] Processing CreateTablet for tablet 0a187a088f5042c081aa87c79662c8cf (DEFAULT_TABLE table=default.Table_530e7f5173d54781a219bcd014267a9f [id=4b8789f2c2234483aa891cad1334c474]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.395573 15221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a187a088f5042c081aa87c79662c8cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.395913 15226 tablet_service.cc:1505] Processing CreateTablet for tablet bcf414d04305456b80b2ec5dd8fb0ba7 (DEFAULT_TABLE table=default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.396111 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcf414d04305456b80b2ec5dd8fb0ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.397334 14652 master_service.cc:954] ReplaceTablet: received request to replace tablet 4dd72f76c950485c968409fe868266a2 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.397818 15114 raft_consensus.cc:1275] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:25.397955 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06b3cc87826249ccb1f84c29df09f802" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.398043 15112 raft_consensus.cc:1275] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:25.398052 15113 raft_consensus.cc:2468] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:25.398218 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06b3cc87826249ccb1f84c29df09f802" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.398224 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 0a187a088f5042c081aa87c79662c8cf (DEFAULT_TABLE table=default.Table_530e7f5173d54781a219bcd014267a9f [id=4b8789f2c2234483aa891cad1334c474]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.398409 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a187a088f5042c081aa87c79662c8cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.398628 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 8737df10a3c8482c995ac6aadc240c42 (DEFAULT_TABLE table=default.Table_7a2d41df4f9d4874b3403fdef1ae1e72 [id=c8b69f7419b842c18f324e0c08ba840a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.398680 15374 consensus_queue.cc:1048] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.398727 14915 leader_election.cc:304] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.398836 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8737df10a3c8482c995ac6aadc240c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.398891 15445 consensus_queue.cc:1048] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.398947 15374 raft_consensus.cc:2804] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.399003 15374 raft_consensus.cc:493] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.399051 15374 raft_consensus.cc:3060] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:25.399324 14914 consensus_peers.cc:597] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20251025 08:02:25.399415 14914 consensus_peers.cc:597] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20251025 08:02:25.399511 14914 leader_election.cc:343] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.399861 15374 raft_consensus.cc:515] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.400194 15374 leader_election.cc:290] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.400988 15451 tablet.cc:1722] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:25.401211 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06b3cc87826249ccb1f84c29df09f802" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:25.401216 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06b3cc87826249ccb1f84c29df09f802" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:25.401312 15114 raft_consensus.cc:3060] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:25.401747 14914 leader_election.cc:343] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.402110 15114 raft_consensus.cc:2468] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:25.402181 15385 tablet_replica.cc:333] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.402324 15385 raft_consensus.cc:2243] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.402413 15385 raft_consensus.cc:2272] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.402727 15092 tablet_service.cc:1505] Processing CreateTablet for tablet cf90d2e477b9493e9b78aae6a7d2d3e0 (DEFAULT_TABLE table=default.Table_e22e6abaeec0420496616ee334cf07eb [id=b3be7f970bc745f7873e9d54a68e3e50]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.402769 14915 leader_election.cc:304] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.402907 15464 raft_consensus.cc:2804] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.402901 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 81e7695e1a0d47c881f2851d97ada61b (table default.Table_e650e0b918954a7f8c97ff7e8e9bcffd [id=dfe9146b50254c54ad1b75080a2ee201]) successfully deleted
I20251025 08:02:25.402980 15464 raft_consensus.cc:697] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:25.403084 15464 consensus_queue.cc:237] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.403136 15385 ts_tablet_manager.cc:1916] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.403854 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf90d2e477b9493e9b78aae6a7d2d3e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.405592 15385 ts_tablet_manager.cc:1929] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.405661 15385 log.cc:1199] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/81e7695e1a0d47c881f2851d97ada61b
I20251025 08:02:25.405930 15385 ts_tablet_manager.cc:1950] T 81e7695e1a0d47c881f2851d97ada61b P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.408496 14652 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 4dd72f76c950485c968409fe868266a2
I20251025 08:02:25.408533 14650 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 0310efe286dd409ab857a92daa6ff99f
I20251025 08:02:25.408696 14654 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6] alter complete (version 3)
I20251025 08:02:25.408696 14652 catalog_manager.cc:6719] ReplaceTablet: tablet 4dd72f76c950485c968409fe868266a2 deleted and replaced by tablet 4f3163f8a4ff49069d55b9acf8a4c19a
I20251025 08:02:25.409111 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 4dd72f76c950485c968409fe868266a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4f3163f8a4ff49069d55b9acf8a4c19a) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.410254 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 0310efe286dd409ab857a92daa6ff99f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.410714 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 4dd72f76c950485c968409fe868266a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4f3163f8a4ff49069d55b9acf8a4c19a) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.412133 14646 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 4134d50b613748fd9291ff245047af33
I20251025 08:02:25.412300 15093 tablet_service.cc:1505] Processing CreateTablet for tablet bcf414d04305456b80b2ec5dd8fb0ba7 (DEFAULT_TABLE table=default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.412528 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcf414d04305456b80b2ec5dd8fb0ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.412508 14651 catalog_manager.cc:5649] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.412678 14651 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 06b3cc87826249ccb1f84c29df09f802 (table default.Table_f5bf4f0664c44a70aa6d2f0e9143f7a7 [id=6739c1319b784c8eb66fc75125f83056]). Expected version 3 got 0
I20251025 08:02:25.412672 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 4134d50b613748fd9291ff245047af33 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
W20251025 08:02:25.414083 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 4dd72f76c950485c968409fe868266a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dd72f76c950485c968409fe868266a2 already in progress: creating tablet
I20251025 08:02:25.414134 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 0310efe286dd409ab857a92daa6ff99f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
W20251025 08:02:25.414255 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 4134d50b613748fd9291ff245047af33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4134d50b613748fd9291ff245047af33 already in progress: creating tablet
W20251025 08:02:25.414466 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 0310efe286dd409ab857a92daa6ff99f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0310efe286dd409ab857a92daa6ff99f already in progress: creating tablet
W20251025 08:02:25.414575 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 4dd72f76c950485c968409fe868266a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dd72f76c950485c968409fe868266a2 already in progress: creating tablet
W20251025 08:02:25.414556 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 0310efe286dd409ab857a92daa6ff99f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0310efe286dd409ab857a92daa6ff99f already in progress: creating tablet
I20251025 08:02:25.415911 15464 raft_consensus.cc:493] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.415987 15464 raft_consensus.cc:515] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.416255 15464 leader_election.cc:290] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.416905 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b49d48b94b0427aa2dcc39dae45a4eb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.417058 14652 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_d6e61e9e78464c9096cbb26d6eb98c2e" } new_table_name: "default.Table_9bbb4f343dc64170b9f81ce2f0c5f37f" modify_external_catalogs: true
W20251025 08:02:25.417261 14914 leader_election.cc:343] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.417801 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 8737df10a3c8482c995ac6aadc240c42 (DEFAULT_TABLE table=default.Table_7a2d41df4f9d4874b3403fdef1ae1e72 [id=c8b69f7419b842c18f324e0c08ba840a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.417884 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b49d48b94b0427aa2dcc39dae45a4eb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.417986 15112 raft_consensus.cc:2468] T 5b49d48b94b0427aa2dcc39dae45a4eb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:25.418025 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8737df10a3c8482c995ac6aadc240c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.418128 15436 tablet.cc:1722] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.418282 14915 leader_election.cc:304] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.418545 15445 raft_consensus.cc:2804] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.418602 15445 raft_consensus.cc:493] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.418650 15445 raft_consensus.cc:3060] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.419003 15229 tablet_service.cc:1505] Processing CreateTablet for tablet cf90d2e477b9493e9b78aae6a7d2d3e0 (DEFAULT_TABLE table=default.Table_e22e6abaeec0420496616ee334cf07eb [id=b3be7f970bc745f7873e9d54a68e3e50]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.419210 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf90d2e477b9493e9b78aae6a7d2d3e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.419406 15445 raft_consensus.cc:515] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.419701 15445 leader_election.cc:290] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.419983 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b49d48b94b0427aa2dcc39dae45a4eb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:25.420219 14914 leader_election.cc:343] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.420306 15451 tablet.cc:1722] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.421257 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b49d48b94b0427aa2dcc39dae45a4eb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:25.421351 15113 raft_consensus.cc:3060] T 5b49d48b94b0427aa2dcc39dae45a4eb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.422099 15113 raft_consensus.cc:2468] T 5b49d48b94b0427aa2dcc39dae45a4eb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:25.422453 15497 raft_consensus.cc:493] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.422479 14915 leader_election.cc:304] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.422539 15497 raft_consensus.cc:515] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.422827 15497 leader_election.cc:290] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.423175 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4134d50b613748fd9291ff245047af33" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.423664 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8 (table default.Table_d5f1669745ce40c9afcd65029292ea51 [id=42a26b3ac1e54d518e958e6ea0cf22c8]) successfully deleted
I20251025 08:02:25.423789 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 81e7695e1a0d47c881f2851d97ada61b (table default.Table_e650e0b918954a7f8c97ff7e8e9bcffd [id=dfe9146b50254c54ad1b75080a2ee201]) successfully deleted
I20251025 08:02:25.423868 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4134d50b613748fd9291ff245047af33" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:25.424079 15049 leader_election.cc:343] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:25.424157 15048 leader_election.cc:343] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.424216 15048 leader_election.cc:304] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.424553 15497 raft_consensus.cc:2749] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.426051 14955 tablet_service.cc:1505] Processing CreateTablet for tablet cf5008728a6241c096c9a76f8e374ceb (DEFAULT_TABLE table=default.Table_b2029265ed824a48b4f5db3a90b38bdf [id=025400eac2f746d7afc76aa78cd49c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.426298 14959 tablet_service.cc:1505] Processing CreateTablet for tablet f585455b77df49738b44c31a3d7adb71 (DEFAULT_TABLE table=default.Table_d9d4e09b4b4f4014847e00428c183725 [id=37373d664cc54e57bed0f09a7c12c8e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.426424 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 45be7daf50e741c9b6f1eeedccae8c8e (DEFAULT_TABLE table=default.Table_5854b229e0af41b88196de4a1c9c0270 [id=e95f72536b1242469fd4dad2c4d1c276]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.426450 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 74d87666abb643899a7b1e576e6cc840 (DEFAULT_TABLE table=default.Table_521f904aba4a4b309e9864df54df659d [id=a95abf5644c64177afde71baad186bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.426733 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 8737df10a3c8482c995ac6aadc240c42 (DEFAULT_TABLE table=default.Table_7a2d41df4f9d4874b3403fdef1ae1e72 [id=c8b69f7419b842c18f324e0c08ba840a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.426920 14954 tablet_service.cc:1505] Processing CreateTablet for tablet cf90d2e477b9493e9b78aae6a7d2d3e0 (DEFAULT_TABLE table=default.Table_e22e6abaeec0420496616ee334cf07eb [id=b3be7f970bc745f7873e9d54a68e3e50]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.427021 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet 4dd72f76c950485c968409fe868266a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4f3163f8a4ff49069d55b9acf8a4c19a) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.427083 14953 tablet_service.cc:1505] Processing CreateTablet for tablet bcf414d04305456b80b2ec5dd8fb0ba7 (DEFAULT_TABLE table=default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.427163 14950 tablet_service.cc:1552] Processing DeleteTablet for tablet 0310efe286dd409ab857a92daa6ff99f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.427261 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 0a187a088f5042c081aa87c79662c8cf (DEFAULT_TABLE table=default.Table_530e7f5173d54781a219bcd014267a9f [id=4b8789f2c2234483aa891cad1334c474]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.427306 15464 raft_consensus.cc:2804] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.427390 15464 raft_consensus.cc:697] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:25.427492 15464 consensus_queue.cc:237] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.427724 14949 tablet_service.cc:1552] Processing DeleteTablet for tablet 4134d50b613748fd9291ff245047af33 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.428617 15436 tablet.cc:1722] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.428771 15451 tablet.cc:1722] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.429195 14647 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_219931bbd7ec46f7bee6b90d2c3145ae"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.429507 14647 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_219931bbd7ec46f7bee6b90d2c3145ae in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:25.429805 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 4dd72f76c950485c968409fe868266a2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dd72f76c950485c968409fe868266a2 already in progress: creating tablet
W20251025 08:02:25.429919 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 0310efe286dd409ab857a92daa6ff99f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0310efe286dd409ab857a92daa6ff99f already in progress: creating tablet
W20251025 08:02:25.430069 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 4134d50b613748fd9291ff245047af33 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4134d50b613748fd9291ff245047af33 already in progress: creating tablet
I20251025 08:02:25.430238 14650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_d57dfa9ab2164520aa85ebfdd8a85546"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.430534 14650 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d57dfa9ab2164520aa85ebfdd8a85546 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.432116 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 4134d50b613748fd9291ff245047af33 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.432770 15388 tablet_replica.cc:333] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.432893 15388 raft_consensus.cc:2243] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.432996 15388 raft_consensus.cc:2272] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:25.434283 14652 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76a906654cc44bfb96d9e1a936040e57 consensus state has no leader
I20251025 08:02:25.436028 15388 ts_tablet_manager.cc:1916] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.436069 15372 tablet_bootstrap.cc:492] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.436153 15372 ts_tablet_manager.cc:1403] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.156s user 0.001s sys 0.000s
I20251025 08:02:25.436605 15372 raft_consensus.cc:359] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.436695 15372 raft_consensus.cc:385] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.436729 15372 raft_consensus.cc:740] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.436826 15372 consensus_queue.cc:260] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.437119 15372 ts_tablet_manager.cc:1434] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.437291 15372 tablet_bootstrap.cc:492] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.437919 15388 ts_tablet_manager.cc:1929] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.437996 15388 log.cc:1199] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/4134d50b613748fd9291ff245047af33
I20251025 08:02:25.426311 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf5008728a6241c096c9a76f8e374ceb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.438388 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74d87666abb643899a7b1e576e6cc840. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.438481 15372 tablet_bootstrap.cc:654] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.438529 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcf414d04305456b80b2ec5dd8fb0ba7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.438634 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_cd97ecbd521e4d4b8f03836dbb9e15cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.438915 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd97ecbd521e4d4b8f03836dbb9e15cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.439646 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a187a088f5042c081aa87c79662c8cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.440052 15370 tablet_bootstrap.cc:492] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.440158 15370 ts_tablet_manager.cc:1403] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.060s user 0.000s sys 0.002s
I20251025 08:02:25.440328 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45be7daf50e741c9b6f1eeedccae8c8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.440579 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8737df10a3c8482c995ac6aadc240c42. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.440589 15370 raft_consensus.cc:359] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.440663 15370 raft_consensus.cc:385] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.440690 15370 raft_consensus.cc:740] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.440814 15370 consensus_queue.cc:260] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.441391 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f585455b77df49738b44c31a3d7adb71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.442672 14652 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_ddb045f037264e75a3a270929fae8239" } modify_external_catalogs: true
I20251025 08:02:25.442754 14652 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_ddb045f037264e75a3a270929fae8239" } modify_external_catalogs: true
I20251025 08:02:25.443136 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf90d2e477b9493e9b78aae6a7d2d3e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.443320 15370 ts_tablet_manager.cc:1434] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:25.443486 15370 tablet_bootstrap.cc:492] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.444495 14653 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_6a446944f6d94a81bea892d25a3ed54e" } new_table_name: "default.Table_9f0385b6e26c4f259e1eedb673daea56" modify_external_catalogs: true
I20251025 08:02:25.445294 15370 tablet_bootstrap.cc:654] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.447777 15497 raft_consensus.cc:493] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.447840 15497 raft_consensus.cc:515] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.448197 15388 ts_tablet_manager.cc:1950] T 4134d50b613748fd9291ff245047af33 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.448443 15642 consensus_queue.cc:1048] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.448488 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e5e6d65e6ed4c228e97d7b8c3d63d65" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.448177 15497 leader_election.cc:290] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.449154 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e5e6d65e6ed4c228e97d7b8c3d63d65" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.449194 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 4134d50b613748fd9291ff245047af33 (table default.Table_de463c68e4cf4110a906098e963221eb [id=1686afc032714790a429b58ea8c0e5b1]) successfully deleted
I20251025 08:02:25.449268 14978 raft_consensus.cc:2468] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
W20251025 08:02:25.449630 15049 leader_election.cc:343] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.450062 15048 leader_election.cc:304] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.450842 15497 raft_consensus.cc:2804] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.450913 15497 raft_consensus.cc:493] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.450976 15497 raft_consensus.cc:3060] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.451649 15369 tablet_bootstrap.cc:492] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.451741 15369 ts_tablet_manager.cc:1403] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.082s user 0.002s sys 0.000s
I20251025 08:02:25.451829 15497 raft_consensus.cc:515] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.452158 15497 leader_election.cc:290] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.452190 15369 raft_consensus.cc:359] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.452292 15369 raft_consensus.cc:385] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.452344 15369 raft_consensus.cc:740] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.452442 15369 consensus_queue.cc:260] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.452701 15369 ts_tablet_manager.cc:1434] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.452859 15369 tablet_bootstrap.cc:492] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.453755 15369 tablet_bootstrap.cc:654] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.454479 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e5e6d65e6ed4c228e97d7b8c3d63d65" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:25.454567 14978 raft_consensus.cc:3060] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.454885 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e5e6d65e6ed4c228e97d7b8c3d63d65" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:25.455381 14978 raft_consensus.cc:2468] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
W20251025 08:02:25.455839 15049 leader_election.cc:343] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.455965 15048 leader_election.cc:304] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.456297 15380 raft_consensus.cc:2804] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.456370 15380 raft_consensus.cc:697] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:25.456472 15380 consensus_queue.cc:237] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.457952 14647 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_07dd75378eaf438d89036c48a5545591" } modify_external_catalogs: true
I20251025 08:02:25.457968 15380 consensus_queue.cc:1048] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.458047 14647 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_07dd75378eaf438d89036c48a5545591" } modify_external_catalogs: true
I20251025 08:02:25.460381 15370 tablet_bootstrap.cc:492] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.460457 15370 ts_tablet_manager.cc:1403] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.001s
I20251025 08:02:25.460776 15370 raft_consensus.cc:359] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.460872 15370 raft_consensus.cc:385] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.460901 15370 raft_consensus.cc:740] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.460991 15370 consensus_queue.cc:260] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.461267 15370 ts_tablet_manager.cc:1434] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.461850 15370 tablet_bootstrap.cc:492] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.462682 15370 tablet_bootstrap.cc:654] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.464740 15372 tablet_bootstrap.cc:492] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.464821 15372 ts_tablet_manager.cc:1403] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.001s
I20251025 08:02:25.465246 15372 raft_consensus.cc:359] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.465342 15372 raft_consensus.cc:385] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.465374 15372 raft_consensus.cc:740] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.465478 15372 consensus_queue.cc:260] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.465699 15372 ts_tablet_manager.cc:1434] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.465867 15372 tablet_bootstrap.cc:492] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.466518 14648 master_service.cc:954] ReplaceTablet: received request to replace tablet 97df7606f88c4b59a722f6c0359851d9 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.466848 15372 tablet_bootstrap.cc:654] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.467342 15380 raft_consensus.cc:493] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.467412 15380 raft_consensus.cc:515] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.467692 15380 leader_election.cc:290] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.468021 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1a10ef5ab73459695e1ef772e3a5266" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.469288 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c1a10ef5ab73459695e1ef772e3a5266" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:25.469633 15048 leader_election.cc:343] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:25.469704 15049 leader_election.cc:343] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.469770 15049 leader_election.cc:304] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.470049 15380 raft_consensus.cc:2749] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.472488 15372 tablet_bootstrap.cc:492] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.472563 15372 ts_tablet_manager.cc:1403] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20251025 08:02:25.472982 15372 raft_consensus.cc:359] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.473075 15372 raft_consensus.cc:385] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.473107 15372 raft_consensus.cc:740] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.473222 15372 consensus_queue.cc:260] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.473479 15372 ts_tablet_manager.cc:1434] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.473639 15372 tablet_bootstrap.cc:492] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.474337 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 5e605f701a474fff80688533f3a398e7 (DEFAULT_TABLE table=default.Table_e650e0b918954a7f8c97ff7e8e9bcffd [id=dfe9146b50254c54ad1b75080a2ee201]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.474540 15372 tablet_bootstrap.cc:654] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.474560 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e605f701a474fff80688533f3a398e7. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:25.475250 14653 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43da3f4fc9604562a95dff59da3c574b consensus state has no leader
I20251025 08:02:25.476013 14954 tablet_service.cc:1505] Processing CreateTablet for tablet 5e605f701a474fff80688533f3a398e7 (DEFAULT_TABLE table=default.Table_e650e0b918954a7f8c97ff7e8e9bcffd [id=dfe9146b50254c54ad1b75080a2ee201]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.476132 15372 tablet_bootstrap.cc:492] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.476234 15372 ts_tablet_manager.cc:1403] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251025 08:02:25.476258 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e605f701a474fff80688533f3a398e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.476658 15372 raft_consensus.cc:359] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.476747 15372 raft_consensus.cc:385] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.476778 15372 raft_consensus.cc:740] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.476884 15372 consensus_queue.cc:260] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.477133 15372 ts_tablet_manager.cc:1434] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.477303 15372 tablet_bootstrap.cc:492] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.479506 15372 tablet_bootstrap.cc:654] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.480716 15372 tablet_bootstrap.cc:492] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.480794 15372 ts_tablet_manager.cc:1403] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20251025 08:02:25.480773 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 5e605f701a474fff80688533f3a398e7 (DEFAULT_TABLE table=default.Table_e650e0b918954a7f8c97ff7e8e9bcffd [id=dfe9146b50254c54ad1b75080a2ee201]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.480985 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e605f701a474fff80688533f3a398e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.481184 15372 raft_consensus.cc:359] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.481277 15372 raft_consensus.cc:385] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.481307 15372 raft_consensus.cc:740] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.481416 15372 consensus_queue.cc:260] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.481616 15372 ts_tablet_manager.cc:1434] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.481747 15372 tablet_bootstrap.cc:492] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.483799 14647 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet f89313f3d7344132b2fb0fab8941bb3e
I20251025 08:02:25.484228 14648 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 97df7606f88c4b59a722f6c0359851d9
I20251025 08:02:25.484534 14648 catalog_manager.cc:6719] ReplaceTablet: tablet 97df7606f88c4b59a722f6c0359851d9 deleted and replaced by tablet b7e8a698e8ba408a833bbc3905b2ad04
I20251025 08:02:25.484545 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet f89313f3d7344132b2fb0fab8941bb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.484619 15372 tablet_bootstrap.cc:654] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.484933 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet f89313f3d7344132b2fb0fab8941bb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
W20251025 08:02:25.485212 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet f89313f3d7344132b2fb0fab8941bb3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f89313f3d7344132b2fb0fab8941bb3e already in progress: creating tablet
I20251025 08:02:25.485252 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 97df7606f88c4b59a722f6c0359851d9 with delete_type TABLET_DATA_DELETED (replaced by tablet b7e8a698e8ba408a833bbc3905b2ad04) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.485400 15388 tablet_replica.cc:333] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.485395 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 97df7606f88c4b59a722f6c0359851d9 with delete_type TABLET_DATA_DELETED (replaced by tablet b7e8a698e8ba408a833bbc3905b2ad04) from {username='slave'} at 127.0.0.1:36846
W20251025 08:02:25.485425 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet f89313f3d7344132b2fb0fab8941bb3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f89313f3d7344132b2fb0fab8941bb3e already in progress: creating tablet
I20251025 08:02:25.485532 15388 raft_consensus.cc:2243] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.485641 15388 raft_consensus.cc:2272] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:25.485757 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 97df7606f88c4b59a722f6c0359851d9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 97df7606f88c4b59a722f6c0359851d9 already in progress: creating tablet
I20251025 08:02:25.485805 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 97df7606f88c4b59a722f6c0359851d9 with delete_type TABLET_DATA_DELETED (replaced by tablet b7e8a698e8ba408a833bbc3905b2ad04) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.485965 15385 tablet_replica.cc:333] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.486083 15385 raft_consensus.cc:2243] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:25.486245 15385 pending_rounds.cc:70] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:25.486280 15385 pending_rounds.cc:77] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609798554456064 op_type: NO_OP noop_request { }
I20251025 08:02:25.486335 15385 raft_consensus.cc:2889] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:25.486393 15385 raft_consensus.cc:2272] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.486559 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet f89313f3d7344132b2fb0fab8941bb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.486897 15388 ts_tablet_manager.cc:1916] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.488920 15388 ts_tablet_manager.cc:1929] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.489059 15388 log.cc:1199] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/97df7606f88c4b59a722f6c0359851d9
I20251025 08:02:25.489411 15388 ts_tablet_manager.cc:1950] T 97df7606f88c4b59a722f6c0359851d9 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.490139 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 97df7606f88c4b59a722f6c0359851d9 (table default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]) successfully deleted
I20251025 08:02:25.490326 15385 ts_tablet_manager.cc:1916] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.491557 14649 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet e3cd7b63fa174ee192ff909f149e8b17 (table default.Table_a368af9d0b8d46d78f9158b8f9949b01 [id=425e69ea7f8a407e8d22b735ee62c709]). Expected version 1 got 0
I20251025 08:02:25.491757 14649 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 997c8c5921ad4ec18914fd50c97fc33e (table default.Table_a210a38e85814b3db16726f2a0a830b8 [id=cb9294ed7c474aae989ac13159ec3166]). Expected version 1 got 0
I20251025 08:02:25.491834 14649 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet b1ae9934b0ca403ea026233ecd952a20 (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]). Expected version 1 got 0
I20251025 08:02:25.492304 14651 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_8fd6304d02a6478fa31556344ab157ae [id=1ee33ee129d749d0bd7f26dc49fca0fe] alter complete (version 2)
I20251025 08:02:25.492465 15385 ts_tablet_manager.cc:1929] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:25.492527 15385 log.cc:1199] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/97df7606f88c4b59a722f6c0359851d9
I20251025 08:02:25.492769 15385 ts_tablet_manager.cc:1950] T 97df7606f88c4b59a722f6c0359851d9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.493806 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 97df7606f88c4b59a722f6c0359851d9 (table default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]) successfully deleted
I20251025 08:02:25.495354 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 1aa4677de4604abaa2dc6e5413c616a3 (DEFAULT_TABLE table=default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.495553 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa4677de4604abaa2dc6e5413c616a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.495868 14954 tablet_service.cc:1505] Processing CreateTablet for tablet 1aa4677de4604abaa2dc6e5413c616a3 (DEFAULT_TABLE table=default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.496560 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 4f3163f8a4ff49069d55b9acf8a4c19a (DEFAULT_TABLE table=default.Table_2631732663a24b55a695edc159006f87 [id=b9853b2d88cf4a96b9fc5e1099f87064]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.497416 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 4f3163f8a4ff49069d55b9acf8a4c19a (DEFAULT_TABLE table=default.Table_2631732663a24b55a695edc159006f87 [id=b9853b2d88cf4a96b9fc5e1099f87064]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.497612 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f3163f8a4ff49069d55b9acf8a4c19a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.499261 14652 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet b1ae9934b0ca403ea026233ecd952a20
I20251025 08:02:25.499779 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_808c7980d96b48a181f79124ea5a0adb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.500083 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_808c7980d96b48a181f79124ea5a0adb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.500231 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 1aa4677de4604abaa2dc6e5413c616a3 (DEFAULT_TABLE table=default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.500413 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa4677de4604abaa2dc6e5413c616a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.500736 14956 tablet_service.cc:1552] Processing DeleteTablet for tablet b1ae9934b0ca403ea026233ecd952a20 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.502233 14649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_b033036083304e88b2b6fe996fda724f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.502272 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 56263217eaaf4bb9a48a822061ddb369 with delete_type TABLET_DATA_DELETED (replaced by tablet a8393462039d4bb4aba66aee9e90b94a) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.502718 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet b1ae9934b0ca403ea026233ecd952a20 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.503088 14652 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_a87d1a89b11346989da36da121742fc7" } new_table_name: "default.Table_84b80cef0bc442cfb9f5301562ff1cce" modify_external_catalogs: true
I20251025 08:02:25.502296 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet b1ae9934b0ca403ea026233ecd952a20 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.503882 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f3163f8a4ff49069d55b9acf8a4c19a. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:25.503286 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet b1ae9934b0ca403ea026233ecd952a20 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b1ae9934b0ca403ea026233ecd952a20 already in progress: creating tablet
I20251025 08:02:25.503981 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 4f3163f8a4ff49069d55b9acf8a4c19a (DEFAULT_TABLE table=default.Table_2631732663a24b55a695edc159006f87 [id=b9853b2d88cf4a96b9fc5e1099f87064]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.504652 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f3163f8a4ff49069d55b9acf8a4c19a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.505707 15409 raft_consensus.cc:493] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.505784 15409 raft_consensus.cc:515] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.505947 14648 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_7257511e2df84f9cafdd1fe1ec4a180b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.506132 15409 leader_election.cc:290] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:25.506273 14648 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7257511e2df84f9cafdd1fe1ec4a180b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.506661 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c20947edc1f24e338cabf72b18282d24" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.506765 15113 raft_consensus.cc:2468] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:25.507063 15185 leader_election.cc:304] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:25.507231 15409 raft_consensus.cc:2804] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.507280 15409 raft_consensus.cc:493] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.507326 15409 raft_consensus.cc:3060] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.507480 14653 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_c485105a684f427295b74968c29fd30c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.507504 14647 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_129b50f9cb4f415382a1aa57c3f53670"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.507761 14653 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c485105a684f427295b74968c29fd30c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:25.507807 14647 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_129b50f9cb4f415382a1aa57c3f53670 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.508189 15409 raft_consensus.cc:515] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.508502 15409 leader_election.cc:290] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:25.508671 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet f89313f3d7344132b2fb0fab8941bb3e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f89313f3d7344132b2fb0fab8941bb3e already in progress: creating tablet
W20251025 08:02:25.508805 14649 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b033036083304e88b2b6fe996fda724f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.509450 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c20947edc1f24e338cabf72b18282d24" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:25.509553 15113 raft_consensus.cc:3060] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.510039 15372 tablet_bootstrap.cc:492] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.510102 15372 ts_tablet_manager.cc:1403] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.002s
I20251025 08:02:25.510453 15113 raft_consensus.cc:2468] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:25.510521 15372 raft_consensus.cc:359] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.510600 15372 raft_consensus.cc:385] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.510633 15372 raft_consensus.cc:740] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.510732 15372 consensus_queue.cc:260] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.510792 15185 leader_election.cc:304] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:25.510967 15372 ts_tablet_manager.cc:1434] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.511112 15372 tablet_bootstrap.cc:492] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.511636 15388 tablet_replica.cc:333] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.511755 15388 raft_consensus.cc:2243] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.511845 15388 raft_consensus.cc:2272] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.511920 15372 tablet_bootstrap.cc:654] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.512017 15445 raft_consensus.cc:493] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.512087 15445 raft_consensus.cc:515] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.512428 15445 leader_election.cc:290] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.512449 15384 raft_consensus.cc:2804] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.512512 15384 raft_consensus.cc:697] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:25.512611 15384 consensus_queue.cc:237] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.512775 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c20947edc1f24e338cabf72b18282d24" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.512915 15113 raft_consensus.cc:2393] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:25.513170 15388 ts_tablet_manager.cc:1916] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.513490 15369 tablet_bootstrap.cc:492] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.513561 15369 ts_tablet_manager.cc:1403] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.061s user 0.000s sys 0.001s
I20251025 08:02:25.513942 15369 raft_consensus.cc:359] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.514042 15369 raft_consensus.cc:385] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.514019 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c20947edc1f24e338cabf72b18282d24" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.514070 15369 raft_consensus.cc:740] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.514163 15369 consensus_queue.cc:260] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.514405 15369 ts_tablet_manager.cc:1434] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.514968 15384 raft_consensus.cc:493] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.515040 15384 raft_consensus.cc:515] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.515070 15388 ts_tablet_manager.cc:1929] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.515136 15388 log.cc:1199] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/56263217eaaf4bb9a48a822061ddb369
I20251025 08:02:25.515298 15384 leader_election.cc:290] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.515354 15388 ts_tablet_manager.cc:1950] T 56263217eaaf4bb9a48a822061ddb369 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.515825 15388 tablet_replica.cc:333] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.515937 15388 raft_consensus.cc:2243] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.516048 15388 raft_consensus.cc:2272] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.516356 14915 leader_election.cc:304] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.516538 15445 raft_consensus.cc:3060] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.516614 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 56263217eaaf4bb9a48a822061ddb369 (table default.Table_c91b6d76e1384dd99d7e69ddee320afb [id=244c5edd72af4af790d96dd294e8d8c4]) successfully deleted
I20251025 08:02:25.517436 15445 raft_consensus.cc:2749] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.517652 15388 ts_tablet_manager.cc:1916] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:25.517968 15185 leader_election.cc:343] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 932d4e9a5da84d57b92a42b67d1eaab9
W20251025 08:02:25.519629 14652 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f08d0c3446dd4a478f81688a3259bb91 consensus state has no leader
I20251025 08:02:25.520040 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa4677de4604abaa2dc6e5413c616a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.522601 15385 tablet_replica.cc:333] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.522718 15385 raft_consensus.cc:2243] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:25.522882 15385 raft_consensus.cc:2272] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.523090 15369 tablet_bootstrap.cc:492] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.523941 15369 tablet_bootstrap.cc:654] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.525642 15388 ts_tablet_manager.cc:1929] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.525712 15388 log.cc:1199] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/b1ae9934b0ca403ea026233ecd952a20
I20251025 08:02:25.525949 15388 ts_tablet_manager.cc:1950] T b1ae9934b0ca403ea026233ecd952a20 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.526317 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet b1ae9934b0ca403ea026233ecd952a20 (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]) successfully deleted
I20251025 08:02:25.528865 15385 ts_tablet_manager.cc:1916] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.529007 15370 tablet_bootstrap.cc:492] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.529094 15370 ts_tablet_manager.cc:1403] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.067s user 0.001s sys 0.001s
I20251025 08:02:25.529083 14655 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_670e2c0d014c4003af93e44a18490fda"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.529395 14655 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_670e2c0d014c4003af93e44a18490fda in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.529474 15370 raft_consensus.cc:359] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.529583 15370 raft_consensus.cc:385] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.529616 15370 raft_consensus.cc:740] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.529724 15370 consensus_queue.cc:260] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.530020 15370 ts_tablet_manager.cc:1434] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.530231 15370 tablet_bootstrap.cc:492] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.530578 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c20947edc1f24e338cabf72b18282d24" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:25.530651 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c20947edc1f24e338cabf72b18282d24" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.530887 15385 ts_tablet_manager.cc:1929] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.530956 15385 log.cc:1199] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/b1ae9934b0ca403ea026233ecd952a20
I20251025 08:02:25.530943 14646 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_e95c804d7eab4d979aa8b83cf41e6acc" } new_table_name: "default.Table_5228048f3783458dbb44280a7a6e4816" modify_external_catalogs: true
I20251025 08:02:25.531211 15370 tablet_bootstrap.cc:654] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.531213 15385 ts_tablet_manager.cc:1950] T b1ae9934b0ca403ea026233ecd952a20 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.531518 14977 raft_consensus.cc:2468] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:25.531726 14650 master_service.cc:954] ReplaceTablet: received request to replace tablet c1a10ef5ab73459695e1ef772e3a5266 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.532061 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet b1ae9934b0ca403ea026233ecd952a20 (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]) successfully deleted
W20251025 08:02:25.533927 15183 leader_election.cc:343] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 932d4e9a5da84d57b92a42b67d1eaab9
I20251025 08:02:25.534013 15183 leader_election.cc:304] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:25.534152 15384 raft_consensus.cc:2749] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.536172 15370 tablet_bootstrap.cc:492] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.536239 15370 ts_tablet_manager.cc:1403] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251025 08:02:25.536588 15370 raft_consensus.cc:359] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.536664 15370 raft_consensus.cc:385] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.536689 15370 raft_consensus.cc:740] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.536784 15370 consensus_queue.cc:260] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.537004 15370 ts_tablet_manager.cc:1434] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.537128 15370 tablet_bootstrap.cc:492] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.537932 15370 tablet_bootstrap.cc:654] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.538992 15369 tablet_bootstrap.cc:492] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.539062 15369 ts_tablet_manager.cc:1403] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.002s
I20251025 08:02:25.539428 15369 raft_consensus.cc:359] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.539506 15369 raft_consensus.cc:385] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.539530 15369 raft_consensus.cc:740] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.539628 15369 consensus_queue.cc:260] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.539836 15369 ts_tablet_manager.cc:1434] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.539986 15369 tablet_bootstrap.cc:492] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.540771 15369 tablet_bootstrap.cc:654] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.543304 14653 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_8a9ed5d813b141578255d0ffdfc9fedb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.543378 14651 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 997c8c5921ad4ec18914fd50c97fc33e (table default.Table_a210a38e85814b3db16726f2a0a830b8 [id=cb9294ed7c474aae989ac13159ec3166]). Expected version 1 got 0
I20251025 08:02:25.547009 14654 catalog_manager.cc:5649] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.548646 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet dcfb649e699748118ffd4fae0ced9546 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:24 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.548802 15386 tablet_replica.cc:333] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.548923 15386 raft_consensus.cc:2243] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.549024 15386 raft_consensus.cc:2272] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.549162 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 932d4e9a5da84d57b92a42b67d1eaab9 with delete_type TABLET_DATA_DELETED (replaced by tablet b3fdc5bd4c7f4506a150f31137e8b091) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.550529 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 2bda60aba9a647019adf715083ce05a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
W20251025 08:02:25.553741 14653 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a9ed5d813b141578255d0ffdfc9fedb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.553838 14652 catalog_manager.cc:5649] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.556262 15451 tablet.cc:1722] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.556843 15436 tablet.cc:1722] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.557813 15370 tablet_bootstrap.cc:492] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.557896 15370 ts_tablet_manager.cc:1403] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20251025 08:02:25.557917 14654 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_a210a38e85814b3db16726f2a0a830b8 [id=cb9294ed7c474aae989ac13159ec3166] alter complete (version 1)
I20251025 08:02:25.558427 15370 raft_consensus.cc:359] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.558533 15370 raft_consensus.cc:385] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.558579 15370 raft_consensus.cc:740] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.558669 15370 consensus_queue.cc:260] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.558933 15370 ts_tablet_manager.cc:1434] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.559096 15370 tablet_bootstrap.cc:492] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.559904 15370 tablet_bootstrap.cc:654] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.560454 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 88052f79558a42eeb1c8acf44e6b48e1 with delete_type TABLET_DATA_DELETED (replaced by tablet f8576553f17b49f8bd11436ecac471ed) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.560871 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet b1ae9934b0ca403ea026233ecd952a20 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.563114 15497 raft_consensus.cc:493] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.563187 15497 raft_consensus.cc:515] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.563469 15497 leader_election.cc:290] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.564503 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dd72f76c950485c968409fe868266a2" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:25.564919 15048 leader_election.cc:343] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.564996 15369 tablet_bootstrap.cc:492] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.565073 15369 ts_tablet_manager.cc:1403] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.001s
I20251025 08:02:25.565369 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4dd72f76c950485c968409fe868266a2" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.565513 15369 raft_consensus.cc:359] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.565605 15369 raft_consensus.cc:385] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.565644 15369 raft_consensus.cc:740] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.565748 15369 consensus_queue.cc:260] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:25.565879 15049 leader_election.cc:343] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.565943 15049 leader_election.cc:304] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.566012 15369 ts_tablet_manager.cc:1434] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.566123 15497 raft_consensus.cc:2749] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.566169 15369 tablet_bootstrap.cc:492] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.566330 15783 tablet.cc:1722] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.567109 15369 tablet_bootstrap.cc:654] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.569804 14649 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_b033036083304e88b2b6fe996fda724f" } new_table_name: "default.Table_4afe1c6e03a941df9d5f7df4a42cbc61" modify_external_catalogs: true
I20251025 08:02:25.570703 14653 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_c414e6cfc2cf41198677517c4a4bfbef" } modify_external_catalogs: true
I20251025 08:02:25.570793 14653 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_c414e6cfc2cf41198677517c4a4bfbef" } modify_external_catalogs: true
I20251025 08:02:25.574026 15445 raft_consensus.cc:493] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.574115 15445 raft_consensus.cc:515] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.574447 15445 leader_election.cc:290] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.575060 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e3cd7b63fa174ee192ff909f149e8b17" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.575168 15113 raft_consensus.cc:2468] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:25.575616 14915 leader_election.cc:304] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.575632 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e3cd7b63fa174ee192ff909f149e8b17" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.575896 15445 raft_consensus.cc:2804] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.575963 15445 raft_consensus.cc:493] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.576004 15445 raft_consensus.cc:3060] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.576922 15445 raft_consensus.cc:515] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.577242 15445 leader_election.cc:290] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.577534 15369 tablet_bootstrap.cc:492] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.577611 15369 ts_tablet_manager.cc:1403] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20251025 08:02:25.577993 15369 raft_consensus.cc:359] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:25.578047 14914 leader_election.cc:343] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.578076 15369 raft_consensus.cc:385] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.578285 15369 raft_consensus.cc:740] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.578418 15369 consensus_queue.cc:260] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.578680 15369 ts_tablet_manager.cc:1434] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.578866 15369 tablet_bootstrap.cc:492] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.580062 15369 tablet_bootstrap.cc:654] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.580776 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e3cd7b63fa174ee192ff909f149e8b17" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:25.581143 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e3cd7b63fa174ee192ff909f149e8b17" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:25.581246 15113 raft_consensus.cc:3060] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.582166 15113 raft_consensus.cc:2468] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
W20251025 08:02:25.582667 14914 leader_election.cc:343] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.583511 14915 leader_election.cc:304] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.585294 15445 raft_consensus.cc:2804] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.585389 15445 raft_consensus.cc:697] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:25.585496 15445 consensus_queue.cc:237] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.585618 15388 tablet_replica.cc:333] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.585724 15388 raft_consensus.cc:2243] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.585812 15388 raft_consensus.cc:2272] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.586818 14655 master_service.cc:954] ReplaceTablet: received request to replace tablet e54e57e850564e079db3dd383347ed30 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.587080 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 834a6c675ac54dbdb5416c683384d96e with delete_type TABLET_DATA_DELETED (replaced by tablet bcb5f7e52507450c8a6f5a99a9927974) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.587240 15385 tablet_replica.cc:333] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.587344 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet b1ae9934b0ca403ea026233ecd952a20 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.587345 15385 raft_consensus.cc:2243] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.587481 15385 raft_consensus.cc:2272] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.588668 15385 ts_tablet_manager.cc:1916] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.590808 15385 ts_tablet_manager.cc:1929] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.590871 15385 log.cc:1199] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/834a6c675ac54dbdb5416c683384d96e
I20251025 08:02:25.591089 15385 ts_tablet_manager.cc:1950] T 834a6c675ac54dbdb5416c683384d96e P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
W20251025 08:02:25.591621 14649 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 346c0c8bf30b4dbaa92436b45e5fbf47 has no consensus state
I20251025 08:02:25.591897 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 834a6c675ac54dbdb5416c683384d96e (table default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]) successfully deleted
W20251025 08:02:25.592058 14640 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet b1ae9934b0ca403ea026233ecd952a20 because the tablet was not found. No further retry: Not found: Tablet not found: b1ae9934b0ca403ea026233ecd952a20
I20251025 08:02:25.593745 15388 ts_tablet_manager.cc:1916] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.595219 15386 ts_tablet_manager.cc:1916] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.595542 14646 catalog_manager.cc:5649] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.596673 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 801d06a391e34bec8e1f74257937f069 (DEFAULT_TABLE table=default.Table_cd97ecbd521e4d4b8f03836dbb9e15cf [id=59daf7f960b84b148da5d5f30db95bfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.596937 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801d06a391e34bec8e1f74257937f069. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.597370 15386 ts_tablet_manager.cc:1929] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.597431 15386 log.cc:1199] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/dcfb649e699748118ffd4fae0ced9546
I20251025 08:02:25.597627 15386 ts_tablet_manager.cc:1950] T dcfb649e699748118ffd4fae0ced9546 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.598291 14653 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 35eb28e4cabf4e59b8245fa3adc57872
I20251025 08:02:25.598678 15386 tablet_replica.cc:333] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.598783 15386 raft_consensus.cc:2243] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.598875 15386 raft_consensus.cc:2272] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.598920 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet dcfb649e699748118ffd4fae0ced9546 (table default.Table_802f081e7d2c4fe4b0d34d798171708d [id=70e669319af14d04b8a3ca13f0c5bd6e]) successfully deleted
I20251025 08:02:25.599103 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 35eb28e4cabf4e59b8245fa3adc57872 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.599437 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 35eb28e4cabf4e59b8245fa3adc57872 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.599418 15386 ts_tablet_manager.cc:1916] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.599716 15370 tablet_bootstrap.cc:492] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.599757 15369 tablet_bootstrap.cc:492] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.599787 15370 ts_tablet_manager.cc:1403] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.000s
I20251025 08:02:25.599813 15369 ts_tablet_manager.cc:1403] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.002s
I20251025 08:02:25.600150 15369 raft_consensus.cc:359] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.600150 15370 raft_consensus.cc:359] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.600232 15369 raft_consensus.cc:385] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.600239 15370 raft_consensus.cc:385] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.600267 15369 raft_consensus.cc:740] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.600270 15370 raft_consensus.cc:740] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.600380 15370 consensus_queue.cc:260] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.600387 15369 consensus_queue.cc:260] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.600690 15370 ts_tablet_manager.cc:1434] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.600878 15370 tablet_bootstrap.cc:492] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.601800 15370 tablet_bootstrap.cc:654] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.601816 15386 ts_tablet_manager.cc:1929] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.601867 15386 log.cc:1199] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/932d4e9a5da84d57b92a42b67d1eaab9
I20251025 08:02:25.602066 15386 ts_tablet_manager.cc:1950] T 932d4e9a5da84d57b92a42b67d1eaab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.602569 15386 tablet_replica.cc:333] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.602627 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 932d4e9a5da84d57b92a42b67d1eaab9 (table default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a]) successfully deleted
I20251025 08:02:25.602654 15386 raft_consensus.cc:2243] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.602738 15386 raft_consensus.cc:2272] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.603120 15386 ts_tablet_manager.cc:1916] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.603227 15369 ts_tablet_manager.cc:1434] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:25.604183 15369 tablet_bootstrap.cc:492] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.605295 15386 ts_tablet_manager.cc:1929] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.605305 15369 tablet_bootstrap.cc:654] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.605451 15386 log.cc:1199] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/2bda60aba9a647019adf715083ce05a5
I20251025 08:02:25.605679 15386 ts_tablet_manager.cc:1950] T 2bda60aba9a647019adf715083ce05a5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.605805 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet 35eb28e4cabf4e59b8245fa3adc57872 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.606272 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 2bda60aba9a647019adf715083ce05a5 (table default.Table_3a925a6333c342289286ca5667f5f19d [id=940bf492708245f9b5c7a9b3073a1b07]) successfully deleted
I20251025 08:02:25.606542 15385 tablet_replica.cc:333] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.606482 15386 tablet_replica.cc:333] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.606660 15385 raft_consensus.cc:2243] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:25.606729 15386 raft_consensus.cc:2243] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.606859 15386 raft_consensus.cc:2272] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.606848 15385 raft_consensus.cc:2272] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.607322 15385 ts_tablet_manager.cc:1916] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.609239 15385 ts_tablet_manager.cc:1929] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.609302 15385 log.cc:1199] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/35eb28e4cabf4e59b8245fa3adc57872
I20251025 08:02:25.609603 15385 ts_tablet_manager.cc:1950] T 35eb28e4cabf4e59b8245fa3adc57872 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.610566 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 35eb28e4cabf4e59b8245fa3adc57872 (table default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]) successfully deleted
I20251025 08:02:25.611181 15386 ts_tablet_manager.cc:1916] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.612970 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 801d06a391e34bec8e1f74257937f069 (DEFAULT_TABLE table=default.Table_cd97ecbd521e4d4b8f03836dbb9e15cf [id=59daf7f960b84b148da5d5f30db95bfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.613194 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801d06a391e34bec8e1f74257937f069. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.613551 14650 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet c1a10ef5ab73459695e1ef772e3a5266
I20251025 08:02:25.613829 14650 catalog_manager.cc:6719] ReplaceTablet: tablet c1a10ef5ab73459695e1ef772e3a5266 deleted and replaced by tablet adc14c254b0c4974bfbadede727b6c6b
I20251025 08:02:25.614039 15388 ts_tablet_manager.cc:1929] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.614110 15388 log.cc:1199] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/88052f79558a42eeb1c8acf44e6b48e1
I20251025 08:02:25.614311 14653 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_8a9ed5d813b141578255d0ffdfc9fedb" } modify_external_catalogs: true
I20251025 08:02:25.614387 15388 ts_tablet_manager.cc:1950] T 88052f79558a42eeb1c8acf44e6b48e1 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.614408 14653 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_8a9ed5d813b141578255d0ffdfc9fedb" } modify_external_catalogs: true
I20251025 08:02:25.614729 15497 raft_consensus.cc:493] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.614794 15497 raft_consensus.cc:515] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.615149 15497 leader_election.cc:290] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.615216 14652 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet e3cd7b63fa174ee192ff909f149e8b17 (table default.Table_a368af9d0b8d46d78f9158b8f9949b01 [id=425e69ea7f8a407e8d22b735ee62c709]). Expected version 1 got 0
I20251025 08:02:25.615535 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76a906654cc44bfb96d9e1a936040e57" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:25.615808 15048 leader_election.cc:343] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.615907 14650 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_e650e0b918954a7f8c97ff7e8e9bcffd" } modify_external_catalogs: true
I20251025 08:02:25.616007 14650 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_e650e0b918954a7f8c97ff7e8e9bcffd" } modify_external_catalogs: true
I20251025 08:02:25.616216 15388 tablet_replica.cc:333] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.616340 15388 raft_consensus.cc:2243] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.616430 15388 raft_consensus.cc:2272] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.616931 15388 ts_tablet_manager.cc:1916] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.617071 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 88052f79558a42eeb1c8acf44e6b48e1 (table default.Table_8f781f3f507c4a339ba15100b719fcbb [id=2283253a9522485d93d6c484c5eef6e4]) successfully deleted
I20251025 08:02:25.617216 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet c1a10ef5ab73459695e1ef772e3a5266 with delete_type TABLET_DATA_DELETED (replaced by tablet adc14c254b0c4974bfbadede727b6c6b) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.617326 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet c1a10ef5ab73459695e1ef772e3a5266 with delete_type TABLET_DATA_DELETED (replaced by tablet adc14c254b0c4974bfbadede727b6c6b) from {username='slave'} at 127.0.0.1:37198
W20251025 08:02:25.617466 14642 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet b1ae9934b0ca403ea026233ecd952a20 because the tablet was not found. No further retry: Not found: Tablet not found: b1ae9934b0ca403ea026233ecd952a20
I20251025 08:02:25.617532 15385 tablet_replica.cc:333] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.617635 15385 raft_consensus.cc:2243] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.617713 15385 raft_consensus.cc:2272] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.618290 14655 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet e54e57e850564e079db3dd383347ed30
I20251025 08:02:25.618599 14655 catalog_manager.cc:6719] ReplaceTablet: tablet e54e57e850564e079db3dd383347ed30 deleted and replaced by tablet 95c9778bd0d94542bec79e9d36c6ce46
I20251025 08:02:25.619472 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet e54e57e850564e079db3dd383347ed30 with delete_type TABLET_DATA_DELETED (replaced by tablet 95c9778bd0d94542bec79e9d36c6ce46) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.619529 15388 ts_tablet_manager.cc:1929] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.619596 15388 log.cc:1199] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/35eb28e4cabf4e59b8245fa3adc57872
I20251025 08:02:25.619832 14649 master_service.cc:954] ReplaceTablet: received request to replace tablet 54ea861dbc8c46129df50fc5060739b3 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.620198 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet c1a10ef5ab73459695e1ef772e3a5266 with delete_type TABLET_DATA_DELETED (replaced by tablet adc14c254b0c4974bfbadede727b6c6b) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.620203 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet e54e57e850564e079db3dd383347ed30 with delete_type TABLET_DATA_DELETED (replaced by tablet 95c9778bd0d94542bec79e9d36c6ce46) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.620460 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet e54e57e850564e079db3dd383347ed30 with delete_type TABLET_DATA_DELETED (replaced by tablet 95c9778bd0d94542bec79e9d36c6ce46) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.620617 15385 ts_tablet_manager.cc:1916] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.620870 14655 master_service.cc:954] ReplaceTablet: received request to replace tablet 74d87666abb643899a7b1e576e6cc840 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.621402 15388 ts_tablet_manager.cc:1950] T 35eb28e4cabf4e59b8245fa3adc57872 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.621721 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76a906654cc44bfb96d9e1a936040e57" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.621999 15388 tablet_replica.cc:333] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.622115 15388 raft_consensus.cc:2243] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.622232 15388 raft_consensus.cc:2272] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.622397 14954 tablet_service.cc:1505] Processing CreateTablet for tablet 801d06a391e34bec8e1f74257937f069 (DEFAULT_TABLE table=default.Table_cd97ecbd521e4d4b8f03836dbb9e15cf [id=59daf7f960b84b148da5d5f30db95bfe]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:25.622534 15049 leader_election.cc:343] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.622594 15049 leader_election.cc:304] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.622642 15388 ts_tablet_manager.cc:1916] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.622658 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 801d06a391e34bec8e1f74257937f069. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.622733 15497 raft_consensus.cc:2749] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.623185 15385 ts_tablet_manager.cc:1929] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.623281 15385 log.cc:1199] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/c1a10ef5ab73459695e1ef772e3a5266
I20251025 08:02:25.623502 15385 ts_tablet_manager.cc:1950] T c1a10ef5ab73459695e1ef772e3a5266 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.624017 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet c1a10ef5ab73459695e1ef772e3a5266 (table default.Table_d8110cf18c6748b092f8bf7348349f88 [id=53d57abf556c4926b02a1e265cf34c61]) successfully deleted
I20251025 08:02:25.624238 15388 ts_tablet_manager.cc:1929] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.624267 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 35eb28e4cabf4e59b8245fa3adc57872 (table default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]) successfully deleted
I20251025 08:02:25.624302 15388 log.cc:1199] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/c1a10ef5ab73459695e1ef772e3a5266
W20251025 08:02:25.624401 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet e54e57e850564e079db3dd383347ed30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e54e57e850564e079db3dd383347ed30 already in progress: creating tablet
I20251025 08:02:25.624482 15388 ts_tablet_manager.cc:1950] T c1a10ef5ab73459695e1ef772e3a5266 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.624969 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet c1a10ef5ab73459695e1ef772e3a5266 (table default.Table_d8110cf18c6748b092f8bf7348349f88 [id=53d57abf556c4926b02a1e265cf34c61]) successfully deleted
W20251025 08:02:25.625329 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet e54e57e850564e079db3dd383347ed30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e54e57e850564e079db3dd383347ed30 already in progress: creating tablet
I20251025 08:02:25.629758 15229 tablet_service.cc:1505] Processing CreateTablet for tablet b7e8a698e8ba408a833bbc3905b2ad04 (DEFAULT_TABLE table=default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.629983 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e8a698e8ba408a833bbc3905b2ad04. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.630627 14654 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_5228048f3783458dbb44280a7a6e4816 [id=7fe739c2f676459d8c73632266babedb] alter complete (version 1)
I20251025 08:02:25.630975 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 20a3581bd02143bd8a6bdf8e17072faf (DEFAULT_TABLE table=default.Table_d57dfa9ab2164520aa85ebfdd8a85546 [id=317c0892e78047c4b33e1836c3e1776d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.631153 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a3581bd02143bd8a6bdf8e17072faf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.631800 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 20a3581bd02143bd8a6bdf8e17072faf (DEFAULT_TABLE table=default.Table_d57dfa9ab2164520aa85ebfdd8a85546 [id=317c0892e78047c4b33e1836c3e1776d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.632050 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a3581bd02143bd8a6bdf8e17072faf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.632372 14653 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet 9362147e43964ca296dbfb242e5723af
I20251025 08:02:25.632597 14650 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 5e605f701a474fff80688533f3a398e7
I20251025 08:02:25.633586 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 5e605f701a474fff80688533f3a398e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.633878 15090 tablet_service.cc:1505] Processing CreateTablet for tablet b7e8a698e8ba408a833bbc3905b2ad04 (DEFAULT_TABLE table=default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.634064 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e8a698e8ba408a833bbc3905b2ad04. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.634788 14646 catalog_manager.cc:5649] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.634979 14646 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet e3cd7b63fa174ee192ff909f149e8b17 (table default.Table_a368af9d0b8d46d78f9158b8f9949b01 [id=425e69ea7f8a407e8d22b735ee62c709]). Expected version 1 got 0
I20251025 08:02:25.635591 14650 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_b2029265ed824a48b4f5db3a90b38bdf" } new_table_name: "default.Table_3231d801b62849a8a125cbe1d6fe9482" modify_external_catalogs: true
I20251025 08:02:25.635726 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 4dd72f76c950485c968409fe868266a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4f3163f8a4ff49069d55b9acf8a4c19a) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.636487 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 5e605f701a474fff80688533f3a398e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.637158 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 56263217eaaf4bb9a48a822061ddb369 with delete_type TABLET_DATA_DELETED (replaced by tablet a8393462039d4bb4aba66aee9e90b94a) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.637195 14653 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 76a906654cc44bfb96d9e1a936040e57 (table default.Table_9bbb4f343dc64170b9f81ce2f0c5f37f [id=78794c8ceec3479ca3ac3ef55594762f]). Expected version 1 got 0
I20251025 08:02:25.637364 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 97df7606f88c4b59a722f6c0359851d9 with delete_type TABLET_DATA_DELETED (replaced by tablet b7e8a698e8ba408a833bbc3905b2ad04) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.637683 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet c1a10ef5ab73459695e1ef772e3a5266 with delete_type TABLET_DATA_DELETED (replaced by tablet adc14c254b0c4974bfbadede727b6c6b) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.637764 14959 tablet_service.cc:1505] Processing CreateTablet for tablet b7e8a698e8ba408a833bbc3905b2ad04 (DEFAULT_TABLE table=default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.637801 14956 tablet_service.cc:1552] Processing DeleteTablet for tablet 5e605f701a474fff80688533f3a398e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.637969 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7e8a698e8ba408a833bbc3905b2ad04. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.638623 14954 tablet_service.cc:1505] Processing CreateTablet for tablet 20a3581bd02143bd8a6bdf8e17072faf (DEFAULT_TABLE table=default.Table_d57dfa9ab2164520aa85ebfdd8a85546 [id=317c0892e78047c4b33e1836c3e1776d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.638803 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20a3581bd02143bd8a6bdf8e17072faf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.639906 15385 tablet_replica.cc:333] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.640017 15385 raft_consensus.cc:2243] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.640100 15385 raft_consensus.cc:2272] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.640173 15388 tablet_replica.cc:333] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.640317 15388 raft_consensus.cc:2243] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.640455 15388 raft_consensus.cc:2272] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.641018 15385 ts_tablet_manager.cc:1916] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.641614 15388 ts_tablet_manager.cc:1916] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.642761 15385 ts_tablet_manager.cc:1929] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.642827 15385 log.cc:1199] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/56263217eaaf4bb9a48a822061ddb369
I20251025 08:02:25.643023 15385 ts_tablet_manager.cc:1950] T 56263217eaaf4bb9a48a822061ddb369 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.643168 15369 tablet_bootstrap.cc:492] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.643254 15369 ts_tablet_manager.cc:1403] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.000s
I20251025 08:02:25.643517 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 56263217eaaf4bb9a48a822061ddb369 (table default.Table_c91b6d76e1384dd99d7e69ddee320afb [id=244c5edd72af4af790d96dd294e8d8c4]) successfully deleted
I20251025 08:02:25.643656 15369 raft_consensus.cc:359] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.643767 15369 raft_consensus.cc:385] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.643803 15369 raft_consensus.cc:740] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.643980 15388 ts_tablet_manager.cc:1929] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.643941 15369 consensus_queue.cc:260] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.644618 15388 log.cc:1199] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/4dd72f76c950485c968409fe868266a2
I20251025 08:02:25.644851 15369 ts_tablet_manager.cc:1434] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:25.645017 15369 tablet_bootstrap.cc:492] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.646665 15369 tablet_bootstrap.cc:654] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.647399 15388 ts_tablet_manager.cc:1950] T 4dd72f76c950485c968409fe868266a2 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.648357 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 4dd72f76c950485c968409fe868266a2 (table default.Table_2631732663a24b55a695edc159006f87 [id=b9853b2d88cf4a96b9fc5e1099f87064]) successfully deleted
W20251025 08:02:25.649345 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 5e605f701a474fff80688533f3a398e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e605f701a474fff80688533f3a398e7 already in progress: creating tablet
I20251025 08:02:25.651058 14649 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 54ea861dbc8c46129df50fc5060739b3
I20251025 08:02:25.651126 15372 tablet_bootstrap.cc:492] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.651191 15372 ts_tablet_manager.cc:1403] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.140s user 0.000s sys 0.001s
I20251025 08:02:25.651362 14649 catalog_manager.cc:6719] ReplaceTablet: tablet 54ea861dbc8c46129df50fc5060739b3 deleted and replaced by tablet 5d25a2805a264574bc20150762c48262
I20251025 08:02:25.651562 15372 raft_consensus.cc:359] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.651660 15372 raft_consensus.cc:385] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.651685 15372 raft_consensus.cc:740] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.651759 15370 tablet_bootstrap.cc:492] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.651774 15372 consensus_queue.cc:260] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.651829 15370 ts_tablet_manager.cc:1403] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.000s
I20251025 08:02:25.652004 15372 ts_tablet_manager.cc:1434] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.652180 15372 tablet_bootstrap.cc:492] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.652243 15370 raft_consensus.cc:359] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.652329 15370 raft_consensus.cc:385] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.652357 15370 raft_consensus.cc:740] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.652446 15370 consensus_queue.cc:260] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.652693 15370 ts_tablet_manager.cc:1434] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.652860 15370 tablet_bootstrap.cc:492] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.653004 15372 tablet_bootstrap.cc:654] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.654031 15370 tablet_bootstrap.cc:654] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.655587 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 54ea861dbc8c46129df50fc5060739b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5d25a2805a264574bc20150762c48262) from {username='slave'} at 127.0.0.1:36846
W20251025 08:02:25.656049 14640 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet c1a10ef5ab73459695e1ef772e3a5266 because the tablet was not found. No further retry: Not found: Tablet not found: c1a10ef5ab73459695e1ef772e3a5266
I20251025 08:02:25.657109 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet 54ea861dbc8c46129df50fc5060739b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5d25a2805a264574bc20150762c48262) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.657138 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 54ea861dbc8c46129df50fc5060739b3 with delete_type TABLET_DATA_DELETED (replaced by tablet 5d25a2805a264574bc20150762c48262) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:25.657461 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 5e605f701a474fff80688533f3a398e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e605f701a474fff80688533f3a398e7 already in progress: creating tablet
I20251025 08:02:25.657655 15385 tablet_replica.cc:333] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.658097 15385 raft_consensus.cc:2243] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:25.658318 14653 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_e96eec11f48049a9b2a4332b23e60a6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.658643 14653 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e96eec11f48049a9b2a4332b23e60a6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.659621 15385 raft_consensus.cc:2272] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.660378 15385 ts_tablet_manager.cc:1916] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.661439 15386 ts_tablet_manager.cc:1929] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.661506 15388 tablet_replica.cc:333] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.661541 15386 log.cc:1199] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/35eb28e4cabf4e59b8245fa3adc57872
I20251025 08:02:25.661619 15388 raft_consensus.cc:2243] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.661715 15388 raft_consensus.cc:2272] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.661886 15386 ts_tablet_manager.cc:1950] T 35eb28e4cabf4e59b8245fa3adc57872 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.662227 15388 ts_tablet_manager.cc:1916] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.662716 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet dfb4a050022d462699005fedc4323fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.664049 15385 ts_tablet_manager.cc:1929] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:25.664096 15388 ts_tablet_manager.cc:1929] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:25.664182 15388 log.cc:1199] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/54ea861dbc8c46129df50fc5060739b3
I20251025 08:02:25.664431 15388 ts_tablet_manager.cc:1950] T 54ea861dbc8c46129df50fc5060739b3 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.664629 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 35eb28e4cabf4e59b8245fa3adc57872 (table default.Table_c414e6cfc2cf41198677517c4a4bfbef [id=e8f1b9d591bb4f8fbbb05ee960280cc6]) successfully deleted
I20251025 08:02:25.664971 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 54ea861dbc8c46129df50fc5060739b3 (table default.Table_9a3a6f5c45104e33a5a455d911ce8927 [id=15a38bbafe4045e9991cb846ec9e452c]) successfully deleted
W20251025 08:02:25.665030 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet c1a10ef5ab73459695e1ef772e3a5266 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet c1a10ef5ab73459695e1ef772e3a5266 already in progress: creating tablet
W20251025 08:02:25.665413 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet e54e57e850564e079db3dd383347ed30 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e54e57e850564e079db3dd383347ed30 already in progress: creating tablet
I20251025 08:02:25.667471 15388 tablet_replica.cc:333] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.667567 14655 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 74d87666abb643899a7b1e576e6cc840
I20251025 08:02:25.667588 15388 raft_consensus.cc:2243] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.667663 15388 raft_consensus.cc:2272] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.667811 14655 catalog_manager.cc:6719] ReplaceTablet: tablet 74d87666abb643899a7b1e576e6cc840 deleted and replaced by tablet 7b8d94fc010046c7b37804f168471904
I20251025 08:02:25.667865 15386 tablet_replica.cc:333] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.667954 15386 raft_consensus.cc:2243] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.668033 15386 raft_consensus.cc:2272] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.668043 15370 tablet_bootstrap.cc:492] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.668110 15370 ts_tablet_manager.cc:1403] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
W20251025 08:02:25.668334 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 5e605f701a474fff80688533f3a398e7 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5e605f701a474fff80688533f3a398e7 already in progress: creating tablet
I20251025 08:02:25.668411 15386 ts_tablet_manager.cc:1916] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.668514 15370 raft_consensus.cc:359] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.668577 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 74d87666abb643899a7b1e576e6cc840 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b8d94fc010046c7b37804f168471904) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.668606 15370 raft_consensus.cc:385] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.668637 15370 raft_consensus.cc:740] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.668735 15370 consensus_queue.cc:260] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.669003 15370 ts_tablet_manager.cc:1434] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:25.669250 15370 tablet_bootstrap.cc:492] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.671232 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 74d87666abb643899a7b1e576e6cc840 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b8d94fc010046c7b37804f168471904) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.670156 15370 tablet_bootstrap.cc:654] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.672688 15388 ts_tablet_manager.cc:1916] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.674819 15464 raft_consensus.cc:493] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.674907 15464 raft_consensus.cc:515] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.675261 15464 leader_election.cc:290] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.675966 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 4134d50b613748fd9291ff245047af33 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.676260 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6ee2b8cfe7743d29714910fe8060083" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.676328 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6ee2b8cfe7743d29714910fe8060083" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.676358 15113 raft_consensus.cc:2468] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:25.676412 15386 ts_tablet_manager.cc:1929] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.676468 15386 log.cc:1199] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/97df7606f88c4b59a722f6c0359851d9
I20251025 08:02:25.676644 15386 ts_tablet_manager.cc:1950] T 97df7606f88c4b59a722f6c0359851d9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:25.676671 14914 leader_election.cc:343] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.667179 15369 tablet_bootstrap.cc:492] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.676918 15369 ts_tablet_manager.cc:1403] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20251025 08:02:25.676937 14915 leader_election.cc:304] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.677196 15464 raft_consensus.cc:2804] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.677323 15464 raft_consensus.cc:493] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.677378 15464 raft_consensus.cc:3060] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.670423 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet 74d87666abb643899a7b1e576e6cc840 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b8d94fc010046c7b37804f168471904) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.678375 15464 raft_consensus.cc:515] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.678730 15464 leader_election.cc:290] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.679273 14654 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_530e7f5173d54781a219bcd014267a9f" } new_table_name: "default.Table_b42eeab602164c40a7721a43fb071328" modify_external_catalogs: true
I20251025 08:02:25.679669 15369 raft_consensus.cc:359] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.679764 15369 raft_consensus.cc:385] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.679796 15369 raft_consensus.cc:740] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.679891 15369 consensus_queue.cc:260] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.679996 14652 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_4b7b9ad86d85404785a42b98239e38cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.680271 14652 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b7b9ad86d85404785a42b98239e38cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.680734 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6ee2b8cfe7743d29714910fe8060083" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:25.680823 15113 raft_consensus.cc:3060] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.681648 15113 raft_consensus.cc:2468] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:25.677037 15372 tablet_bootstrap.cc:492] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.681917 15372 ts_tablet_manager.cc:1403] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.030s user 0.000s sys 0.001s
I20251025 08:02:25.682390 15372 raft_consensus.cc:359] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.682482 15372 raft_consensus.cc:385] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.682514 15372 raft_consensus.cc:740] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.682592 15369 ts_tablet_manager.cc:1434] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:25.682607 15372 consensus_queue.cc:260] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.682807 15372 ts_tablet_manager.cc:1434] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.682834 14915 leader_election.cc:304] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.682947 15372 tablet_bootstrap.cc:492] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.683672 15464 raft_consensus.cc:2804] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.683755 15464 raft_consensus.cc:697] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:25.683831 15372 tablet_bootstrap.cc:654] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.683889 15464 consensus_queue.cc:237] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.684827 15369 tablet_bootstrap.cc:492] T 3743a9de419d40689c49aae471edfa01 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.685923 15369 tablet_bootstrap.cc:654] T 3743a9de419d40689c49aae471edfa01 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.688412 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.674820 15385 log.cc:1199] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/54ea861dbc8c46129df50fc5060739b3
I20251025 08:02:25.688882 15385 ts_tablet_manager.cc:1950] T 54ea861dbc8c46129df50fc5060739b3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.689165 14647 master_service.cc:954] ReplaceTablet: received request to replace tablet cf90d2e477b9493e9b78aae6a7d2d3e0 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.679708 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6ee2b8cfe7743d29714910fe8060083" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:25.689527 14914 leader_election.cc:343] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.689682 14651 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_d9d4e09b4b4f4014847e00428c183725" } modify_external_catalogs: true
I20251025 08:02:25.689757 14651 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_d9d4e09b4b4f4014847e00428c183725" } modify_external_catalogs: true
I20251025 08:02:25.690367 15385 tablet_replica.cc:333] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.690486 15385 raft_consensus.cc:2243] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.690587 15385 raft_consensus.cc:2272] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.691008 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 54ea861dbc8c46129df50fc5060739b3 (table default.Table_9a3a6f5c45104e33a5a455d911ce8927 [id=15a38bbafe4045e9991cb846ec9e452c]) successfully deleted
I20251025 08:02:25.691100 15385 ts_tablet_manager.cc:1916] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.691285 15386 tablet_replica.cc:333] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.691417 15386 raft_consensus.cc:2243] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.691531 15386 raft_consensus.cc:2272] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.691558 15388 ts_tablet_manager.cc:1929] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.691642 15388 log.cc:1199] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/dfb4a050022d462699005fedc4323fdb
I20251025 08:02:25.691756 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 97df7606f88c4b59a722f6c0359851d9 (table default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]) successfully deleted
I20251025 08:02:25.691838 15388 ts_tablet_manager.cc:1950] T dfb4a050022d462699005fedc4323fdb P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.692152 15386 ts_tablet_manager.cc:1916] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.692643 14649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_1dacf98643304d1288547a682f2d7815"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.693048 14649 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1dacf98643304d1288547a682f2d7815 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.693104 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet dfb4a050022d462699005fedc4323fdb (table default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]) successfully deleted
W20251025 08:02:25.693653 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 74d87666abb643899a7b1e576e6cc840 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74d87666abb643899a7b1e576e6cc840 already in progress: creating tablet
I20251025 08:02:25.693835 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet 88052f79558a42eeb1c8acf44e6b48e1 with delete_type TABLET_DATA_DELETED (replaced by tablet f8576553f17b49f8bd11436ecac471ed) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.694024 15386 ts_tablet_manager.cc:1929] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20251025 08:02:25.696439 14650 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cf5008728a6241c096c9a76f8e374ceb consensus state has no leader
I20251025 08:02:25.697425 15386 log.cc:1199] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/54ea861dbc8c46129df50fc5060739b3
I20251025 08:02:25.697700 15386 ts_tablet_manager.cc:1950] T 54ea861dbc8c46129df50fc5060739b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.698043 15372 tablet_bootstrap.cc:492] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.698145 15372 ts_tablet_manager.cc:1403] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251025 08:02:25.698486 15372 raft_consensus.cc:359] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.698555 15372 raft_consensus.cc:385] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.698577 15372 raft_consensus.cc:740] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.698657 15372 consensus_queue.cc:260] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.698832 15372 ts_tablet_manager.cc:1434] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.698973 15372 tablet_bootstrap.cc:492] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.699694 15372 tablet_bootstrap.cc:654] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.700250 15246 raft_consensus.cc:3060] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.702600 15783 tablet.cc:1722] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.704375 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 54ea861dbc8c46129df50fc5060739b3 (table default.Table_9a3a6f5c45104e33a5a455d911ce8927 [id=15a38bbafe4045e9991cb846ec9e452c]) successfully deleted
W20251025 08:02:25.704923 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 74d87666abb643899a7b1e576e6cc840 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74d87666abb643899a7b1e576e6cc840 already in progress: creating tablet
I20251025 08:02:25.705408 15409 raft_consensus.cc:493] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.705474 15409 raft_consensus.cc:515] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.705788 15409 leader_election.cc:290] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:25.706369 15185 leader_election.cc:343] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 2ba7db73d6c3469aa0fd1a78ca32c4d8
W20251025 08:02:25.706710 15183 leader_election.cc:343] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 2ba7db73d6c3469aa0fd1a78ca32c4d8
I20251025 08:02:25.706771 15183 leader_election.cc:304] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:25.706914 15409 raft_consensus.cc:2749] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.707028 15386 tablet_replica.cc:333] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.707131 15386 raft_consensus.cc:2243] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.707217 15386 raft_consensus.cc:2272] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.708453 15386 ts_tablet_manager.cc:1916] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.708454 15113 raft_consensus.cc:1275] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:25.708701 14648 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_e22e6abaeec0420496616ee334cf07eb" } modify_external_catalogs: true
I20251025 08:02:25.708791 14648 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_e22e6abaeec0420496616ee334cf07eb" } modify_external_catalogs: true
I20251025 08:02:25.708786 15445 consensus_queue.cc:1048] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.709040 15385 ts_tablet_manager.cc:1929] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.709098 15385 log.cc:1199] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/4134d50b613748fd9291ff245047af33
I20251025 08:02:25.709409 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 1a9f9a42dbe7402189df59c49b463fad with delete_type TABLET_DATA_DELETED (replaced by tablet 76a906654cc44bfb96d9e1a936040e57) from {username='slave'} at 127.0.0.1:36846
W20251025 08:02:25.709910 14914 consensus_peers.cc:597] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:25.712168 15451 tablet.cc:1722] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:25.712841 15436 tablet.cc:1722] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:25.714340 15385 ts_tablet_manager.cc:1950] T 4134d50b613748fd9291ff245047af33 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
W20251025 08:02:25.714596 14654 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0a187a088f5042c081aa87c79662c8cf consensus state has no leader
I20251025 08:02:25.716867 15372 tablet_bootstrap.cc:492] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.716939 15372 ts_tablet_manager.cc:1403] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20251025 08:02:25.717326 15372 raft_consensus.cc:359] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.717388 15372 raft_consensus.cc:385] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.717406 15372 raft_consensus.cc:740] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.717494 15372 consensus_queue.cc:260] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.717727 15372 ts_tablet_manager.cc:1434] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.718149 15372 tablet_bootstrap.cc:492] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.718982 15372 tablet_bootstrap.cc:654] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.720194 15372 tablet_bootstrap.cc:492] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.720266 15372 ts_tablet_manager.cc:1403] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:25.720646 15372 raft_consensus.cc:359] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.720742 15372 raft_consensus.cc:385] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.720772 15372 raft_consensus.cc:740] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.720866 15372 consensus_queue.cc:260] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.721107 15372 ts_tablet_manager.cc:1434] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.721235 15372 tablet_bootstrap.cc:492] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.722501 15370 tablet_bootstrap.cc:492] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.722579 15370 ts_tablet_manager.cc:1403] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.053s user 0.001s sys 0.000s
I20251025 08:02:25.722607 15372 tablet_bootstrap.cc:654] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.722955 15370 raft_consensus.cc:359] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.723050 15370 raft_consensus.cc:385] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.723085 15370 raft_consensus.cc:740] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.723202 15370 consensus_queue.cc:260] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.723453 15370 ts_tablet_manager.cc:1434] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.723737 15370 tablet_bootstrap.cc:492] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.724452 15370 tablet_bootstrap.cc:654] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.725028 14650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_541e363972b34e9b9b64f21b771e7ce2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.725327 15386 ts_tablet_manager.cc:1929] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20251025 08:02:25.725343 14650 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_541e363972b34e9b9b64f21b771e7ce2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.725392 15386 log.cc:1199] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/2ba7db73d6c3469aa0fd1a78ca32c4d8
I20251025 08:02:25.725595 15386 ts_tablet_manager.cc:1950] T 2ba7db73d6c3469aa0fd1a78ca32c4d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.726052 15386 tablet_replica.cc:333] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.726118 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 4134d50b613748fd9291ff245047af33 (table default.Table_de463c68e4cf4110a906098e963221eb [id=1686afc032714790a429b58ea8c0e5b1]) successfully deleted
I20251025 08:02:25.726094 14653 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_9bbb4f343dc64170b9f81ce2f0c5f37f" } new_table_name: "default.Table_4598018e26254b78befa93852241f777" modify_external_catalogs: true
I20251025 08:02:25.726163 15386 raft_consensus.cc:2243] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.726285 15386 raft_consensus.cc:2272] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:25.726531 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 74d87666abb643899a7b1e576e6cc840 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 74d87666abb643899a7b1e576e6cc840 already in progress: creating tablet
I20251025 08:02:25.726751 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 2ba7db73d6c3469aa0fd1a78ca32c4d8 (table default.Table_d5f1669745ce40c9afcd65029292ea51 [id=42a26b3ac1e54d518e958e6ea0cf22c8]) successfully deleted
I20251025 08:02:25.727856 15385 tablet_replica.cc:333] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.727991 15385 raft_consensus.cc:2243] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.728060 15386 ts_tablet_manager.cc:1916] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.728083 15385 raft_consensus.cc:2272] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.728631 15370 tablet_bootstrap.cc:492] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.728657 15385 ts_tablet_manager.cc:1916] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.728716 15370 ts_tablet_manager.cc:1403] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:25.729118 15370 raft_consensus.cc:359] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.729219 15370 raft_consensus.cc:385] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.729265 15370 raft_consensus.cc:740] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.729373 15370 consensus_queue.cc:260] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.729624 15370 ts_tablet_manager.cc:1434] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.729766 15113 raft_consensus.cc:1275] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:25.729808 15370 tablet_bootstrap.cc:492] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.730295 15374 consensus_queue.cc:1048] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:25.730635 14914 consensus_peers.cc:597] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:25.731047 15370 tablet_bootstrap.cc:654] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.732065 15386 ts_tablet_manager.cc:1929] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.732123 15386 log.cc:1199] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/1a9f9a42dbe7402189df59c49b463fad
I20251025 08:02:25.732288 15386 ts_tablet_manager.cc:1950] T 1a9f9a42dbe7402189df59c49b463fad P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.732509 15385 ts_tablet_manager.cc:1929] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.732649 15497 raft_consensus.cc:493] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.732728 15497 raft_consensus.cc:515] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.733059 15497 leader_election.cc:290] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.733199 15385 log.cc:1199] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/88052f79558a42eeb1c8acf44e6b48e1
I20251025 08:02:25.733311 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90bb43eb01c949b09f7a4c703a99dc7e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.733436 14976 raft_consensus.cc:2468] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:25.733675 15048 leader_election.cc:304] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.733822 15497 raft_consensus.cc:2804] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.733870 15497 raft_consensus.cc:493] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.733899 15497 raft_consensus.cc:3060] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.734539 15385 ts_tablet_manager.cc:1950] T 88052f79558a42eeb1c8acf44e6b48e1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.734673 15497 raft_consensus.cc:515] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.734923 15497 leader_election.cc:290] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.735219 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 88052f79558a42eeb1c8acf44e6b48e1 (table default.Table_8f781f3f507c4a339ba15100b719fcbb [id=2283253a9522485d93d6c484c5eef6e4]) successfully deleted
I20251025 08:02:25.736478 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90bb43eb01c949b09f7a4c703a99dc7e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:25.736580 14976 raft_consensus.cc:3060] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.736718 15451 tablet.cc:1722] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.737859 14976 raft_consensus.cc:2468] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:25.738929 15048 leader_election.cc:304] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.739081 15497 raft_consensus.cc:2804] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.739161 15497 raft_consensus.cc:697] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:25.739207 15436 tablet.cc:1722] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.739276 15497 consensus_queue.cc:237] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.732671 15372 tablet_bootstrap.cc:492] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.740283 15372 ts_tablet_manager.cc:1403] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20251025 08:02:25.740717 15372 raft_consensus.cc:359] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.740815 15372 raft_consensus.cc:385] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.740849 15372 raft_consensus.cc:740] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.740948 15372 consensus_queue.cc:260] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.741199 15372 ts_tablet_manager.cc:1434] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.733316 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90bb43eb01c949b09f7a4c703a99dc7e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.735513 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "90bb43eb01c949b09f7a4c703a99dc7e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:25.741555 15049 leader_election.cc:343] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:25.741845 15049 leader_election.cc:343] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.742746 15372 tablet_bootstrap.cc:492] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.742697 14652 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_2931abc275064dfd818fc151a0267713"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.743063 14652 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2931abc275064dfd818fc151a0267713 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.743693 15372 tablet_bootstrap.cc:654] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.737718 15909 raft_consensus.cc:493] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.744181 15909 raft_consensus.cc:515] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.744505 15909 leader_election.cc:290] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.744750 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6ee2b8cfe7743d29714910fe8060083" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.744868 15113 raft_consensus.cc:2393] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:25.745342 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c6ee2b8cfe7743d29714910fe8060083" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.745522 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 1a9f9a42dbe7402189df59c49b463fad (table default.Table_9bbb4f343dc64170b9f81ce2f0c5f37f [id=78794c8ceec3479ca3ac3ef55594762f]) successfully deleted
I20251025 08:02:25.746148 15185 leader_election.cc:304] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:25.746395 15909 raft_consensus.cc:3060] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.746699 15370 tablet_bootstrap.cc:492] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.746783 15370 ts_tablet_manager.cc:1403] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20251025 08:02:25.747231 15372 tablet_bootstrap.cc:492] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.747314 15372 ts_tablet_manager.cc:1403] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:25.747339 15909 raft_consensus.cc:2749] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.747380 15370 raft_consensus.cc:359] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.747463 15370 raft_consensus.cc:385] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.747490 15370 raft_consensus.cc:740] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.747589 15370 consensus_queue.cc:260] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.747824 15370 ts_tablet_manager.cc:1434] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.747802 15372 raft_consensus.cc:359] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.747898 15372 raft_consensus.cc:385] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.747931 15372 raft_consensus.cc:740] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.747962 15370 tablet_bootstrap.cc:492] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.748039 15372 consensus_queue.cc:260] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.748299 15372 ts_tablet_manager.cc:1434] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.748787 15370 tablet_bootstrap.cc:654] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.751376 15464 raft_consensus.cc:493] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.751456 15464 raft_consensus.cc:515] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.751785 15464 leader_election.cc:290] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.752059 14651 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet f585455b77df49738b44c31a3d7adb71
I20251025 08:02:25.752305 15369 tablet_bootstrap.cc:492] T 3743a9de419d40689c49aae471edfa01 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.752370 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "071220f7bd334f5aad733209193244d4" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.752403 15369 ts_tablet_manager.cc:1403] T 3743a9de419d40689c49aae471edfa01 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.068s user 0.000s sys 0.001s
I20251025 08:02:25.752460 15113 raft_consensus.cc:2468] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:25.752465 14651 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_ad3dee0a2af74757a17bc9fd115a69cb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.752753 14651 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad3dee0a2af74757a17bc9fd115a69cb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.752831 15369 raft_consensus.cc:359] T 3743a9de419d40689c49aae471edfa01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.752919 15369 raft_consensus.cc:385] T 3743a9de419d40689c49aae471edfa01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.752966 15369 raft_consensus.cc:740] T 3743a9de419d40689c49aae471edfa01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.753000 14915 leader_election.cc:304] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.753082 15369 consensus_queue.cc:260] T 3743a9de419d40689c49aae471edfa01 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.753329 15369 ts_tablet_manager.cc:1434] T 3743a9de419d40689c49aae471edfa01 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.753500 15369 tablet_bootstrap.cc:492] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.753573 15374 raft_consensus.cc:2804] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.753643 15374 raft_consensus.cc:493] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.753679 15374 raft_consensus.cc:3060] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.754438 15369 tablet_bootstrap.cc:654] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.754545 15374 raft_consensus.cc:515] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.754861 15374 leader_election.cc:290] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.755522 15369 tablet_bootstrap.cc:492] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.755585 15369 ts_tablet_manager.cc:1403] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251025 08:02:25.755899 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet f585455b77df49738b44c31a3d7adb71 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.756170 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "071220f7bd334f5aad733209193244d4" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:25.756230 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet f585455b77df49738b44c31a3d7adb71 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.756269 15113 raft_consensus.cc:3060] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.756524 15369 raft_consensus.cc:359] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.756649 15369 raft_consensus.cc:385] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.756707 15369 raft_consensus.cc:740] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.756851 15369 consensus_queue.cc:260] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.757077 15113 raft_consensus.cc:2468] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:25.757107 15369 ts_tablet_manager.cc:1434] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.757239 15369 tablet_bootstrap.cc:492] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.758015 15370 tablet_bootstrap.cc:492] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.758072 15369 tablet_bootstrap.cc:654] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.758093 15370 ts_tablet_manager.cc:1403] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:25.758149 15380 raft_consensus.cc:493] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.758240 15380 raft_consensus.cc:515] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.758554 15380 leader_election.cc:290] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.758534 15370 raft_consensus.cc:359] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.758612 15370 raft_consensus.cc:385] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.758632 15370 raft_consensus.cc:740] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.758723 15370 consensus_queue.cc:260] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.758944 15370 ts_tablet_manager.cc:1434] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.759066 14915 leader_election.cc:304] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.759159 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "080d77feb2a242959fb8e375f07e5a5f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.759279 15370 tablet_bootstrap.cc:492] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:25.759428 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet f585455b77df49738b44c31a3d7adb71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f585455b77df49738b44c31a3d7adb71 already in progress: creating tablet
I20251025 08:02:25.759384 14649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_dc0d80dcd5304d218f07109ec6675955"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.759552 15464 raft_consensus.cc:2804] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.759620 15464 raft_consensus.cc:697] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
W20251025 08:02:25.759685 14649 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dc0d80dcd5304d218f07109ec6675955 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.759737 15464 consensus_queue.cc:237] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.760095 15370 tablet_bootstrap.cc:654] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.760478 14650 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_782772638c3646fea7dfa5ecc8e01959"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.760617 15048 leader_election.cc:343] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:25.760772 14650 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_782772638c3646fea7dfa5ecc8e01959 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:25.761473 14653 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 76a906654cc44bfb96d9e1a936040e57 consensus state has no leader
I20251025 08:02:25.761689 15370 tablet_bootstrap.cc:492] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.761677 14653 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_eaf82018b440497e86dbf2cfdd3785e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.761744 15370 ts_tablet_manager.cc:1403] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
W20251025 08:02:25.761945 14653 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eaf82018b440497e86dbf2cfdd3785e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.762066 15370 raft_consensus.cc:359] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.762131 15370 raft_consensus.cc:385] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.762153 15370 raft_consensus.cc:740] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.762893 15370 consensus_queue.cc:260] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.763120 15370 ts_tablet_manager.cc:1434] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.763303 15370 tablet_bootstrap.cc:492] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.764008 15370 tablet_bootstrap.cc:654] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.765158 15370 tablet_bootstrap.cc:492] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.765280 15370 ts_tablet_manager.cc:1403] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:25.765769 15370 raft_consensus.cc:359] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.765910 15370 raft_consensus.cc:385] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.765990 15370 raft_consensus.cc:740] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.766141 15370 consensus_queue.cc:260] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.766870 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet f585455b77df49738b44c31a3d7adb71 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.767218 15370 ts_tablet_manager.cc:1434] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:25.767388 15370 tablet_bootstrap.cc:492] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:25.767474 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet f585455b77df49738b44c31a3d7adb71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f585455b77df49738b44c31a3d7adb71 already in progress: creating tablet
I20251025 08:02:25.768209 15370 tablet_bootstrap.cc:654] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.769398 15380 raft_consensus.cc:493] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.769474 15380 raft_consensus.cc:515] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.769768 15380 leader_election.cc:290] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.769833 15372 tablet_bootstrap.cc:492] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.770114 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3743a9de419d40689c49aae471edfa01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.770296 14976 raft_consensus.cc:2468] T 3743a9de419d40689c49aae471edfa01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:25.770568 15048 leader_election.cc:304] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.770656 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "080d77feb2a242959fb8e375f07e5a5f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.770782 15372 tablet_bootstrap.cc:654] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.770895 15380 raft_consensus.cc:2804] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.770942 15380 raft_consensus.cc:493] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.770979 15380 raft_consensus.cc:3060] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.771097 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3743a9de419d40689c49aae471edfa01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.771278 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "071220f7bd334f5aad733209193244d4" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.771435 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "071220f7bd334f5aad733209193244d4" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:25.771767 15380 raft_consensus.cc:515] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:25.771834 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet f585455b77df49738b44c31a3d7adb71 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f585455b77df49738b44c31a3d7adb71 already in progress: creating tablet
I20251025 08:02:25.772068 15380 leader_election.cc:290] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:25.772272 15049 leader_election.cc:343] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.772280 14652 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_9f0385b6e26c4f259e1eedb673daea56" } new_table_name: "default.Table_8f13647040414977b520af60cd428302" modify_external_catalogs: true
I20251025 08:02:25.772328 15049 leader_election.cc:304] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.772326 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3743a9de419d40689c49aae471edfa01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:25.772403 14976 raft_consensus.cc:3060] T 3743a9de419d40689c49aae471edfa01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:25.772483 15049 leader_election.cc:343] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.772946 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3743a9de419d40689c49aae471edfa01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:25.773288 14976 raft_consensus.cc:2468] T 3743a9de419d40689c49aae471edfa01 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:25.773304 15380 raft_consensus.cc:2749] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:25.773494 14914 leader_election.cc:343] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:25.773689 14914 leader_election.cc:343] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.773777 15048 leader_election.cc:304] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
W20251025 08:02:25.773926 15049 leader_election.cc:343] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.774057 15380 raft_consensus.cc:2804] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.774113 15380 raft_consensus.cc:697] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:25.774320 15380 consensus_queue.cc:237] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.775534 15370 tablet_bootstrap.cc:492] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.775609 15370 ts_tablet_manager.cc:1403] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251025 08:02:25.777235 15370 raft_consensus.cc:359] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.777321 15370 raft_consensus.cc:385] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.777352 15370 raft_consensus.cc:740] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.777477 15370 consensus_queue.cc:260] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.777813 15370 ts_tablet_manager.cc:1434] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:25.777979 15370 tablet_bootstrap.cc:492] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.778873 15370 tablet_bootstrap.cc:654] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.779110 14651 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_fa9d9b9a535648d89d19b74bb940ed9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.779410 14651 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa9d9b9a535648d89d19b74bb940ed9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.784327 15372 tablet_bootstrap.cc:492] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.784394 15372 ts_tablet_manager.cc:1403] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:25.784840 15369 tablet_bootstrap.cc:492] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.784794 15372 raft_consensus.cc:359] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.784878 15372 raft_consensus.cc:385] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.784902 15372 raft_consensus.cc:740] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.784904 15369 ts_tablet_manager.cc:1403] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.001s
I20251025 08:02:25.784994 15372 consensus_queue.cc:260] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.785369 15372 ts_tablet_manager.cc:1434] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.785363 15369 raft_consensus.cc:359] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.785444 15369 raft_consensus.cc:385] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.785475 15369 raft_consensus.cc:740] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.785534 15372 tablet_bootstrap.cc:492] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.785583 15369 consensus_queue.cc:260] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.785842 15369 ts_tablet_manager.cc:1434] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.786002 15369 tablet_bootstrap.cc:492] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.786443 15372 tablet_bootstrap.cc:654] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.786962 14954 tablet_service.cc:1505] Processing CreateTablet for tablet 7f5c6a17507d4a5a8057a725d3299ab9 (DEFAULT_TABLE table=default.Table_7257511e2df84f9cafdd1fe1ec4a180b [id=b5be4f412cc04aa59c819d0e1cc403bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.787254 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f5c6a17507d4a5a8057a725d3299ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.787818 15369 tablet_bootstrap.cc:654] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.789762 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 77365d99094541b2a5f7b8bb3bc18739 (DEFAULT_TABLE table=default.Table_129b50f9cb4f415382a1aa57c3f53670 [id=10953f82daf547f1a012597278f4770c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.789821 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 821de6815eb244058f1d8a7a06bf48a6 (DEFAULT_TABLE table=default.Table_c485105a684f427295b74968c29fd30c [id=3abb3c7d3dd74d408db083bf0499f679]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.789999 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77365d99094541b2a5f7b8bb3bc18739. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.790208 15221 tablet_service.cc:1505] Processing CreateTablet for tablet a608dd2b2d1d42178bb00b3355bd6470 (DEFAULT_TABLE table=default.Table_808c7980d96b48a181f79124ea5a0adb [id=e3c0ae796ee2421abe38408b729dd2a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.790294 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 7f5c6a17507d4a5a8057a725d3299ab9 (DEFAULT_TABLE table=default.Table_7257511e2df84f9cafdd1fe1ec4a180b [id=b5be4f412cc04aa59c819d0e1cc403bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.790414 15221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a608dd2b2d1d42178bb00b3355bd6470. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.790616 15226 tablet_service.cc:1505] Processing CreateTablet for tablet 88efe498fb6f4ce1a02b5389ff6f5797 (DEFAULT_TABLE table=default.Table_670e2c0d014c4003af93e44a18490fda [id=c824002e1e954b65be5aee4a39a78cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.790789 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88efe498fb6f4ce1a02b5389ff6f5797. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.792253 15227 tablet_service.cc:1505] Processing CreateTablet for tablet adc14c254b0c4974bfbadede727b6c6b (DEFAULT_TABLE table=default.Table_d8110cf18c6748b092f8bf7348349f88 [id=53d57abf556c4926b02a1e265cf34c61]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.792317 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 7f5c6a17507d4a5a8057a725d3299ab9 (DEFAULT_TABLE table=default.Table_7257511e2df84f9cafdd1fe1ec4a180b [id=b5be4f412cc04aa59c819d0e1cc403bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.792460 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc14c254b0c4974bfbadede727b6c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.792524 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f5c6a17507d4a5a8057a725d3299ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.792644 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 821de6815eb244058f1d8a7a06bf48a6 (DEFAULT_TABLE table=default.Table_c485105a684f427295b74968c29fd30c [id=3abb3c7d3dd74d408db083bf0499f679]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.792830 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821de6815eb244058f1d8a7a06bf48a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.793783 15219 tablet_service.cc:1505] Processing CreateTablet for tablet 95c9778bd0d94542bec79e9d36c6ce46 (DEFAULT_TABLE table=default.Table_7387f487853a4b608f5e5237684550d8 [id=3e1281c3f28346a4a1dd2c4fcc990a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.793951 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c9778bd0d94542bec79e9d36c6ce46. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.794440 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 346c0c8bf30b4dbaa92436b45e5fbf47 (DEFAULT_TABLE table=default.Table_4afe1c6e03a941df9d5f7df4a42cbc61 [id=ef3a1760f2c44935bbb79e518510905f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.794497 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 77365d99094541b2a5f7b8bb3bc18739 (DEFAULT_TABLE table=default.Table_129b50f9cb4f415382a1aa57c3f53670 [id=10953f82daf547f1a012597278f4770c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.794556 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 88efe498fb6f4ce1a02b5389ff6f5797 (DEFAULT_TABLE table=default.Table_670e2c0d014c4003af93e44a18490fda [id=c824002e1e954b65be5aee4a39a78cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.794646 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 346c0c8bf30b4dbaa92436b45e5fbf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.794811 15089 tablet_service.cc:1505] Processing CreateTablet for tablet a608dd2b2d1d42178bb00b3355bd6470 (DEFAULT_TABLE table=default.Table_808c7980d96b48a181f79124ea5a0adb [id=e3c0ae796ee2421abe38408b729dd2a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.795003 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a608dd2b2d1d42178bb00b3355bd6470. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.796263 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88efe498fb6f4ce1a02b5389ff6f5797. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.796623 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 346c0c8bf30b4dbaa92436b45e5fbf47 (DEFAULT_TABLE table=default.Table_4afe1c6e03a941df9d5f7df4a42cbc61 [id=ef3a1760f2c44935bbb79e518510905f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.796775 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 346c0c8bf30b4dbaa92436b45e5fbf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.796829 15091 tablet_service.cc:1505] Processing CreateTablet for tablet adc14c254b0c4974bfbadede727b6c6b (DEFAULT_TABLE table=default.Table_d8110cf18c6748b092f8bf7348349f88 [id=53d57abf556c4926b02a1e265cf34c61]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.797027 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc14c254b0c4974bfbadede727b6c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.797886 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f5c6a17507d4a5a8057a725d3299ab9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.798352 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 95c9778bd0d94542bec79e9d36c6ce46 (DEFAULT_TABLE table=default.Table_7387f487853a4b608f5e5237684550d8 [id=3e1281c3f28346a4a1dd2c4fcc990a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.798472 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821de6815eb244058f1d8a7a06bf48a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.798545 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c9778bd0d94542bec79e9d36c6ce46. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.799923 15369 tablet_bootstrap.cc:492] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.799989 15369 ts_tablet_manager.cc:1403] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.001s
I20251025 08:02:25.800123 15372 tablet_bootstrap.cc:492] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.800174 15372 ts_tablet_manager.cc:1403] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:25.800387 15369 raft_consensus.cc:359] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.800485 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77365d99094541b2a5f7b8bb3bc18739. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.800480 15369 raft_consensus.cc:385] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.800514 15369 raft_consensus.cc:740] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.800614 15369 consensus_queue.cc:260] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.800683 15372 raft_consensus.cc:359] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.800784 15372 raft_consensus.cc:385] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.800818 15372 raft_consensus.cc:740] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.800873 15369 ts_tablet_manager.cc:1434] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:25.800946 15372 consensus_queue.cc:260] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.801111 15369 tablet_bootstrap.cc:492] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.801256 15372 ts_tablet_manager.cc:1434] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.801523 15372 tablet_bootstrap.cc:492] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.801973 15369 tablet_bootstrap.cc:654] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.802412 15372 tablet_bootstrap.cc:654] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.803066 14655 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_cd66db813b934963acab38c81d9fd793" } new_table_name: "default.Table_20420bbacfa743d4ad1ed935423c4ff5" modify_external_catalogs: true
I20251025 08:02:25.803319 15372 tablet_bootstrap.cc:492] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.803380 15372 ts_tablet_manager.cc:1403] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:25.803812 15372 raft_consensus.cc:359] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.803905 15372 raft_consensus.cc:385] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.803943 15372 raft_consensus.cc:740] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.803927 14649 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_3231d801b62849a8a125cbe1d6fe9482" } modify_external_catalogs: true
I20251025 08:02:25.804025 14649 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_3231d801b62849a8a125cbe1d6fe9482" } modify_external_catalogs: true
I20251025 08:02:25.804026 15372 consensus_queue.cc:260] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.804306 15372 ts_tablet_manager.cc:1434] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.804451 15372 tablet_bootstrap.cc:492] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.805362 15372 tablet_bootstrap.cc:654] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.806665 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 88efe498fb6f4ce1a02b5389ff6f5797 (DEFAULT_TABLE table=default.Table_670e2c0d014c4003af93e44a18490fda [id=c824002e1e954b65be5aee4a39a78cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.806815 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 821de6815eb244058f1d8a7a06bf48a6 (DEFAULT_TABLE table=default.Table_c485105a684f427295b74968c29fd30c [id=3abb3c7d3dd74d408db083bf0499f679]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.806883 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88efe498fb6f4ce1a02b5389ff6f5797. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.806980 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821de6815eb244058f1d8a7a06bf48a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.807013 14958 tablet_service.cc:1505] Processing CreateTablet for tablet adc14c254b0c4974bfbadede727b6c6b (DEFAULT_TABLE table=default.Table_d8110cf18c6748b092f8bf7348349f88 [id=53d57abf556c4926b02a1e265cf34c61]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.807194 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adc14c254b0c4974bfbadede727b6c6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.808874 14952 tablet_service.cc:1505] Processing CreateTablet for tablet a608dd2b2d1d42178bb00b3355bd6470 (DEFAULT_TABLE table=default.Table_808c7980d96b48a181f79124ea5a0adb [id=e3c0ae796ee2421abe38408b729dd2a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.809034 14953 tablet_service.cc:1505] Processing CreateTablet for tablet 346c0c8bf30b4dbaa92436b45e5fbf47 (DEFAULT_TABLE table=default.Table_4afe1c6e03a941df9d5f7df4a42cbc61 [id=ef3a1760f2c44935bbb79e518510905f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.809100 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a608dd2b2d1d42178bb00b3355bd6470. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.809230 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 346c0c8bf30b4dbaa92436b45e5fbf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.809314 14954 tablet_service.cc:1505] Processing CreateTablet for tablet 77365d99094541b2a5f7b8bb3bc18739 (DEFAULT_TABLE table=default.Table_129b50f9cb4f415382a1aa57c3f53670 [id=10953f82daf547f1a012597278f4770c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.809383 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 95c9778bd0d94542bec79e9d36c6ce46 (DEFAULT_TABLE table=default.Table_7387f487853a4b608f5e5237684550d8 [id=3e1281c3f28346a4a1dd2c4fcc990a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.809526 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77365d99094541b2a5f7b8bb3bc18739. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.809715 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95c9778bd0d94542bec79e9d36c6ce46. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.814975 14647 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet cf90d2e477b9493e9b78aae6a7d2d3e0
I20251025 08:02:25.815232 14647 catalog_manager.cc:6719] ReplaceTablet: tablet cf90d2e477b9493e9b78aae6a7d2d3e0 deleted and replaced by tablet 262014e996b54824824aa99c0b7ad771
I20251025 08:02:25.818879 14649 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet cf5008728a6241c096c9a76f8e374ceb
I20251025 08:02:25.820012 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet cf5008728a6241c096c9a76f8e374ceb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.820271 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet cf5008728a6241c096c9a76f8e374ceb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.820389 15246 raft_consensus.cc:3060] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.820425 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet cf90d2e477b9493e9b78aae6a7d2d3e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 262014e996b54824824aa99c0b7ad771) from {username='slave'} at 127.0.0.1:36254
W20251025 08:02:25.821084 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet cf5008728a6241c096c9a76f8e374ceb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf5008728a6241c096c9a76f8e374ceb already in progress: creating tablet
W20251025 08:02:25.821280 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet cf90d2e477b9493e9b78aae6a7d2d3e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf90d2e477b9493e9b78aae6a7d2d3e0 already in progress: creating tablet
I20251025 08:02:25.821348 15246 raft_consensus.cc:1275] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:25.821511 15909 raft_consensus.cc:493] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.821579 15909 raft_consensus.cc:515] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.821708 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet cf90d2e477b9493e9b78aae6a7d2d3e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 262014e996b54824824aa99c0b7ad771) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.821898 15909 leader_election.cc:290] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.821925 14649 master_service.cc:954] ReplaceTablet: received request to replace tablet cf90d2e477b9493e9b78aae6a7d2d3e0 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.822147 15113 raft_consensus.cc:1275] T 5b49d48b94b0427aa2dcc39dae45a4eb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:25.822486 15464 consensus_queue.cc:1048] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.823158 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b49d48b94b0427aa2dcc39dae45a4eb" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.823310 15464 consensus_queue.cc:1048] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.824196 14651 master_service.cc:954] ReplaceTablet: received request to replace tablet 01d9f6636b364e3b9192ae546422de5b from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.824298 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet cf5008728a6241c096c9a76f8e374ceb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
W20251025 08:02:25.824775 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet cf5008728a6241c096c9a76f8e374ceb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf5008728a6241c096c9a76f8e374ceb already in progress: creating tablet
I20251025 08:02:25.828290 14648 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet 262014e996b54824824aa99c0b7ad771
W20251025 08:02:25.828960 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet cf5008728a6241c096c9a76f8e374ceb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf5008728a6241c096c9a76f8e374ceb already in progress: creating tablet
I20251025 08:02:25.829176 15451 tablet.cc:1722] T 5b49d48b94b0427aa2dcc39dae45a4eb P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.829631 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet cf90d2e477b9493e9b78aae6a7d2d3e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 262014e996b54824824aa99c0b7ad771) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.830261 15783 tablet.cc:1722] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.834405 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5b49d48b94b0427aa2dcc39dae45a4eb" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.834833 14649 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_0046658bb1c6486da44cf4f7da540d34" } modify_external_catalogs: true
I20251025 08:02:25.834934 14649 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_0046658bb1c6486da44cf4f7da540d34" } modify_external_catalogs: true
I20251025 08:02:25.835361 14648 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_129b50f9cb4f415382a1aa57c3f53670" } modify_external_catalogs: true
I20251025 08:02:25.835446 14648 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_129b50f9cb4f415382a1aa57c3f53670" } modify_external_catalogs: true
I20251025 08:02:25.838580 15183 leader_election.cc:304] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:25.838887 15909 raft_consensus.cc:2749] T 5b49d48b94b0427aa2dcc39dae45a4eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251025 08:02:25.839665 15374 consensus_queue.cc:1048] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.840433 15370 tablet_bootstrap.cc:492] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.840510 15370 ts_tablet_manager.cc:1403] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.063s user 0.002s sys 0.000s
I20251025 08:02:25.840922 15370 raft_consensus.cc:359] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.841086 15370 raft_consensus.cc:385] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.841117 15370 raft_consensus.cc:740] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.841207 15370 consensus_queue.cc:260] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.841459 15370 ts_tablet_manager.cc:1434] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:25.841555 14649 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet c6d9fd3a6b2d41c5881248c0960c3ee7
I20251025 08:02:25.841609 15370 tablet_bootstrap.cc:492] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.842528 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.842664 15370 tablet_bootstrap.cc:654] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.842909 15386 tablet_replica.cc:333] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.843039 15386 raft_consensus.cc:2243] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.843147 15386 raft_consensus.cc:2272] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.843238 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.843403 15388 tablet_replica.cc:333] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.843483 15386 ts_tablet_manager.cc:1916] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.843523 15388 raft_consensus.cc:2243] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:25.843688 15388 raft_consensus.cc:2272] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.844005 15388 ts_tablet_manager.cc:1916] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.844653 15370 tablet_bootstrap.cc:492] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.844727 15370 ts_tablet_manager.cc:1403] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:25.845052 15370 raft_consensus.cc:359] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.845124 15370 raft_consensus.cc:385] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.845156 15370 raft_consensus.cc:740] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.845276 15370 consensus_queue.cc:260] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.845420 15386 ts_tablet_manager.cc:1929] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20251025 08:02:25.845448 15642 raft_consensus.cc:493] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.845475 15386 log.cc:1199] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/c6d9fd3a6b2d41c5881248c0960c3ee7
I20251025 08:02:25.845520 15370 ts_tablet_manager.cc:1434] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.845506 15642 raft_consensus.cc:515] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.845643 15370 tablet_bootstrap.cc:492] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.845700 15386 ts_tablet_manager.cc:1950] T c6d9fd3a6b2d41c5881248c0960c3ee7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.845793 15642 leader_election.cc:290] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.846025 15409 raft_consensus.cc:493] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.846062 15388 ts_tablet_manager.cc:1929] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20251025 08:02:25.846118 15388 log.cc:1199] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/c6d9fd3a6b2d41c5881248c0960c3ee7
I20251025 08:02:25.846100 15409 raft_consensus.cc:515] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.846380 15388 ts_tablet_manager.cc:1950] T c6d9fd3a6b2d41c5881248c0960c3ee7 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.846419 15409 leader_election.cc:290] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.846423 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (table default.Table_0046658bb1c6486da44cf4f7da540d34 [id=9af7f62b46de47af9bfae466af91660b]) successfully deleted
I20251025 08:02:25.846487 15409 raft_consensus.cc:493] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.846540 15409 raft_consensus.cc:515] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.846813 15409 leader_election.cc:290] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.846923 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "422e2c32a18a4e1ea9a5e371da17dfea" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:25.847256 15049 leader_election.cc:343] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.847563 15370 tablet_bootstrap.cc:654] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.847702 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "422e2c32a18a4e1ea9a5e371da17dfea" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:25.848382 15048 leader_election.cc:343] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.848456 15048 leader_election.cc:304] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.848575 15380 raft_consensus.cc:2749] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.848701 15370 tablet_bootstrap.cc:492] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.848767 15370 ts_tablet_manager.cc:1403] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:25.848796 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06b3cc87826249ccb1f84c29df09f802" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.849159 15370 raft_consensus.cc:359] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:25.849238 15370 raft_consensus.cc:385] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.849272 15370 raft_consensus.cc:740] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.849386 15370 consensus_queue.cc:260] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:25.849589 15370 ts_tablet_manager.cc:1434] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:25.849574 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e5e6d65e6ed4c228e97d7b8c3d63d65" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.849690 14977 raft_consensus.cc:2393] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:25.850219 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet c6d9fd3a6b2d41c5881248c0960c3ee7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.850365 15385 tablet_replica.cc:333] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.850360 15246 raft_consensus.cc:3060] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.850489 15385 raft_consensus.cc:2243] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.850585 15385 raft_consensus.cc:2272] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.850876 15385 ts_tablet_manager.cc:1916] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.851766 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e5e6d65e6ed4c228e97d7b8c3d63d65" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.851783 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06b3cc87826249ccb1f84c29df09f802" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:25.852883 15385 ts_tablet_manager.cc:1929] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20251025 08:02:25.852938 15369 tablet_bootstrap.cc:492] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.853025 15369 ts_tablet_manager.cc:1403] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.000s
I20251025 08:02:25.853438 15369 raft_consensus.cc:359] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.853525 15369 raft_consensus.cc:385] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.853554 15369 raft_consensus.cc:740] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.853643 15369 consensus_queue.cc:260] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.853873 15369 ts_tablet_manager.cc:1434] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.854023 15369 tablet_bootstrap.cc:492] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.854313 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (table default.Table_0046658bb1c6486da44cf4f7da540d34 [id=9af7f62b46de47af9bfae466af91660b]) successfully deleted
I20251025 08:02:25.854473 15464 consensus_queue.cc:1048] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.854936 15369 tablet_bootstrap.cc:654] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.855384 14654 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 43da3f4fc9604562a95dff59da3c574b (table default.Table_9f0385b6e26c4f259e1eedb673daea56 [id=8dc21ea1bf46490388397ecd6895a031]). Expected version 1 got 0
I20251025 08:02:25.855491 14654 catalog_manager.cc:5649] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:25.855736 14654 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 72ff369b973b4c5981ea0810e37e8562 (table default.Table_4ed89f5fc452467d920d19caa6fb931a [id=8a0e4fe9e4544c539cb23b0279c1deaf]). Expected version 1 got 0
I20251025 08:02:25.855846 14654 catalog_manager.cc:5649] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:25.856297 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 8e0cc372400447b48e5fecfc009a11c2 (DEFAULT_TABLE table=default.Table_ad3dee0a2af74757a17bc9fd115a69cb [id=e9162dd5a2524394b1cb11594293de96]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:25.856493 14652 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 43da3f4fc9604562a95dff59da3c574b consensus state has no leader
I20251025 08:02:25.856506 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0cc372400447b48e5fecfc009a11c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.857868 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 8e0cc372400447b48e5fecfc009a11c2 (DEFAULT_TABLE table=default.Table_ad3dee0a2af74757a17bc9fd115a69cb [id=e9162dd5a2524394b1cb11594293de96]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.857945 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 2091a81ad64a4574b04c081bdeceda1f (DEFAULT_TABLE table=default.Table_2931abc275064dfd818fc151a0267713 [id=87037802262e424ebe9c070b5ef7ba62]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.858076 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0cc372400447b48e5fecfc009a11c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.858278 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2091a81ad64a4574b04c081bdeceda1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.858461 15228 tablet_service.cc:1505] Processing CreateTablet for tablet ea0d438e99864c57999abf3467edc643 (DEFAULT_TABLE table=default.Table_1dacf98643304d1288547a682f2d7815 [id=912da5ef8bbf4af29528c084ea7fa633]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.858686 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0d438e99864c57999abf3467edc643. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.859350 14651 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 01d9f6636b364e3b9192ae546422de5b
I20251025 08:02:25.859596 14651 catalog_manager.cc:6719] ReplaceTablet: tablet 01d9f6636b364e3b9192ae546422de5b deleted and replaced by tablet 53f89ab2ef9b4136812cb4a320a645a6
I20251025 08:02:25.860951 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 2091a81ad64a4574b04c081bdeceda1f (DEFAULT_TABLE table=default.Table_2931abc275064dfd818fc151a0267713 [id=87037802262e424ebe9c070b5ef7ba62]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.861173 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2091a81ad64a4574b04c081bdeceda1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.861168 15185 leader_election.cc:304] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:25.861353 14955 tablet_service.cc:1505] Processing CreateTablet for tablet ea0d438e99864c57999abf3467edc643 (DEFAULT_TABLE table=default.Table_1dacf98643304d1288547a682f2d7815 [id=912da5ef8bbf4af29528c084ea7fa633]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.861375 15185 leader_election.cc:304] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:25.861567 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0d438e99864c57999abf3467edc643. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.862315 15909 raft_consensus.cc:3060] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.863049 15090 tablet_service.cc:1505] Processing CreateTablet for tablet ea0d438e99864c57999abf3467edc643 (DEFAULT_TABLE table=default.Table_1dacf98643304d1288547a682f2d7815 [id=912da5ef8bbf4af29528c084ea7fa633]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.863157 15909 raft_consensus.cc:2749] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.863235 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea0d438e99864c57999abf3467edc643. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.863281 15909 raft_consensus.cc:2749] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.863349 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 01d9f6636b364e3b9192ae546422de5b with delete_type TABLET_DATA_DELETED (replaced by tablet 53f89ab2ef9b4136812cb4a320a645a6) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.863541 14954 tablet_service.cc:1505] Processing CreateTablet for tablet 2091a81ad64a4574b04c081bdeceda1f (DEFAULT_TABLE table=default.Table_2931abc275064dfd818fc151a0267713 [id=87037802262e424ebe9c070b5ef7ba62]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.863771 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2091a81ad64a4574b04c081bdeceda1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.863871 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 8e0cc372400447b48e5fecfc009a11c2 (DEFAULT_TABLE table=default.Table_ad3dee0a2af74757a17bc9fd115a69cb [id=e9162dd5a2524394b1cb11594293de96]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.864071 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e0cc372400447b48e5fecfc009a11c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.864100 15369 tablet_bootstrap.cc:492] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.864167 15369 ts_tablet_manager.cc:1403] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:25.864569 15369 raft_consensus.cc:359] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.864656 15369 raft_consensus.cc:385] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.864686 15369 raft_consensus.cc:740] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.864809 15369 consensus_queue.cc:260] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.865137 15369 ts_tablet_manager.cc:1434] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.865294 15369 tablet_bootstrap.cc:492] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.865497 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet 01d9f6636b364e3b9192ae546422de5b with delete_type TABLET_DATA_DELETED (replaced by tablet 53f89ab2ef9b4136812cb4a320a645a6) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.866408 15369 tablet_bootstrap.cc:654] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.867144 14651 master_service.cc:954] ReplaceTablet: received request to replace tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.852947 15385 log.cc:1199] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/c6d9fd3a6b2d41c5881248c0960c3ee7
I20251025 08:02:25.867843 15385 ts_tablet_manager.cc:1950] T c6d9fd3a6b2d41c5881248c0960c3ee7 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.869059 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 01d9f6636b364e3b9192ae546422de5b with delete_type TABLET_DATA_DELETED (replaced by tablet 53f89ab2ef9b4136812cb4a320a645a6) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.869132 14648 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 77365d99094541b2a5f7b8bb3bc18739
I20251025 08:02:25.869369 15370 tablet_bootstrap.cc:492] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.870225 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 77365d99094541b2a5f7b8bb3bc18739 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.870818 15388 tablet_replica.cc:333] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.870944 15388 raft_consensus.cc:2243] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.871028 15388 raft_consensus.cc:2272] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.872604 14646 catalog_manager.cc:5649] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.872826 14646 catalog_manager.cc:5649] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:25.873020 14646 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 76a906654cc44bfb96d9e1a936040e57 (table default.Table_4598018e26254b78befa93852241f777 [id=78794c8ceec3479ca3ac3ef55594762f]). Expected version 2 got 0
I20251025 08:02:25.873363 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 77365d99094541b2a5f7b8bb3bc18739 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.874251 14651 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65
I20251025 08:02:25.874374 14648 master_service.cc:954] ReplaceTablet: received request to replace tablet 06b3cc87826249ccb1f84c29df09f802 from {username='slave'} at 127.0.0.1:59180
I20251025 08:02:25.874401 15370 tablet_bootstrap.cc:654] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.874516 14651 catalog_manager.cc:6719] ReplaceTablet: tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65 deleted and replaced by tablet 0078dd6fb0e34d01a54889326dd6dfd7
I20251025 08:02:25.875021 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65 with delete_type TABLET_DATA_DELETED (replaced by tablet 0078dd6fb0e34d01a54889326dd6dfd7) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.875133 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 792c6d7038624ec29e5e36c0145c64db (DEFAULT_TABLE table=default.Table_4b7b9ad86d85404785a42b98239e38cc [id=7505f67ea24847a6aa9c90955f1596fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.875340 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 792c6d7038624ec29e5e36c0145c64db. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.875337 15372 tablet_bootstrap.cc:492] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.875458 15372 ts_tablet_manager.cc:1403] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.071s user 0.002s sys 0.000s
I20251025 08:02:25.875842 15372 raft_consensus.cc:359] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.875927 15372 raft_consensus.cc:385] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.875957 15372 raft_consensus.cc:740] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.876075 15372 consensus_queue.cc:260] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.876360 15372 ts_tablet_manager.cc:1434] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.876513 15372 tablet_bootstrap.cc:492] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.877408 15372 tablet_bootstrap.cc:654] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.878899 14653 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 06b3cc87826249ccb1f84c29df09f802 (table default.Table_f5bf4f0664c44a70aa6d2f0e9143f7a7 [id=6739c1319b784c8eb66fc75125f83056]). Expected version 3 got 0
I20251025 08:02:25.879329 14654 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_f5bf4f0664c44a70aa6d2f0e9143f7a7 [id=6739c1319b784c8eb66fc75125f83056] alter complete (version 3)
I20251025 08:02:25.880548 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65 with delete_type TABLET_DATA_DELETED (replaced by tablet 0078dd6fb0e34d01a54889326dd6dfd7) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.880632 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet b1ae9934b0ca403ea026233ecd952a20 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.884109 15388 ts_tablet_manager.cc:1916] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.885779 15386 tablet_replica.cc:333] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.886163 15388 ts_tablet_manager.cc:1929] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20251025 08:02:25.886225 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 01d9f6636b364e3b9192ae546422de5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01d9f6636b364e3b9192ae546422de5b already in progress: creating tablet
I20251025 08:02:25.886271 15388 log.cc:1199] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/01d9f6636b364e3b9192ae546422de5b
W20251025 08:02:25.886373 14641 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 77365d99094541b2a5f7b8bb3bc18739 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77365d99094541b2a5f7b8bb3bc18739 already in progress: creating tablet
I20251025 08:02:25.886469 15388 ts_tablet_manager.cc:1950] T 01d9f6636b364e3b9192ae546422de5b P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.886860 15386 raft_consensus.cc:2243] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.887024 15386 raft_consensus.cc:2272] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.887007 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 01d9f6636b364e3b9192ae546422de5b (table default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]) successfully deleted
I20251025 08:02:25.887215 14648 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 06b3cc87826249ccb1f84c29df09f802
I20251025 08:02:25.887466 14648 catalog_manager.cc:6719] ReplaceTablet: tablet 06b3cc87826249ccb1f84c29df09f802 deleted and replaced by tablet 1d7c262b73904f1f87188718617e38a8
I20251025 08:02:25.887581 15370 tablet_bootstrap.cc:492] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.887650 15370 ts_tablet_manager.cc:1403] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251025 08:02:25.888039 15370 raft_consensus.cc:359] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:25.888134 15370 raft_consensus.cc:385] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.888166 15370 raft_consensus.cc:740] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.888270 15370 consensus_queue.cc:260] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:25.888542 15370 ts_tablet_manager.cc:1434] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.888670 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 06b3cc87826249ccb1f84c29df09f802 with delete_type TABLET_DATA_DELETED (replaced by tablet 1d7c262b73904f1f87188718617e38a8) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.888700 15370 tablet_bootstrap.cc:492] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.888832 14646 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_a368af9d0b8d46d78f9158b8f9949b01 [id=425e69ea7f8a407e8d22b735ee62c709] alter complete (version 1)
I20251025 08:02:25.889499 15370 tablet_bootstrap.cc:654] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.890075 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 06b3cc87826249ccb1f84c29df09f802 with delete_type TABLET_DATA_DELETED (replaced by tablet 1d7c262b73904f1f87188718617e38a8) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.890285 15642 raft_consensus.cc:493] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.890321 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet c6d9fd3a6b2d41c5881248c0960c3ee7 (table default.Table_0046658bb1c6486da44cf4f7da540d34 [id=9af7f62b46de47af9bfae466af91660b]) successfully deleted
I20251025 08:02:25.890354 15642 raft_consensus.cc:515] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:25.890522 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 01d9f6636b364e3b9192ae546422de5b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01d9f6636b364e3b9192ae546422de5b already in progress: creating tablet
I20251025 08:02:25.890657 15642 leader_election.cc:290] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.891084 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc5f892ca7a246a28a556fe0eb3f5442" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:25.891465 15049 leader_election.cc:343] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.892066 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 4dd72f76c950485c968409fe868266a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4f3163f8a4ff49069d55b9acf8a4c19a) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.892258 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 77365d99094541b2a5f7b8bb3bc18739 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.892324 15385 tablet_replica.cc:333] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.892463 15385 raft_consensus.cc:2243] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.892470 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65 with delete_type TABLET_DATA_DELETED (replaced by tablet 0078dd6fb0e34d01a54889326dd6dfd7) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.892556 15385 raft_consensus.cc:2272] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.893043 15385 ts_tablet_manager.cc:1916] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.893895 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet ff82c6ab12c844339dd387569fb85526 with delete_type TABLET_DATA_DELETED (replaced by tablet 8737df10a3c8482c995ac6aadc240c42) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.894081 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc5f892ca7a246a28a556fe0eb3f5442" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.894210 14977 raft_consensus.cc:2468] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:25.894479 15048 leader_election.cc:304] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.895068 15385 ts_tablet_manager.cc:1929] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.895135 15385 log.cc:1199] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/4dd72f76c950485c968409fe868266a2
I20251025 08:02:25.895309 15385 ts_tablet_manager.cc:1950] T 4dd72f76c950485c968409fe868266a2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.895349 15388 tablet_replica.cc:333] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.895452 15388 raft_consensus.cc:2243] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
W20251025 08:02:25.895515 14642 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 77365d99094541b2a5f7b8bb3bc18739 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77365d99094541b2a5f7b8bb3bc18739 already in progress: creating tablet
I20251025 08:02:25.895569 15388 pending_rounds.cc:70] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:25.895601 15388 pending_rounds.cc:77] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609798990585856 op_type: NO_OP noop_request { }
I20251025 08:02:25.895653 15388 raft_consensus.cc:2889] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:25.895864 15385 tablet_replica.cc:333] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.895984 15385 raft_consensus.cc:2243] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.896076 15385 raft_consensus.cc:2272] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.896283 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet 06b3cc87826249ccb1f84c29df09f802 with delete_type TABLET_DATA_DELETED (replaced by tablet 1d7c262b73904f1f87188718617e38a8) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.896351 15385 ts_tablet_manager.cc:1916] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.896425 14653 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_20420bbacfa743d4ad1ed935423c4ff5 [id=6c847ade4b8f485fb3353af3d2ec442b] alter complete (version 1)
I20251025 08:02:25.897351 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 4dd72f76c950485c968409fe868266a2 (table default.Table_2631732663a24b55a695edc159006f87 [id=b9853b2d88cf4a96b9fc5e1099f87064]) successfully deleted
I20251025 08:02:25.897454 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 834a6c675ac54dbdb5416c683384d96e with delete_type TABLET_DATA_DELETED (replaced by tablet bcb5f7e52507450c8a6f5a99a9927974) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.897563 15219 tablet_service.cc:1552] Processing DeleteTablet for tablet a12f1428ccda4cef8c00a34630f2e54e with delete_type TABLET_DATA_DELETED (replaced by tablet 0310efe286dd409ab857a92daa6ff99f) from {username='slave'} at 127.0.0.1:36846
W20251025 08:02:25.897882 14640 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 77365d99094541b2a5f7b8bb3bc18739 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77365d99094541b2a5f7b8bb3bc18739 already in progress: creating tablet
I20251025 08:02:25.897900 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet c1a10ef5ab73459695e1ef772e3a5266 with delete_type TABLET_DATA_DELETED (replaced by tablet adc14c254b0c4974bfbadede727b6c6b) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.898082 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet e54e57e850564e079db3dd383347ed30 with delete_type TABLET_DATA_DELETED (replaced by tablet 95c9778bd0d94542bec79e9d36c6ce46) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.895706 15388 raft_consensus.cc:2272] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.898217 15380 raft_consensus.cc:2804] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:25.898221 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet e54e57e850564e079db3dd383347ed30 with delete_type TABLET_DATA_DELETED (replaced by tablet 95c9778bd0d94542bec79e9d36c6ce46) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.898258 15380 raft_consensus.cc:493] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:25.898272 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet dfb4a050022d462699005fedc4323fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:37198
I20251025 08:02:25.898317 15380 raft_consensus.cc:3060] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.899063 15380 raft_consensus.cc:515] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.899212 15388 ts_tablet_manager.cc:1916] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.899319 15380 leader_election.cc:290] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.899605 14654 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 5b49d48b94b0427aa2dcc39dae45a4eb (table default.Table_20420bbacfa743d4ad1ed935423c4ff5 [id=6c847ade4b8f485fb3353af3d2ec442b]). Expected version 1 got 0
I20251025 08:02:25.899605 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc5f892ca7a246a28a556fe0eb3f5442" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:25.899704 14977 raft_consensus.cc:3060] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.899725 14654 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 4d9cd745bd3e42e98b0ae1d145007bee (table default.Table_8540557c73a34cc2851ad08d71acac22 [id=abe30167767443d0b8e59f9418399d88]). Expected version 1 got 0
I20251025 08:02:25.900631 14977 raft_consensus.cc:2468] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:25.900641 14653 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_1dacf98643304d1288547a682f2d7815" } new_table_name: "default.Table_3c48d3160e5d42509de4f0be1af855e2" modify_external_catalogs: true
I20251025 08:02:25.900861 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc5f892ca7a246a28a556fe0eb3f5442" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:25.900873 15048 leader_election.cc:304] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:25.901008 15380 raft_consensus.cc:2804] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:25.901083 15380 raft_consensus.cc:697] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
W20251025 08:02:25.901161 15049 leader_election.cc:343] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.901203 15380 consensus_queue.cc:237] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.901661 15386 ts_tablet_manager.cc:1916] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.901798 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet 3eee1563ce444900a96f9f363e92e7ff with delete_type TABLET_DATA_DELETED (replaced by tablet dfb4a050022d462699005fedc4323fdb) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.904680 15385 ts_tablet_manager.cc:1929] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.904743 15385 log.cc:1199] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/6e5e6d65e6ed4c228e97d7b8c3d63d65
I20251025 08:02:25.904762 14646 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_51c8e80718644971942377f115aee6ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.904930 15385 ts_tablet_manager.cc:1950] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
W20251025 08:02:25.905077 14646 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51c8e80718644971942377f115aee6ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.905478 14654 catalog_manager.cc:5649] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:25.905635 15247 raft_consensus.cc:3060] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:25.905663 15385 tablet_replica.cc:333] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.905769 15385 raft_consensus.cc:2243] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:25.905900 15385 raft_consensus.cc:2272] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.906379 15385 ts_tablet_manager.cc:1916] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.907339 15783 tablet.cc:1722] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:25.908591 15909 raft_consensus.cc:493] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.908676 15909 raft_consensus.cc:515] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.909026 15909 leader_election.cc:290] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:25.909561 15185 leader_election.cc:343] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: b1ae9934b0ca403ea026233ecd952a20
I20251025 08:02:25.910082 15370 tablet_bootstrap.cc:492] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.910144 15385 ts_tablet_manager.cc:1929] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.910200 15370 ts_tablet_manager.cc:1403] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.001s
I20251025 08:02:25.910233 15385 log.cc:1199] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/06b3cc87826249ccb1f84c29df09f802
I20251025 08:02:25.910470 15385 ts_tablet_manager.cc:1950] T 06b3cc87826249ccb1f84c29df09f802 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.910709 15370 raft_consensus.cc:359] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.910809 15370 raft_consensus.cc:385] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.910842 15370 raft_consensus.cc:740] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.910943 15370 consensus_queue.cc:260] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.911229 15370 ts_tablet_manager.cc:1434] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.911391 15370 tablet_bootstrap.cc:492] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.911443 15385 tablet_replica.cc:333] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.911535 15385 raft_consensus.cc:2243] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.911625 15385 raft_consensus.cc:2272] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.912088 15385 ts_tablet_manager.cc:1916] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.912266 15370 tablet_bootstrap.cc:654] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.914505 15385 ts_tablet_manager.cc:1929] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.914566 15385 log.cc:1199] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/e54e57e850564e079db3dd383347ed30
I20251025 08:02:25.915225 15385 ts_tablet_manager.cc:1950] T e54e57e850564e079db3dd383347ed30 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
W20251025 08:02:25.908216 14653 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ea0d438e99864c57999abf3467edc643 consensus state has no leader
I20251025 08:02:25.915885 14646 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_717f9ff4ad3846128a0a9136d894cc6a" } new_table_name: "default.Table_7a87c8dce3c3439db7879b9d642a745f" modify_external_catalogs: true
I20251025 08:02:25.915983 15386 ts_tablet_manager.cc:1929] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.916045 15386 log.cc:1199] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/6e5e6d65e6ed4c228e97d7b8c3d63d65
I20251025 08:02:25.916249 15386 ts_tablet_manager.cc:1950] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.916741 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65 (table default.Table_2f4e7934dc164dcdadd6467e1afc563a [id=4f1a1f84f436411db166b8c28873a27b]) successfully deleted
I20251025 08:02:25.917174 15386 tablet_replica.cc:333] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.917374 15386 raft_consensus.cc:2243] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.917527 15386 raft_consensus.cc:2272] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.917847 15385 tablet_replica.cc:333] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:25.917953 15385 raft_consensus.cc:2243] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.918468 15385 raft_consensus.cc:2272] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.918673 15370 tablet_bootstrap.cc:492] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.918740 15370 ts_tablet_manager.cc:1403] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20251025 08:02:25.919204 15370 raft_consensus.cc:359] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.919293 15370 raft_consensus.cc:385] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.919325 15370 raft_consensus.cc:740] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.919418 15370 consensus_queue.cc:260] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.919663 15370 ts_tablet_manager.cc:1434] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:25.919819 15370 tablet_bootstrap.cc:492] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.920625 15385 ts_tablet_manager.cc:1916] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.920743 15370 tablet_bootstrap.cc:654] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.920740 15909 consensus_queue.cc:1048] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.920956 15386 ts_tablet_manager.cc:1916] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.922079 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65 (table default.Table_2f4e7934dc164dcdadd6467e1afc563a [id=4f1a1f84f436411db166b8c28873a27b]) successfully deleted
W20251025 08:02:25.922909 15183 leader_election.cc:343] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: b1ae9934b0ca403ea026233ecd952a20
I20251025 08:02:25.922917 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 06b3cc87826249ccb1f84c29df09f802 (table default.Table_f5bf4f0664c44a70aa6d2f0e9143f7a7 [id=6739c1319b784c8eb66fc75125f83056]) successfully deleted
I20251025 08:02:25.922981 15183 leader_election.cc:304] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
W20251025 08:02:25.923054 15183 raft_consensus.cc:2686] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251025 08:02:25.923059 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet e54e57e850564e079db3dd383347ed30 (table default.Table_7387f487853a4b608f5e5237684550d8 [id=3e1281c3f28346a4a1dd2c4fcc990a2e]) successfully deleted
I20251025 08:02:25.923249 15385 ts_tablet_manager.cc:1929] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.923311 15385 log.cc:1199] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/dfb4a050022d462699005fedc4323fdb
I20251025 08:02:25.923398 15909 consensus_queue.cc:1048] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.923511 15385 ts_tablet_manager.cc:1950] T dfb4a050022d462699005fedc4323fdb P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:25.923861 14646 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet b3fdc5bd4c7f4506a150f31137e8b091 (table default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a]). Expected version 1 got 0
W20251025 08:02:25.924532 14646 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet b3fdc5bd4c7f4506a150f31137e8b091 (table default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet b3fdc5bd4c7f4506a150f31137e8b091 consensus state has no leader
W20251025 08:02:25.925014 14914 consensus_peers.cc:597] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:25.926458 15386 ts_tablet_manager.cc:1929] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.926735 15370 tablet_bootstrap.cc:492] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.926831 15370 ts_tablet_manager.cc:1403] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20251025 08:02:25.927237 15370 raft_consensus.cc:359] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.927333 15370 raft_consensus.cc:385] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.927376 15370 raft_consensus.cc:740] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.927476 15370 consensus_queue.cc:260] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.928704 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 792c6d7038624ec29e5e36c0145c64db (DEFAULT_TABLE table=default.Table_4b7b9ad86d85404785a42b98239e38cc [id=7505f67ea24847a6aa9c90955f1596fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.928939 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 792c6d7038624ec29e5e36c0145c64db. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.929373 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 7b8d94fc010046c7b37804f168471904 (DEFAULT_TABLE table=default.Table_521f904aba4a4b309e9864df54df659d [id=a95abf5644c64177afde71baad186bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.930411 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8d94fc010046c7b37804f168471904. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.928715 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 7b8d94fc010046c7b37804f168471904 (DEFAULT_TABLE table=default.Table_521f904aba4a4b309e9864df54df659d [id=a95abf5644c64177afde71baad186bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.930883 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8d94fc010046c7b37804f168471904. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.931717 14640 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet dfb4a050022d462699005fedc4323fdb (table default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]) successfully deleted
I20251025 08:02:25.930132 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 3092fd602dc7478693595ffcbc3bcf45 (DEFAULT_TABLE table=default.Table_e96eec11f48049a9b2a4332b23e60a6f [id=de8b64679bcb4ef582d6edd600342a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.932382 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3092fd602dc7478693595ffcbc3bcf45. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.933743 15112 raft_consensus.cc:1275] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:25.934540 15374 consensus_queue.cc:1048] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:25.934947 14954 tablet_service.cc:1505] Processing CreateTablet for tablet 792c6d7038624ec29e5e36c0145c64db (DEFAULT_TABLE table=default.Table_4b7b9ad86d85404785a42b98239e38cc [id=7505f67ea24847a6aa9c90955f1596fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.935156 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 792c6d7038624ec29e5e36c0145c64db. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.936764 15370 ts_tablet_manager.cc:1434] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:25.937116 15370 tablet_bootstrap.cc:492] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.938055 14654 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_0f884fc2a3c74502aa6bad6c3a9b49a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.938433 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 3092fd602dc7478693595ffcbc3bcf45 (DEFAULT_TABLE table=default.Table_e96eec11f48049a9b2a4332b23e60a6f [id=de8b64679bcb4ef582d6edd600342a82]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:25.938594 14654 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0f884fc2a3c74502aa6bad6c3a9b49a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.938688 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3092fd602dc7478693595ffcbc3bcf45. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.939774 15370 tablet_bootstrap.cc:654] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.942422 15386 log.cc:1199] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/b1ae9934b0ca403ea026233ecd952a20
I20251025 08:02:25.942708 15386 ts_tablet_manager.cc:1950] T b1ae9934b0ca403ea026233ecd952a20 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.943441 14641 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet b1ae9934b0ca403ea026233ecd952a20 (table default.Table_ddb045f037264e75a3a270929fae8239 [id=f0a305005a5140a19271b7f9ceae8dbb]) successfully deleted
I20251025 08:02:25.944260 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 7b8d94fc010046c7b37804f168471904 (DEFAULT_TABLE table=default.Table_521f904aba4a4b309e9864df54df659d [id=a95abf5644c64177afde71baad186bca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.944478 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b8d94fc010046c7b37804f168471904. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.946395 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 3092fd602dc7478693595ffcbc3bcf45 (DEFAULT_TABLE table=default.Table_e96eec11f48049a9b2a4332b23e60a6f [id=de8b64679bcb4ef582d6edd600342a82]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.946622 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3092fd602dc7478693595ffcbc3bcf45. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.946633 15223 tablet_service.cc:1505] Processing CreateTablet for tablet d2697ee09dc74d35abffc3158410aa5e (DEFAULT_TABLE table=default.Table_541e363972b34e9b9b64f21b771e7ce2 [id=bdcc7cd59c78409fad7b5f687ae81310]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.946853 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2697ee09dc74d35abffc3158410aa5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.948729 15386 tablet_replica.cc:333] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.949018 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet f89313f3d7344132b2fb0fab8941bb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36254
I20251025 08:02:25.949246 15386 raft_consensus.cc:2243] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.949361 15386 raft_consensus.cc:2272] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.949898 15090 tablet_service.cc:1505] Processing CreateTablet for tablet d2697ee09dc74d35abffc3158410aa5e (DEFAULT_TABLE table=default.Table_541e363972b34e9b9b64f21b771e7ce2 [id=bdcc7cd59c78409fad7b5f687ae81310]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.950138 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2697ee09dc74d35abffc3158410aa5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.950462 15372 tablet_bootstrap.cc:492] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.950537 15372 ts_tablet_manager.cc:1403] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.074s user 0.001s sys 0.000s
I20251025 08:02:25.950711 14646 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 071220f7bd334f5aad733209193244d4 (table default.Table_7a87c8dce3c3439db7879b9d642a745f [id=c571a9bdb4d14249a27b401b9c02f644]). Expected version 1 got 0
I20251025 08:02:25.950973 15372 raft_consensus.cc:359] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.951081 15372 raft_consensus.cc:385] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.951113 15372 raft_consensus.cc:740] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.951253 15372 consensus_queue.cc:260] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.951501 15372 ts_tablet_manager.cc:1434] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.951678 15372 tablet_bootstrap.cc:492] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.951781 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 5d25a2805a264574bc20150762c48262 (DEFAULT_TABLE table=default.Table_9a3a6f5c45104e33a5a455d911ce8927 [id=15a38bbafe4045e9991cb846ec9e452c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.952003 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d25a2805a264574bc20150762c48262. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.952196 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 5d25a2805a264574bc20150762c48262 (DEFAULT_TABLE table=default.Table_9a3a6f5c45104e33a5a455d911ce8927 [id=15a38bbafe4045e9991cb846ec9e452c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.952435 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d25a2805a264574bc20150762c48262. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.952931 15372 tablet_bootstrap.cc:654] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.953780 15388 ts_tablet_manager.cc:1929] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:25.953850 15388 log.cc:1199] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/6e5e6d65e6ed4c228e97d7b8c3d63d65
I20251025 08:02:25.954129 15388 ts_tablet_manager.cc:1950] T 6e5e6d65e6ed4c228e97d7b8c3d63d65 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.955036 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 4134d50b613748fd9291ff245047af33 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.955626 15372 tablet_bootstrap.cc:492] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.955700 15372 ts_tablet_manager.cc:1403] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:25.956094 15372 raft_consensus.cc:359] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.956185 15372 raft_consensus.cc:385] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.956248 15372 raft_consensus.cc:740] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.956362 15372 consensus_queue.cc:260] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.956600 15372 ts_tablet_manager.cc:1434] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.956746 15372 tablet_bootstrap.cc:492] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.957548 15372 tablet_bootstrap.cc:654] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.958376 15497 raft_consensus.cc:493] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.958464 15497 raft_consensus.cc:515] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.958787 15497 leader_election.cc:290] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.959317 14653 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_89703a34a83e4da8973b625249c4a03d" } modify_external_catalogs: true
I20251025 08:02:25.959416 14653 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_89703a34a83e4da8973b625249c4a03d" } modify_external_catalogs: true
I20251025 08:02:25.959688 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcb5f7e52507450c8a6f5a99a9927974" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:25.960006 15049 leader_election.cc:343] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.960160 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcb5f7e52507450c8a6f5a99a9927974" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.960188 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 5d25a2805a264574bc20150762c48262 (DEFAULT_TABLE table=default.Table_9a3a6f5c45104e33a5a455d911ce8927 [id=15a38bbafe4045e9991cb846ec9e452c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:25.960430 14952 tablet_service.cc:1505] Processing CreateTablet for tablet d2697ee09dc74d35abffc3158410aa5e (DEFAULT_TABLE table=default.Table_541e363972b34e9b9b64f21b771e7ce2 [id=bdcc7cd59c78409fad7b5f687ae81310]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:25.960584 15048 leader_election.cc:343] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.960660 15048 leader_election.cc:304] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.960786 15497 raft_consensus.cc:2749] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.960927 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d25a2805a264574bc20150762c48262. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.962113 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2697ee09dc74d35abffc3158410aa5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:25.962473 15436 tablet.cc:1722] T 5b49d48b94b0427aa2dcc39dae45a4eb P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.963835 14648 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:59180:
table { table_name: "default.Table_9a3a6f5c45104e33a5a455d911ce8927" } new_table_name: "default.Table_4a9fc326b302473f86d8d3f7e7b8040f" modify_external_catalogs: true
I20251025 08:02:25.963886 14652 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_acf14806991f4da89dc9bb3361537133"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.964646 14649 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_c93b71eeb33d4dcc9501dd2efdde7556"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:25.965152 15409 raft_consensus.cc:493] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.965243 15409 raft_consensus.cc:515] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.965579 15409 leader_election.cc:290] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.966238 15497 raft_consensus.cc:493] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.966305 15497 raft_consensus.cc:515] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.966591 15497 leader_election.cc:290] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:25.966739 15409 raft_consensus.cc:493] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.966820 15409 raft_consensus.cc:515] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.967114 15409 leader_election.cc:290] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:25.967249 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72ff369b973b4c5981ea0810e37e8562" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.967343 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72ff369b973b4c5981ea0810e37e8562" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:25.967597 15185 leader_election.cc:343] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 3eee1563ce444900a96f9f363e92e7ff
W20251025 08:02:25.967931 15185 leader_election.cc:343] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: c1a10ef5ab73459695e1ef772e3a5266
W20251025 08:02:25.968053 15049 leader_election.cc:343] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:25.968365 15048 leader_election.cc:343] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.968432 15048 leader_election.cc:304] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.968663 15497 raft_consensus.cc:2749] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:25.970892 15183 leader_election.cc:343] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: c1a10ef5ab73459695e1ef772e3a5266
I20251025 08:02:25.970968 15183 leader_election.cc:304] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
W20251025 08:02:25.972159 15183 leader_election.cc:343] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 3eee1563ce444900a96f9f363e92e7ff
I20251025 08:02:25.972220 15183 leader_election.cc:304] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:25.972338 15909 raft_consensus.cc:2749] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.972440 15909 raft_consensus.cc:2749] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.972599 15388 tablet_replica.cc:333] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.972882 15372 tablet_bootstrap.cc:492] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.972954 15372 ts_tablet_manager.cc:1403] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
W20251025 08:02:25.972976 14648 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5d25a2805a264574bc20150762c48262 consensus state has no leader
I20251025 08:02:25.973273 15388 raft_consensus.cc:2243] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.973810 15370 tablet_bootstrap.cc:492] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.973882 15370 ts_tablet_manager.cc:1403] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.037s user 0.001s sys 0.000s
I20251025 08:02:25.971951 14642 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 6e5e6d65e6ed4c228e97d7b8c3d63d65 (table default.Table_2f4e7934dc164dcdadd6467e1afc563a [id=4f1a1f84f436411db166b8c28873a27b]) successfully deleted
W20251025 08:02:25.974565 14652 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acf14806991f4da89dc9bb3361537133 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:25.974809 15945 consensus_queue.cc:1175] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" status { last_received { term: 1 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 1 index: 2 } }
I20251025 08:02:25.975095 15370 raft_consensus.cc:359] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.975184 15370 raft_consensus.cc:385] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.975214 15370 raft_consensus.cc:740] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.975176 15451 tablet.cc:1722] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.975308 15370 consensus_queue.cc:260] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.975556 15370 ts_tablet_manager.cc:1434] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:25.975728 15370 tablet_bootstrap.cc:492] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:25.975935 14649 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.976661 15370 tablet_bootstrap.cc:654] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.977664 15436 tablet.cc:1722] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:25.978062 14651 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59180:
name: "default.Table_891766baabb34ace9d4695004f20f425"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:25.978511 14651 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_891766baabb34ace9d4695004f20f425 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:25.973923 15388 raft_consensus.cc:2272] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.981218 14616 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu with pid 14624
I20251025 08:02:25.982595 15388 ts_tablet_manager.cc:1916] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.978062 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 56263217eaaf4bb9a48a822061ddb369 with delete_type TABLET_DATA_DELETED (replaced by tablet a8393462039d4bb4aba66aee9e90b94a) from {username='slave'} at 127.0.0.1:36846
I20251025 08:02:25.985551 15388 ts_tablet_manager.cc:1929] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.973436 15372 raft_consensus.cc:359] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.985827 15388 log.cc:1199] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/06b3cc87826249ccb1f84c29df09f802
I20251025 08:02:25.985837 15372 raft_consensus.cc:385] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.985896 15372 raft_consensus.cc:740] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.986009 15372 consensus_queue.cc:260] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.986282 15388 ts_tablet_manager.cc:1950] T 06b3cc87826249ccb1f84c29df09f802 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:25.986284 15372 ts_tablet_manager.cc:1434] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20251025 08:02:25.986415 15372 tablet_bootstrap.cc:492] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:25.987017 15388 tablet_replica.cc:333] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:25.987277 15372 tablet_bootstrap.cc:654] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.987280 15497 raft_consensus.cc:493] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.987362 15497 raft_consensus.cc:515] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.987640 15497 leader_election.cc:290] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:25.987282 15388 raft_consensus.cc:2243] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.988132 15388 raft_consensus.cc:2272] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.988180 15370 tablet_bootstrap.cc:492] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.988180 15372 tablet_bootstrap.cc:492] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:25.988274 15372 ts_tablet_manager.cc:1403] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:25.988281 15370 ts_tablet_manager.cc:1403] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20251025 08:02:25.988407 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f89313f3d7344132b2fb0fab8941bb3e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:25.988703 15370 raft_consensus.cc:359] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.988787 15370 raft_consensus.cc:385] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.988816 15370 raft_consensus.cc:740] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.988924 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f89313f3d7344132b2fb0fab8941bb3e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:25.988922 15370 consensus_queue.cc:260] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.989164 15370 ts_tablet_manager.cc:1434] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.989336 15370 tablet_bootstrap.cc:492] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:25.989512 15048 leader_election.cc:343] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.990221 15370 tablet_bootstrap.cc:654] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.990790 15369 tablet_bootstrap.cc:492] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:25.990857 15369 ts_tablet_manager.cc:1403] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.126s user 0.002s sys 0.000s
W20251025 08:02:25.991115 15049 leader_election.cc:343] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:25.991179 15049 leader_election.cc:304] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:25.991227 15369 raft_consensus.cc:359] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.991302 15369 raft_consensus.cc:385] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.991328 15369 raft_consensus.cc:740] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.991420 15369 consensus_queue.cc:260] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.991642 15369 ts_tablet_manager.cc:1434] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.991771 15369 tablet_bootstrap.cc:492] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:25.991782 15497 raft_consensus.cc:2749] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:25.992167 15370 tablet_bootstrap.cc:492] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.992261 15370 ts_tablet_manager.cc:1403] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:25.992563 15369 tablet_bootstrap.cc:654] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.992623 15370 raft_consensus.cc:359] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.992702 15370 raft_consensus.cc:385] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.992729 15370 raft_consensus.cc:740] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.992888 15370 consensus_queue.cc:260] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.993223 15370 ts_tablet_manager.cc:1434] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:25.993376 15370 tablet_bootstrap.cc:492] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.994464 15370 tablet_bootstrap.cc:654] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:25.990178 15386 ts_tablet_manager.cc:1916] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.995401 15388 ts_tablet_manager.cc:1916] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.996711 15386 ts_tablet_manager.cc:1929] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:25.996775 15386 log.cc:1199] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/06b3cc87826249ccb1f84c29df09f802
I20251025 08:02:25.996982 15386 ts_tablet_manager.cc:1950] T 06b3cc87826249ccb1f84c29df09f802 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:25.997089 15388 ts_tablet_manager.cc:1929] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:25.997146 15388 log.cc:1199] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/ff82c6ab12c844339dd387569fb85526
I20251025 08:02:25.997319 15370 tablet_bootstrap.cc:492] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:25.997397 15370 ts_tablet_manager.cc:1403] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:25.997423 15386 tablet_replica.cc:333] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:25.997514 15386 raft_consensus.cc:2243] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:25.997579 15386 raft_consensus.cc:2272] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:25.997759 15370 raft_consensus.cc:359] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.997851 15370 raft_consensus.cc:385] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:25.997881 15370 raft_consensus.cc:740] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:25.997993 15386 ts_tablet_manager.cc:1916] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:25.998667 15370 consensus_queue.cc:260] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:25.999297 15370 ts_tablet_manager.cc:1434] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:25.999526 15370 tablet_bootstrap.cc:492] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:25.999580 15374 raft_consensus.cc:493] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:25.999639 15374 raft_consensus.cc:515] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:25.999936 15374 leader_election.cc:290] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.000211 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76a906654cc44bfb96d9e1a936040e57" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.000331 15111 raft_consensus.cc:2468] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:25.989241 15372 raft_consensus.cc:359] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.000481 15372 raft_consensus.cc:385] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.000514 15372 raft_consensus.cc:740] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.000630 15372 consensus_queue.cc:260] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.001058 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76a906654cc44bfb96d9e1a936040e57" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.001087 15386 ts_tablet_manager.cc:1929] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:26.001168 15386 log.cc:1199] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/834a6c675ac54dbdb5416c683384d96e
W20251025 08:02:26.001420 14914 leader_election.cc:343] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.001507 14915 leader_election.cc:304] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.001663 15864 raft_consensus.cc:2804] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.001721 15864 raft_consensus.cc:493] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.001766 15864 raft_consensus.cc:3060] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.002166 15372 ts_tablet_manager.cc:1434] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20251025 08:02:26.002671 15370 tablet_bootstrap.cc:654] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.002825 15864 raft_consensus.cc:515] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.003177 15372 tablet_bootstrap.cc:492] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.003197 15864 leader_election.cc:290] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.003440 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76a906654cc44bfb96d9e1a936040e57" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.003530 15111 raft_consensus.cc:3060] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.003778 15386 ts_tablet_manager.cc:1950] T 834a6c675ac54dbdb5416c683384d96e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:26.004206 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76a906654cc44bfb96d9e1a936040e57" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:26.004467 14914 leader_election.cc:343] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.004508 15372 tablet_bootstrap.cc:654] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.004375 15386 tablet_replica.cc:333] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:26.004572 15111 raft_consensus.cc:2468] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.004760 15386 raft_consensus.cc:2243] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:26.004863 14915 leader_election.cc:304] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.005007 15864 raft_consensus.cc:2804] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.005091 15864 raft_consensus.cc:697] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.005204 15864 consensus_queue.cc:237] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.005668 15369 tablet_bootstrap.cc:492] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.005728 15369 ts_tablet_manager.cc:1403] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20251025 08:02:26.006060 15369 raft_consensus.cc:359] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.006130 15369 raft_consensus.cc:385] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.006155 15369 raft_consensus.cc:740] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.006284 15369 consensus_queue.cc:260] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.006501 15369 ts_tablet_manager.cc:1434] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:26.006628 15369 tablet_bootstrap.cc:492] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.004905 15386 raft_consensus.cc:2272] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:26.005744 15372 tablet_bootstrap.cc:492] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.007076 15372 ts_tablet_manager.cc:1403] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20251025 08:02:26.007227 15386 ts_tablet_manager.cc:1916] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:26.007628 15369 tablet_bootstrap.cc:654] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.007607 15372 raft_consensus.cc:359] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.007684 15372 raft_consensus.cc:385] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.007720 15372 raft_consensus.cc:740] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.007817 15372 consensus_queue.cc:260] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.008559 15372 ts_tablet_manager.cc:1434] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:26.008744 15372 tablet_bootstrap.cc:492] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.009076 15386 ts_tablet_manager.cc:1929] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:26.009135 15386 log.cc:1199] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/a12f1428ccda4cef8c00a34630f2e54e
I20251025 08:02:26.009351 15386 ts_tablet_manager.cc:1950] T a12f1428ccda4cef8c00a34630f2e54e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:26.009605 15372 tablet_bootstrap.cc:654] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.009873 15386 tablet_replica.cc:333] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:26.010012 15386 raft_consensus.cc:2243] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:26.010259 15386 raft_consensus.cc:2272] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:26.010623 15386 ts_tablet_manager.cc:1916] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:26.013890 15386 ts_tablet_manager.cc:1929] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:26.013993 15386 log.cc:1199] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/c1a10ef5ab73459695e1ef772e3a5266
I20251025 08:02:26.014256 15386 ts_tablet_manager.cc:1950] T c1a10ef5ab73459695e1ef772e3a5266 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:26.014803 15386 tablet_replica.cc:333] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:26.014927 15386 raft_consensus.cc:2243] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:26.015007 15386 raft_consensus.cc:2272] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:26.015328 15386 ts_tablet_manager.cc:1916] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:26.016832 15386 ts_tablet_manager.cc:1929] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:26.016932 15386 log.cc:1199] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/3eee1563ce444900a96f9f363e92e7ff
I20251025 08:02:25.997329 15388 ts_tablet_manager.cc:1950] T ff82c6ab12c844339dd387569fb85526 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:26.017305 15386 ts_tablet_manager.cc:1950] T 3eee1563ce444900a96f9f363e92e7ff P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:26.017738 15386 tablet_replica.cc:333] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:26.017872 15386 raft_consensus.cc:2243] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:26.017968 15386 raft_consensus.cc:2272] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:26.018316 15386 ts_tablet_manager.cc:1916] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:26.018680 15370 tablet_bootstrap.cc:492] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.018766 15370 ts_tablet_manager.cc:1403] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.000s
I20251025 08:02:26.019366 15370 raft_consensus.cc:359] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.019474 15370 raft_consensus.cc:385] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.019511 15370 raft_consensus.cc:740] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.019629 15370 consensus_queue.cc:260] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.019932 15370 ts_tablet_manager.cc:1434] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.020371 15386 ts_tablet_manager.cc:1929] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:26.020442 15386 log.cc:1199] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/4134d50b613748fd9291ff245047af33
I20251025 08:02:26.020650 15386 ts_tablet_manager.cc:1950] T 4134d50b613748fd9291ff245047af33 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:26.021109 15386 tablet_replica.cc:333] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:26.021274 15386 raft_consensus.cc:2243] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:26.021415 15386 raft_consensus.cc:2272] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:26.021775 15386 ts_tablet_manager.cc:1916] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:26.022539 15372 tablet_bootstrap.cc:492] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.022622 15372 ts_tablet_manager.cc:1403] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.001s
I20251025 08:02:26.023181 15372 raft_consensus.cc:359] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:26.023231 15493 connection.cc:537] server connection from 127.0.0.1:41864 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251025 08:02:26.023268 15372 raft_consensus.cc:385] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.023300 15372 raft_consensus.cc:740] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
W20251025 08:02:26.023470 15183 connection.cc:537] server connection from 127.0.0.1:36846 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251025 08:02:26.023497 15388 tablet_replica.cc:333] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:26.023494 15372 consensus_queue.cc:260] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.023602 15388 raft_consensus.cc:2243] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:26.023689 15388 raft_consensus.cc:2272] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:26.024147 15370 tablet_bootstrap.cc:492] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.024243 15372 ts_tablet_manager.cc:1434] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.024402 15372 tablet_bootstrap.cc:492] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.024581 15386 ts_tablet_manager.cc:1929] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:26.024631 15386 log.cc:1199] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/56263217eaaf4bb9a48a822061ddb369
I20251025 08:02:26.024991 15370 tablet_bootstrap.cc:654] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.025079 15369 tablet_bootstrap.cc:492] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.025138 15369 ts_tablet_manager.cc:1403] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.001s
W20251025 08:02:26.025477 15303 connection.cc:537] client connection to 127.14.70.62:39499 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251025 08:02:26.025475 15369 raft_consensus.cc:359] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.025560 15369 raft_consensus.cc:385] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.025599 15369 raft_consensus.cc:740] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.025705 15369 consensus_queue.cc:260] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:26.025856 15303 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.14.70.62:39499)
I20251025 08:02:26.025928 15369 ts_tablet_manager.cc:1434] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20251025 08:02:26.026019 15303 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.14.70.62:39499)
I20251025 08:02:26.026132 15369 tablet_bootstrap.cc:492] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:26.026141 15303 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.14.70.62:39499)
W20251025 08:02:26.026252 15303 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.14.70.62:39499)
I20251025 08:02:26.027979 15369 tablet_bootstrap.cc:654] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.028590 15388 ts_tablet_manager.cc:1916] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:26.026093 15372 tablet_bootstrap.cc:654] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.024803 15386 ts_tablet_manager.cc:1950] T 56263217eaaf4bb9a48a822061ddb369 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:26.030503 15388 ts_tablet_manager.cc:1929] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:26.030565 15388 log.cc:1199] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/e54e57e850564e079db3dd383347ed30
I20251025 08:02:26.030685 15369 tablet_bootstrap.cc:492] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.030751 15369 ts_tablet_manager.cc:1403] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
W20251025 08:02:26.030857 15183 connection.cc:441] server connection from 127.0.0.1:36846 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:36846 (request call id 295) could send its response
I20251025 08:02:26.031111 15369 raft_consensus.cc:359] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.031194 15369 raft_consensus.cc:385] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.031234 15369 raft_consensus.cc:740] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.031333 15369 consensus_queue.cc:260] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.031594 15369 ts_tablet_manager.cc:1434] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.031582 15497 raft_consensus.cc:493] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.031682 15388 ts_tablet_manager.cc:1950] T e54e57e850564e079db3dd383347ed30 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:26.031654 15497 raft_consensus.cc:515] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.031740 15369 tablet_bootstrap.cc:492] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.031914 15388 tablet_replica.cc:333] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:26.031955 15497 leader_election.cc:290] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.032025 15388 raft_consensus.cc:2243] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:26.032102 15388 raft_consensus.cc:2272] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:26.032567 15369 tablet_bootstrap.cc:654] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.032580 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ae3f4cdb1b14d1abe884c4a0628a6ec" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.032624 15388 ts_tablet_manager.cc:1916] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:26.033735 15049 leader_election.cc:343] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.033907 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ae3f4cdb1b14d1abe884c4a0628a6ec" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:26.034737 15048 leader_election.cc:343] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.034798 15048 leader_election.cc:304] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.035230 15370 tablet_bootstrap.cc:492] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.035310 15370 ts_tablet_manager.cc:1403] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20251025 08:02:26.035437 15497 raft_consensus.cc:2749] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.035701 15370 raft_consensus.cc:359] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.035787 15370 raft_consensus.cc:385] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.035818 15370 raft_consensus.cc:740] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.035926 15370 consensus_queue.cc:260] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.036194 15370 ts_tablet_manager.cc:1434] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.036392 15370 tablet_bootstrap.cc:492] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:26.036501 15048 connection.cc:537] client connection to 127.14.70.62:39499 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251025 08:02:26.036398 15388 ts_tablet_manager.cc:1929] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:26.036700 15388 log.cc:1199] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/f89313f3d7344132b2fb0fab8941bb3e
W20251025 08:02:26.037135 15183 connection.cc:537] client connection to 127.14.70.62:39499 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251025 08:02:26.038138 15388 ts_tablet_manager.cc:1950] T f89313f3d7344132b2fb0fab8941bb3e P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:26.038239 15370 tablet_bootstrap.cc:654] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:26.038787 14915 connection.cc:537] server connection from 127.0.0.1:37198 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251025 08:02:26.039573 14711 connection.cc:537] server connection from 127.0.0.1:35676 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251025 08:02:26.039729 15048 connection.cc:537] server connection from 127.0.0.1:36254 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251025 08:02:26.040745 15369 tablet_bootstrap.cc:492] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.040825 15369 ts_tablet_manager.cc:1403] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
W20251025 08:02:26.040908 15971 negotiation.cc:337] Failed RPC negotiation. Trace:
1025 08:02:26.036997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.70.62:39499 (local address 127.14.70.2:49539)
1025 08:02:26.037189 (+ 192us) negotiation.cc:107] Waiting for socket to connect
1025 08:02:26.037203 (+ 14us) client_negotiation.cc:174] Beginning negotiation
1025 08:02:26.037335 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1025 08:02:26.040405 (+ 3070us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.70.62:39499: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":56,"threads_started":1}
I20251025 08:02:26.041237 15369 raft_consensus.cc:359] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.041338 15369 raft_consensus.cc:385] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.041374 15369 raft_consensus.cc:740] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.041478 15369 consensus_queue.cc:260] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.041728 15369 ts_tablet_manager.cc:1434] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20251025 08:02:26.041715 15965 negotiation.cc:337] Failed RPC negotiation. Trace:
1025 08:02:26.026782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.70.62:39499 (local address 127.0.0.1:39144)
1025 08:02:26.040579 (+ 13797us) negotiation.cc:107] Waiting for socket to connect
1025 08:02:26.040623 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.70.62:39499: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":13741,"thread_start_us":69,"threads_started":1}
I20251025 08:02:26.041908 15369 tablet_bootstrap.cc:492] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:26.042279 15974 negotiation.cc:337] Failed RPC negotiation. Trace:
1025 08:02:26.039194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.70.62:39499 (local address 127.14.70.1:42927)
1025 08:02:26.041396 (+ 2202us) negotiation.cc:107] Waiting for socket to connect
1025 08:02:26.041447 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.70.62:39499: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":2123,"thread_start_us":89,"threads_started":1}
W20251025 08:02:26.042747 15972 negotiation.cc:337] Failed RPC negotiation. Trace:
1025 08:02:26.037612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.70.62:39499 (local address 127.14.70.3:36133)
1025 08:02:26.037782 (+ 170us) negotiation.cc:107] Waiting for socket to connect
1025 08:02:26.037796 (+ 14us) client_negotiation.cc:174] Beginning negotiation
1025 08:02:26.037881 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
1025 08:02:26.040092 (+ 2211us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.70.62:39499: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":53,"threads_started":1}
I20251025 08:02:26.043474 15497 raft_consensus.cc:493] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.043573 15497 raft_consensus.cc:515] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.043931 15497 leader_election.cc:290] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.044183 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43da3f4fc9604562a95dff59da3c574b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.044299 14976 raft_consensus.cc:2468] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.044550 15369 tablet_bootstrap.cc:654] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.044565 15048 leader_election.cc:304] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.044903 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43da3f4fc9604562a95dff59da3c574b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.045115 15497 raft_consensus.cc:2804] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.045172 15497 raft_consensus.cc:493] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.045226 15497 raft_consensus.cc:3060] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.045571 15369 tablet_bootstrap.cc:492] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.045643 15369 ts_tablet_manager.cc:1403] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:26.045850 15497 raft_consensus.cc:515] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.045998 15369 raft_consensus.cc:359] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.046073 15369 raft_consensus.cc:385] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.046110 15369 raft_consensus.cc:740] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.046129 15497 leader_election.cc:290] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.046268 15369 consensus_queue.cc:260] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:26.046403 15049 leader_election.cc:343] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.046510 15369 ts_tablet_manager.cc:1434] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.046594 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43da3f4fc9604562a95dff59da3c574b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.046677 15369 tablet_bootstrap.cc:492] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:26.047151 15049 leader_election.cc:343] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.047302 15409 raft_consensus.cc:493] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.047369 15409 raft_consensus.cc:515] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.047511 15369 tablet_bootstrap.cc:654] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.047713 15409 leader_election.cc:290] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.048067 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3743a9de419d40689c49aae471edfa01" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.048226 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43da3f4fc9604562a95dff59da3c574b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.048321 14976 raft_consensus.cc:3060] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.048365 15372 tablet_bootstrap.cc:492] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.048422 15369 tablet_bootstrap.cc:492] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.048435 15372 ts_tablet_manager.cc:1403] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20251025 08:02:26.048480 15369 ts_tablet_manager.cc:1403] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.048828 15369 raft_consensus.cc:359] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.048828 15372 raft_consensus.cc:359] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.048908 15372 raft_consensus.cc:385] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.048908 15369 raft_consensus.cc:385] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.048938 15372 raft_consensus.cc:740] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.049041 15372 consensus_queue.cc:260] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.049258 14976 raft_consensus.cc:2468] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.049276 15372 ts_tablet_manager.cc:1434] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.049417 15372 tablet_bootstrap.cc:492] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.049425 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3743a9de419d40689c49aae471edfa01" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.049523 14977 raft_consensus.cc:2393] T 3743a9de419d40689c49aae471edfa01 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:26.048949 15369 raft_consensus.cc:740] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.049630 15369 consensus_queue.cc:260] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.050041 15369 ts_tablet_manager.cc:1434] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.050235 15369 tablet_bootstrap.cc:492] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.050300 15372 tablet_bootstrap.cc:654] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.050742 15497 raft_consensus.cc:493] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.050818 15497 raft_consensus.cc:515] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.051167 15497 leader_election.cc:290] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.051231 15369 tablet_bootstrap.cc:654] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.051533 15372 tablet_bootstrap.cc:492] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.051617 15372 ts_tablet_manager.cc:1403] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20251025 08:02:26.051985 15183 leader_election.cc:304] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.052073 15372 raft_consensus.cc:359] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.052174 15372 raft_consensus.cc:385] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.052187 15369 tablet_bootstrap.cc:492] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.052203 15372 raft_consensus.cc:740] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.052273 15369 ts_tablet_manager.cc:1403] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.052405 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8393462039d4bb4aba66aee9e90b94a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.052438 15048 leader_election.cc:304] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.052495 14977 raft_consensus.cc:2468] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.052657 15372 consensus_queue.cc:260] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.052702 15369 raft_consensus.cc:359] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.052795 15369 raft_consensus.cc:385] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.052826 15369 raft_consensus.cc:740] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.052842 15909 raft_consensus.cc:3060] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.052930 15369 consensus_queue.cc:260] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.052994 15497 raft_consensus.cc:2804] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.053067 15497 raft_consensus.cc:697] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.053085 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8393462039d4bb4aba66aee9e90b94a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.053189 15369 ts_tablet_manager.cc:1434] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.053169 15497 consensus_queue.cc:237] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.053332 15369 tablet_bootstrap.cc:492] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.053771 15909 raft_consensus.cc:2749] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.054352 15372 ts_tablet_manager.cc:1434] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20251025 08:02:26.054426 15048 leader_election.cc:304] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.054574 15380 raft_consensus.cc:2804] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.054625 15380 raft_consensus.cc:493] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.054675 15380 raft_consensus.cc:3060] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.054652 15372 tablet_bootstrap.cc:492] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.055518 15380 raft_consensus.cc:515] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.055593 15372 tablet_bootstrap.cc:654] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.055828 15380 leader_election.cc:290] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.056805 15369 tablet_bootstrap.cc:654] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.056928 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8393462039d4bb4aba66aee9e90b94a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.057026 14977 raft_consensus.cc:3060] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.057811 14977 raft_consensus.cc:2468] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.058053 15048 leader_election.cc:304] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.058288 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8393462039d4bb4aba66aee9e90b94a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:26.058382 15049 leader_election.cc:343] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.058527 15380 raft_consensus.cc:2804] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.058614 15380 raft_consensus.cc:697] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.058722 15380 consensus_queue.cc:237] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.059485 15372 tablet_bootstrap.cc:492] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.059546 15372 ts_tablet_manager.cc:1403] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251025 08:02:26.059903 15372 raft_consensus.cc:359] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.059994 15372 raft_consensus.cc:385] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.060025 15372 raft_consensus.cc:740] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.060139 15372 consensus_queue.cc:260] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.060379 15372 ts_tablet_manager.cc:1434] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.060421 15864 raft_consensus.cc:493] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.060520 15372 tablet_bootstrap.cc:492] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
W20251025 08:02:26.060498 15049 leader_election.cc:343] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.060488 15864 raft_consensus.cc:515] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.060825 15864 leader_election.cc:290] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.061368 15372 tablet_bootstrap.cc:654] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.061545 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "422e2c32a18a4e1ea9a5e371da17dfea" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:26.061818 14914 leader_election.cc:343] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.062772 15372 tablet_bootstrap.cc:492] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.062837 15372 ts_tablet_manager.cc:1403] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.063225 15372 raft_consensus.cc:359] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.063306 15372 raft_consensus.cc:385] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.063338 15372 raft_consensus.cc:740] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.063418 15369 tablet_bootstrap.cc:492] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.063437 15372 consensus_queue.cc:260] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.063495 15369 ts_tablet_manager.cc:1403] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:26.063553 15370 tablet_bootstrap.cc:492] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.063622 15370 ts_tablet_manager.cc:1403] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.001s
I20251025 08:02:26.063659 15372 ts_tablet_manager.cc:1434] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.063791 15372 tablet_bootstrap.cc:492] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.063867 15369 raft_consensus.cc:359] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.063959 15369 raft_consensus.cc:385] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.063993 15369 raft_consensus.cc:740] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.063959 15370 raft_consensus.cc:359] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.064035 15370 raft_consensus.cc:385] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.064065 15370 raft_consensus.cc:740] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.064108 15369 consensus_queue.cc:260] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.064154 15370 consensus_queue.cc:260] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.064395 15370 ts_tablet_manager.cc:1434] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:26.064538 15370 tablet_bootstrap.cc:492] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.064579 15372 tablet_bootstrap.cc:654] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.065430 15370 tablet_bootstrap.cc:654] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.066550 15369 ts_tablet_manager.cc:1434] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:26.066627 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "422e2c32a18a4e1ea9a5e371da17dfea" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.066706 15369 tablet_bootstrap.cc:492] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.066736 15111 raft_consensus.cc:2468] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.066929 15370 tablet_bootstrap.cc:492] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.067005 15370 ts_tablet_manager.cc:1403] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251025 08:02:26.067402 15370 raft_consensus.cc:359] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.067492 15370 raft_consensus.cc:385] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.067526 15370 raft_consensus.cc:740] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.067625 15370 consensus_queue.cc:260] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.067831 15369 tablet_bootstrap.cc:654] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.067821 15642 raft_consensus.cc:493] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.067859 15370 ts_tablet_manager.cc:1434] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.067881 15642 raft_consensus.cc:515] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.067988 15370 tablet_bootstrap.cc:492] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.068148 15642 leader_election.cc:290] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.068328 14915 leader_election.cc:304] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.068459 15864 raft_consensus.cc:2804] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.068506 15864 raft_consensus.cc:493] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.068552 15864 raft_consensus.cc:3060] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.068991 15370 tablet_bootstrap.cc:654] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.069396 15864 raft_consensus.cc:515] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.069691 15864 leader_election.cc:290] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.069929 15372 tablet_bootstrap.cc:492] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.070021 15372 ts_tablet_manager.cc:1403] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:26.070317 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0310efe286dd409ab857a92daa6ff99f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.070420 15372 raft_consensus.cc:359] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.070523 15372 raft_consensus.cc:385] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.070521 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "422e2c32a18a4e1ea9a5e371da17dfea" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.070554 15372 raft_consensus.cc:740] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.070600 15111 raft_consensus.cc:3060] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.070609 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "422e2c32a18a4e1ea9a5e371da17dfea" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.070663 15372 consensus_queue.cc:260] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.070899 15372 ts_tablet_manager.cc:1434] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.071023 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0310efe286dd409ab857a92daa6ff99f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:26.071043 14914 leader_election.cc:343] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.071413 15111 raft_consensus.cc:2468] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
W20251025 08:02:26.071457 15049 leader_election.cc:343] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:26.071914 15048 leader_election.cc:343] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.072016 15048 leader_election.cc:304] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.072187 14915 leader_election.cc:304] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.072273 15380 raft_consensus.cc:2749] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.072337 15864 raft_consensus.cc:2804] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.072405 15864 raft_consensus.cc:697] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.072530 15372 tablet_bootstrap.cc:492] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.072517 15864 consensus_queue.cc:237] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.073187 15370 tablet_bootstrap.cc:492] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.073264 15370 ts_tablet_manager.cc:1403] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:26.073350 15372 tablet_bootstrap.cc:654] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.073616 15370 raft_consensus.cc:359] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.073702 15370 raft_consensus.cc:385] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.073729 15370 raft_consensus.cc:740] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.073815 15370 consensus_queue.cc:260] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.074327 15370 ts_tablet_manager.cc:1434] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.074476 15370 tablet_bootstrap.cc:492] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.075071 15372 tablet_bootstrap.cc:492] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.075137 15372 ts_tablet_manager.cc:1403] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:26.075320 15370 tablet_bootstrap.cc:654] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.075515 15372 raft_consensus.cc:359] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.075610 15372 raft_consensus.cc:385] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.075639 15372 raft_consensus.cc:740] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.075734 15372 consensus_queue.cc:260] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.076017 15372 ts_tablet_manager.cc:1434] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.076181 15372 tablet_bootstrap.cc:492] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.077144 15372 tablet_bootstrap.cc:654] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.078958 15372 tablet_bootstrap.cc:492] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.079046 15372 ts_tablet_manager.cc:1403] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:26.079414 15372 raft_consensus.cc:359] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.079505 15372 raft_consensus.cc:385] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.079535 15372 raft_consensus.cc:740] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.079612 15372 consensus_queue.cc:260] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.079818 15372 ts_tablet_manager.cc:1434] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.079947 15372 tablet_bootstrap.cc:492] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.080767 15372 tablet_bootstrap.cc:654] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.082551 15372 tablet_bootstrap.cc:492] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.082631 15372 ts_tablet_manager.cc:1403] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:26.083017 15372 raft_consensus.cc:359] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.083112 15372 raft_consensus.cc:385] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.083148 15372 raft_consensus.cc:740] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.083261 15372 consensus_queue.cc:260] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.083508 15372 ts_tablet_manager.cc:1434] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.083664 15372 tablet_bootstrap.cc:492] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.084314 15370 tablet_bootstrap.cc:492] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.084381 15370 ts_tablet_manager.cc:1403] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:26.084519 15372 tablet_bootstrap.cc:654] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.084671 15370 raft_consensus.cc:359] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.084734 15370 raft_consensus.cc:385] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.084759 15370 raft_consensus.cc:740] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.084869 15370 consensus_queue.cc:260] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.085134 15370 ts_tablet_manager.cc:1434] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.085291 15370 tablet_bootstrap.cc:492] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.086422 15372 tablet_bootstrap.cc:492] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.086539 15372 ts_tablet_manager.cc:1403] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20251025 08:02:26.086593 15380 raft_consensus.cc:493] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.086666 15380 raft_consensus.cc:515] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.086941 15380 leader_election.cc:290] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.086930 15372 raft_consensus.cc:359] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.087021 15372 raft_consensus.cc:385] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.087050 15372 raft_consensus.cc:740] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.087503 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9cd745bd3e42e98b0ae1d145007bee" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.087517 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9cd745bd3e42e98b0ae1d145007bee" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.087594 14977 raft_consensus.cc:2468] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.087141 15372 consensus_queue.cc:260] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.087880 15048 leader_election.cc:304] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.088079 15380 raft_consensus.cc:2804] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.088132 15380 raft_consensus.cc:493] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251025 08:02:26.088161 15049 leader_election.cc:343] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.088168 15380 raft_consensus.cc:3060] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.088578 15369 tablet_bootstrap.cc:492] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.088639 15369 ts_tablet_manager.cc:1403] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20251025 08:02:26.089082 15372 ts_tablet_manager.cc:1434] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:26.089038 15369 raft_consensus.cc:359] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.089133 15369 raft_consensus.cc:385] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.089131 15380 raft_consensus.cc:515] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.089164 15369 raft_consensus.cc:740] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.089268 15369 consensus_queue.cc:260] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.089421 15380 leader_election.cc:290] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.089505 15369 ts_tablet_manager.cc:1434] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.089675 15369 tablet_bootstrap.cc:492] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.089234 15372 tablet_bootstrap.cc:492] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.090564 15369 tablet_bootstrap.cc:654] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.091001 15372 tablet_bootstrap.cc:654] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.091794 15370 tablet_bootstrap.cc:654] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.092720 15372 tablet_bootstrap.cc:492] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.092897 15372 ts_tablet_manager.cc:1403] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20251025 08:02:26.093222 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9cd745bd3e42e98b0ae1d145007bee" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:26.093483 15049 leader_election.cc:343] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.093748 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9cd745bd3e42e98b0ae1d145007bee" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.093767 15372 raft_consensus.cc:359] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.093854 14977 raft_consensus.cc:3060] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.093864 15372 raft_consensus.cc:385] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.093896 15372 raft_consensus.cc:740] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.094066 15372 consensus_queue.cc:260] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.094424 15372 ts_tablet_manager.cc:1434] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.095029 14977 raft_consensus.cc:2468] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.095299 15372 tablet_bootstrap.cc:492] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.096143 15048 leader_election.cc:304] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.096201 15372 tablet_bootstrap.cc:654] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.096292 15380 raft_consensus.cc:2804] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.096360 15380 raft_consensus.cc:697] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.096460 15380 consensus_queue.cc:237] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.098696 15372 tablet_bootstrap.cc:492] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.098917 15372 ts_tablet_manager.cc:1403] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:26.099457 15372 raft_consensus.cc:359] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.099593 15372 raft_consensus.cc:385] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.099671 15372 raft_consensus.cc:740] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.096222 15369 tablet_bootstrap.cc:492] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.099884 15369 ts_tablet_manager.cc:1403] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20251025 08:02:26.100042 15372 consensus_queue.cc:260] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.100244 15369 raft_consensus.cc:359] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.100327 15372 ts_tablet_manager.cc:1434] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.100339 15369 raft_consensus.cc:385] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.100379 15369 raft_consensus.cc:740] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.100498 15369 consensus_queue.cc:260] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.100740 15369 ts_tablet_manager.cc:1434] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.100903 15369 tablet_bootstrap.cc:492] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.102118 15372 tablet_bootstrap.cc:492] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.102988 15372 tablet_bootstrap.cc:654] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.103303 15369 tablet_bootstrap.cc:654] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.104300 15370 tablet_bootstrap.cc:492] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.104357 15369 tablet_bootstrap.cc:492] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.104387 15370 ts_tablet_manager.cc:1403] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.000s
I20251025 08:02:26.104416 15369 ts_tablet_manager.cc:1403] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20251025 08:02:26.104511 15372 tablet_bootstrap.cc:492] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.104593 15372 ts_tablet_manager.cc:1403] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:26.104808 15370 raft_consensus.cc:359] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.104818 15369 raft_consensus.cc:359] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.104907 15369 raft_consensus.cc:385] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.104907 15370 raft_consensus.cc:385] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.104940 15369 raft_consensus.cc:740] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.104950 15370 raft_consensus.cc:740] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.104913 15372 raft_consensus.cc:359] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.105000 15372 raft_consensus.cc:385] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.105082 15372 raft_consensus.cc:740] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.105062 15369 consensus_queue.cc:260] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.105229 15372 consensus_queue.cc:260] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.105315 15369 ts_tablet_manager.cc:1434] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.105460 15372 ts_tablet_manager.cc:1434] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.105490 15369 tablet_bootstrap.cc:492] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.105598 15372 tablet_bootstrap.cc:492] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.105703 15370 consensus_queue.cc:260] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.106959 15370 ts_tablet_manager.cc:1434] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:26.107131 15370 tablet_bootstrap.cc:492] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.107614 15372 tablet_bootstrap.cc:654] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.107949 15370 tablet_bootstrap.cc:654] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.109084 15369 tablet_bootstrap.cc:654] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.109601 15370 tablet_bootstrap.cc:492] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.109678 15370 ts_tablet_manager.cc:1403] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:26.110086 15369 tablet_bootstrap.cc:492] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.110100 15370 raft_consensus.cc:359] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.110149 15369 ts_tablet_manager.cc:1403] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:26.110219 15370 raft_consensus.cc:385] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.110251 15370 raft_consensus.cc:740] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.110347 15370 consensus_queue.cc:260] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.110586 15370 ts_tablet_manager.cc:1434] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.110730 15370 tablet_bootstrap.cc:492] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.110625 15369 raft_consensus.cc:359] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.111115 15369 raft_consensus.cc:385] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.111153 15369 raft_consensus.cc:740] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.111280 15369 consensus_queue.cc:260] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.111596 15370 tablet_bootstrap.cc:654] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.113456 15369 ts_tablet_manager.cc:1434] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:26.113742 15369 tablet_bootstrap.cc:492] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.114630 15374 consensus_queue.cc:1048] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.114697 15372 tablet_bootstrap.cc:492] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.114766 15372 ts_tablet_manager.cc:1403] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:26.115211 15372 raft_consensus.cc:359] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.115309 15372 raft_consensus.cc:385] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.115346 15372 raft_consensus.cc:740] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.115474 15372 consensus_queue.cc:260] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.115866 15369 tablet_bootstrap.cc:654] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.116472 15372 ts_tablet_manager.cc:1434] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.116638 15372 tablet_bootstrap.cc:492] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.117513 15372 tablet_bootstrap.cc:654] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.121321 15864 consensus_queue.cc:1048] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.122272 15370 tablet_bootstrap.cc:492] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.122375 15370 ts_tablet_manager.cc:1403] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20251025 08:02:26.122503 15369 tablet_bootstrap.cc:492] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.122582 15369 ts_tablet_manager.cc:1403] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251025 08:02:26.122835 15370 raft_consensus.cc:359] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.123023 15370 raft_consensus.cc:385] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.123008 15369 raft_consensus.cc:359] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.123092 15369 raft_consensus.cc:385] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.123129 15369 raft_consensus.cc:740] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.123229 15369 consensus_queue.cc:260] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.123427 15370 raft_consensus.cc:740] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.123562 15370 consensus_queue.cc:260] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.123818 15370 ts_tablet_manager.cc:1434] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.123996 15370 tablet_bootstrap.cc:492] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.125244 15370 tablet_bootstrap.cc:654] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.126356 15370 tablet_bootstrap.cc:492] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.126485 15369 ts_tablet_manager.cc:1434] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:26.126662 15369 tablet_bootstrap.cc:492] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.126945 15370 ts_tablet_manager.cc:1403] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:26.127399 15370 raft_consensus.cc:359] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.127532 15370 raft_consensus.cc:385] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.127586 15370 raft_consensus.cc:740] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.127701 15370 consensus_queue.cc:260] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.128024 15370 ts_tablet_manager.cc:1434] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.128250 15370 tablet_bootstrap.cc:492] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.128561 15369 tablet_bootstrap.cc:654] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.129179 15370 tablet_bootstrap.cc:654] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.129473 15369 tablet_bootstrap.cc:492] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.129555 15369 ts_tablet_manager.cc:1403] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:26.129966 15369 raft_consensus.cc:359] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.130051 15369 raft_consensus.cc:385] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.130079 15369 raft_consensus.cc:740] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.130196 15369 consensus_queue.cc:260] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.130431 15369 ts_tablet_manager.cc:1434] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.130780 15369 tablet_bootstrap.cc:492] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.131644 15369 tablet_bootstrap.cc:654] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.133095 15369 tablet_bootstrap.cc:492] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.133255 15372 tablet_bootstrap.cc:492] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.133339 15372 ts_tablet_manager.cc:1403] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20251025 08:02:26.133741 15372 raft_consensus.cc:359] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.133850 15372 raft_consensus.cc:385] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.133885 15372 raft_consensus.cc:740] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.134006 15372 consensus_queue.cc:260] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.134303 15372 ts_tablet_manager.cc:1434] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.134459 15372 tablet_bootstrap.cc:492] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.134582 15370 tablet_bootstrap.cc:492] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.134660 15370 ts_tablet_manager.cc:1403] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:26.135069 15370 raft_consensus.cc:359] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.135150 15370 raft_consensus.cc:385] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.135177 15370 raft_consensus.cc:740] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.135295 15372 tablet_bootstrap.cc:654] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.135275 15370 consensus_queue.cc:260] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.133996 15369 ts_tablet_manager.cc:1403] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:26.136490 15369 raft_consensus.cc:359] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.136574 15369 raft_consensus.cc:385] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.136608 15369 raft_consensus.cc:740] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.136732 15369 consensus_queue.cc:260] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.135551 15370 ts_tablet_manager.cc:1434] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.137046 15369 ts_tablet_manager.cc:1434] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.137184 15369 tablet_bootstrap.cc:492] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.137208 15370 tablet_bootstrap.cc:492] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.137642 15864 raft_consensus.cc:493] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.137706 15864 raft_consensus.cc:515] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.138036 15864 leader_election.cc:290] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.138752 15369 tablet_bootstrap.cc:654] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.138803 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f08d0c3446dd4a478f81688a3259bb91" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:26.139572 14914 leader_election.cc:343] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.139680 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f08d0c3446dd4a478f81688a3259bb91" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.139776 15111 raft_consensus.cc:2468] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.140641 14915 leader_election.cc:304] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.140810 15864 raft_consensus.cc:2804] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.140878 15864 raft_consensus.cc:493] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.140916 15864 raft_consensus.cc:3060] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.141741 15864 raft_consensus.cc:515] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.142066 15864 leader_election.cc:290] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.142642 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f08d0c3446dd4a478f81688a3259bb91" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.143436 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f08d0c3446dd4a478f81688a3259bb91" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.143529 15111 raft_consensus.cc:3060] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.143759 15370 tablet_bootstrap.cc:654] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:26.143860 14914 leader_election.cc:343] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.144471 15111 raft_consensus.cc:2468] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.144817 14915 leader_election.cc:304] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.145000 15864 raft_consensus.cc:2804] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.145074 15864 raft_consensus.cc:697] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.145200 15864 consensus_queue.cc:237] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.145749 15372 tablet_bootstrap.cc:492] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.145823 15372 ts_tablet_manager.cc:1403] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20251025 08:02:26.145936 15370 tablet_bootstrap.cc:492] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.146008 15370 ts_tablet_manager.cc:1403] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:26.146256 15372 raft_consensus.cc:359] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.146351 15372 raft_consensus.cc:385] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.146391 15372 raft_consensus.cc:740] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.146389 15370 raft_consensus.cc:359] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.146471 15370 raft_consensus.cc:385] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.146502 15370 raft_consensus.cc:740] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.146502 15372 consensus_queue.cc:260] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.146601 15370 consensus_queue.cc:260] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.146744 15372 ts_tablet_manager.cc:1434] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:26.146833 15370 ts_tablet_manager.cc:1434] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.146914 15372 tablet_bootstrap.cc:492] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.146997 15370 tablet_bootstrap.cc:492] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.147866 15372 tablet_bootstrap.cc:654] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.149052 15372 tablet_bootstrap.cc:492] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.149123 15372 ts_tablet_manager.cc:1403] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.149899 15370 tablet_bootstrap.cc:654] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.151034 15370 tablet_bootstrap.cc:492] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.151232 15370 ts_tablet_manager.cc:1403] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:26.151767 15372 raft_consensus.cc:359] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.151834 15370 raft_consensus.cc:359] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.151885 15372 raft_consensus.cc:385] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.151917 15372 raft_consensus.cc:740] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.151923 15370 raft_consensus.cc:385] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.151959 15370 raft_consensus.cc:740] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.152047 15372 consensus_queue.cc:260] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.152133 15370 consensus_queue.cc:260] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.152194 15369 tablet_bootstrap.cc:492] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.152271 15369 ts_tablet_manager.cc:1403] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:26.152658 15369 raft_consensus.cc:359] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.152740 15369 raft_consensus.cc:385] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.152769 15369 raft_consensus.cc:740] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.152875 15369 consensus_queue.cc:260] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.153144 15369 ts_tablet_manager.cc:1434] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.152393 15370 ts_tablet_manager.cc:1434] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.153481 15370 tablet_bootstrap.cc:492] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.153975 15372 ts_tablet_manager.cc:1434] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:26.154439 15370 tablet_bootstrap.cc:654] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.154465 15372 tablet_bootstrap.cc:492] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.155318 15370 tablet_bootstrap.cc:492] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.155395 15370 ts_tablet_manager.cc:1403] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.155462 15372 tablet_bootstrap.cc:654] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.155783 15370 raft_consensus.cc:359] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.155885 15370 raft_consensus.cc:385] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.155921 15370 raft_consensus.cc:740] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.156085 15370 consensus_queue.cc:260] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.156314 15370 ts_tablet_manager.cc:1434] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.156462 15370 tablet_bootstrap.cc:492] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.157182 15864 raft_consensus.cc:493] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.157276 15864 raft_consensus.cc:515] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.157352 15370 tablet_bootstrap.cc:654] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.157627 15864 leader_election.cc:290] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.157907 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d9f6636b364e3b9192ae546422de5b" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.158025 15247 raft_consensus.cc:2468] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.158399 14914 leader_election.cc:304] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
W20251025 08:02:26.158784 14915 leader_election.cc:343] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 01d9f6636b364e3b9192ae546422de5b
I20251025 08:02:26.160409 15864 raft_consensus.cc:2804] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.160465 15864 raft_consensus.cc:493] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.160502 15864 raft_consensus.cc:3060] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.160785 15369 tablet_bootstrap.cc:492] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.161427 15864 raft_consensus.cc:515] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.161720 15864 leader_election.cc:290] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.161841 15369 tablet_bootstrap.cc:654] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.162124 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "01d9f6636b364e3b9192ae546422de5b" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.162252 15247 raft_consensus.cc:3060] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.163203 15247 raft_consensus.cc:2468] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.163560 15372 tablet_bootstrap.cc:492] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.163532 14914 leader_election.cc:304] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.163625 15372 ts_tablet_manager.cc:1403] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
W20251025 08:02:26.163751 14915 leader_election.cc:343] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 01d9f6636b364e3b9192ae546422de5b
I20251025 08:02:26.163967 15864 raft_consensus.cc:2804] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.164054 15864 raft_consensus.cc:697] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.164072 15372 raft_consensus.cc:359] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.164149 15372 raft_consensus.cc:385] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.164179 15372 raft_consensus.cc:740] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.164171 15864 consensus_queue.cc:237] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.164283 15372 consensus_queue.cc:260] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.164563 15372 ts_tablet_manager.cc:1434] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.164808 15372 tablet_bootstrap.cc:492] T b3fdc5bd4c7f4506a150f31137e8b091 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.165431 15369 tablet_bootstrap.cc:492] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.165485 15369 ts_tablet_manager.cc:1403] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:26.165861 15369 raft_consensus.cc:359] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.165944 15369 raft_consensus.cc:385] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.165972 15369 raft_consensus.cc:740] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.166067 15369 consensus_queue.cc:260] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.166399 15369 ts_tablet_manager.cc:1434] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.166553 15369 tablet_bootstrap.cc:492] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.168287 15369 tablet_bootstrap.cc:654] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.170341 15372 tablet_bootstrap.cc:654] T b3fdc5bd4c7f4506a150f31137e8b091 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.171588 15370 tablet_bootstrap.cc:492] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.171665 15370 ts_tablet_manager.cc:1403] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:26.171898 15369 tablet_bootstrap.cc:492] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.171977 15369 ts_tablet_manager.cc:1403] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251025 08:02:26.172120 15370 raft_consensus.cc:359] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.172245 15370 raft_consensus.cc:385] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.172286 15370 raft_consensus.cc:740] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.172288 15369 raft_consensus.cc:359] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.172358 15369 raft_consensus.cc:385] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.172389 15369 raft_consensus.cc:740] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.172309 15372 tablet_bootstrap.cc:492] T b3fdc5bd4c7f4506a150f31137e8b091 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.172415 15370 consensus_queue.cc:260] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.172511 15369 consensus_queue.cc:260] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.172567 15372 ts_tablet_manager.cc:1403] T b3fdc5bd4c7f4506a150f31137e8b091 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251025 08:02:26.172706 15370 ts_tablet_manager.cc:1434] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.173089 15370 tablet_bootstrap.cc:492] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.173552 15372 raft_consensus.cc:359] T b3fdc5bd4c7f4506a150f31137e8b091 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.173836 15372 raft_consensus.cc:385] T b3fdc5bd4c7f4506a150f31137e8b091 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.173923 15372 raft_consensus.cc:740] T b3fdc5bd4c7f4506a150f31137e8b091 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.174054 15370 tablet_bootstrap.cc:654] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.174165 15372 consensus_queue.cc:260] T b3fdc5bd4c7f4506a150f31137e8b091 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.175546 15369 ts_tablet_manager.cc:1434] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:26.175726 15369 tablet_bootstrap.cc:492] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.175887 15372 ts_tablet_manager.cc:1434] T b3fdc5bd4c7f4506a150f31137e8b091 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20251025 08:02:26.176065 15372 tablet_bootstrap.cc:492] T d14e12c45323420b84de06d828238caa P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.176995 15372 tablet_bootstrap.cc:654] T d14e12c45323420b84de06d828238caa P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.177012 15369 tablet_bootstrap.cc:654] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.178601 15642 raft_consensus.cc:493] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.178691 15642 raft_consensus.cc:515] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.179039 15372 tablet_bootstrap.cc:492] T d14e12c45323420b84de06d828238caa P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.179047 15642 leader_election.cc:290] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.179111 15372 ts_tablet_manager.cc:1403] T d14e12c45323420b84de06d828238caa P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20251025 08:02:26.179445 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcf414d04305456b80b2ec5dd8fb0ba7" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.179613 15372 raft_consensus.cc:359] T d14e12c45323420b84de06d828238caa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.180572 15372 raft_consensus.cc:385] T d14e12c45323420b84de06d828238caa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.180611 15372 raft_consensus.cc:740] T d14e12c45323420b84de06d828238caa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.180732 15372 consensus_queue.cc:260] T d14e12c45323420b84de06d828238caa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:26.180912 15049 leader_election.cc:343] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.180995 15372 ts_tablet_manager.cc:1434] T d14e12c45323420b84de06d828238caa P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.181188 15372 tablet_bootstrap.cc:492] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.181715 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcf414d04305456b80b2ec5dd8fb0ba7" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.181818 14977 raft_consensus.cc:2468] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.182066 15372 tablet_bootstrap.cc:654] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.183106 15372 tablet_bootstrap.cc:492] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.183193 15372 ts_tablet_manager.cc:1403] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:26.183651 15372 raft_consensus.cc:359] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.183750 15372 raft_consensus.cc:385] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.183787 15372 raft_consensus.cc:740] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.183811 15048 leader_election.cc:304] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.183903 15372 consensus_queue.cc:260] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.184043 15642 raft_consensus.cc:2804] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.184088 15642 raft_consensus.cc:493] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.184126 15642 raft_consensus.cc:3060] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.184192 15372 ts_tablet_manager.cc:1434] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.184362 15372 tablet_bootstrap.cc:492] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.185137 15642 raft_consensus.cc:515] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.185418 15372 tablet_bootstrap.cc:654] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.185495 15642 leader_election.cc:290] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.186842 15372 tablet_bootstrap.cc:492] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.186915 15372 ts_tablet_manager.cc:1403] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:26.187307 15372 raft_consensus.cc:359] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.187374 15372 raft_consensus.cc:385] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.187394 15372 raft_consensus.cc:740] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.187484 15372 consensus_queue.cc:260] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.187683 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcf414d04305456b80b2ec5dd8fb0ba7" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.187778 14977 raft_consensus.cc:3060] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.187773 15372 ts_tablet_manager.cc:1434] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.187933 15372 tablet_bootstrap.cc:492] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.188439 14977 raft_consensus.cc:2468] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.188673 15372 tablet_bootstrap.cc:654] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.188730 15048 leader_election.cc:304] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.188897 15642 raft_consensus.cc:2804] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.188974 15642 raft_consensus.cc:697] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.189105 15642 consensus_queue.cc:237] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.189692 15372 tablet_bootstrap.cc:492] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.189755 15372 ts_tablet_manager.cc:1403] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.190150 15372 raft_consensus.cc:359] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.190263 15372 raft_consensus.cc:385] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.190295 15372 raft_consensus.cc:740] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.190389 15372 consensus_queue.cc:260] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.190604 15372 ts_tablet_manager.cc:1434] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.190766 15372 tablet_bootstrap.cc:492] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.191066 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcf414d04305456b80b2ec5dd8fb0ba7" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.191982 15372 tablet_bootstrap.cc:654] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.192972 15372 tablet_bootstrap.cc:492] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.193044 15372 ts_tablet_manager.cc:1403] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.193224 15380 raft_consensus.cc:493] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.193302 15380 raft_consensus.cc:515] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.193399 15372 raft_consensus.cc:359] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.193480 15372 raft_consensus.cc:385] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.193508 15372 raft_consensus.cc:740] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.193589 15380 leader_election.cc:290] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.193591 15372 consensus_queue.cc:260] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.193849 15372 ts_tablet_manager.cc:1434] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
W20251025 08:02:26.194024 15049 leader_election.cc:343] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.194075 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d14e12c45323420b84de06d828238caa" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.194164 15247 raft_consensus.cc:2468] T d14e12c45323420b84de06d828238caa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.195063 15372 tablet_bootstrap.cc:492] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.195082 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d14e12c45323420b84de06d828238caa" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.195178 14977 raft_consensus.cc:2468] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.195456 15048 leader_election.cc:304] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.195735 15380 raft_consensus.cc:2804] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.195791 15380 raft_consensus.cc:493] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.195835 15380 raft_consensus.cc:3060] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.196099 15372 tablet_bootstrap.cc:654] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.196879 15380 raft_consensus.cc:515] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.197240 15372 tablet_bootstrap.cc:492] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.197242 15380 leader_election.cc:290] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.197310 15372 ts_tablet_manager.cc:1403] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:26.197687 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d14e12c45323420b84de06d828238caa" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.197721 15372 raft_consensus.cc:359] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.197793 14977 raft_consensus.cc:3060] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.197803 15372 raft_consensus.cc:385] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.197837 15372 raft_consensus.cc:740] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.197907 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d14e12c45323420b84de06d828238caa" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.197944 15372 consensus_queue.cc:260] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.198007 15247 raft_consensus.cc:3060] T d14e12c45323420b84de06d828238caa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.198289 15372 ts_tablet_manager.cc:1434] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.198442 15372 tablet_bootstrap.cc:492] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.198701 14977 raft_consensus.cc:2468] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.198937 15247 raft_consensus.cc:2468] T d14e12c45323420b84de06d828238caa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.199322 15372 tablet_bootstrap.cc:654] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.199465 15049 leader_election.cc:304] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.199623 15380 raft_consensus.cc:2804] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.199712 15380 raft_consensus.cc:697] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.199829 15380 consensus_queue.cc:237] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.201676 15369 tablet_bootstrap.cc:492] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.201753 15369 ts_tablet_manager.cc:1403] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.000s
I20251025 08:02:26.202098 15369 raft_consensus.cc:359] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.202163 15369 raft_consensus.cc:385] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.202227 15369 raft_consensus.cc:740] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.202364 15369 consensus_queue.cc:260] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.202634 15369 ts_tablet_manager.cc:1434] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.202816 15369 tablet_bootstrap.cc:492] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.203735 15370 tablet_bootstrap.cc:492] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.203776 15369 tablet_bootstrap.cc:654] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.203811 15370 ts_tablet_manager.cc:1403] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.031s user 0.000s sys 0.002s
I20251025 08:02:26.203888 15372 tablet_bootstrap.cc:492] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.203962 15372 ts_tablet_manager.cc:1403] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251025 08:02:26.204222 15370 raft_consensus.cc:359] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.204310 15370 raft_consensus.cc:385] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.204340 15370 raft_consensus.cc:740] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.204397 15372 raft_consensus.cc:359] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.204486 15372 raft_consensus.cc:385] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.204443 15370 consensus_queue.cc:260] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.204527 15372 raft_consensus.cc:740] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.204635 15372 consensus_queue.cc:260] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.204753 15370 ts_tablet_manager.cc:1434] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.204880 15372 ts_tablet_manager.cc:1434] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.204931 15370 tablet_bootstrap.cc:492] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.205054 15372 tablet_bootstrap.cc:492] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.205807 15370 tablet_bootstrap.cc:654] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.205941 15372 tablet_bootstrap.cc:654] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.206378 15369 tablet_bootstrap.cc:492] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.206452 15369 ts_tablet_manager.cc:1403] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:26.206513 15409 raft_consensus.cc:493] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.206585 15409 raft_consensus.cc:515] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.206869 15409 leader_election.cc:290] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.207543 15642 consensus_queue.cc:1048] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.208029 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e3cd7b63fa174ee192ff909f149e8b17" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.209580 15864 raft_consensus.cc:493] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.209685 15864 raft_consensus.cc:515] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.210060 15864 leader_election.cc:290] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.210429 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcb5f7e52507450c8a6f5a99a9927974" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.210661 15247 raft_consensus.cc:2468] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.210677 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcb5f7e52507450c8a6f5a99a9927974" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.210772 15111 raft_consensus.cc:2468] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.211126 14915 leader_election.cc:304] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.212217 15864 raft_consensus.cc:2804] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.212275 15864 raft_consensus.cc:493] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.212316 15864 raft_consensus.cc:3060] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.213248 15864 raft_consensus.cc:515] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.213485 15370 tablet_bootstrap.cc:492] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.213536 15864 leader_election.cc:290] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.213560 15370 ts_tablet_manager.cc:1403] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:26.213606 15372 tablet_bootstrap.cc:492] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.213673 15372 ts_tablet_manager.cc:1403] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:26.213973 15370 raft_consensus.cc:359] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.214072 15370 raft_consensus.cc:385] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.214112 15370 raft_consensus.cc:740] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.214082 15372 raft_consensus.cc:359] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.214164 15372 raft_consensus.cc:385] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.214223 15372 raft_consensus.cc:740] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.214241 15370 consensus_queue.cc:260] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.214323 15372 consensus_queue.cc:260] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.214493 15370 ts_tablet_manager.cc:1434] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.214561 15372 ts_tablet_manager.cc:1434] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:26.214658 15370 tablet_bootstrap.cc:492] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.214705 15372 tablet_bootstrap.cc:492] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.215559 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcb5f7e52507450c8a6f5a99a9927974" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.215663 15247 raft_consensus.cc:3060] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.215642 15497 consensus_queue.cc:1048] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.215803 15372 tablet_bootstrap.cc:654] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.216522 15247 raft_consensus.cc:2468] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.216738 15464 raft_consensus.cc:493] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.216807 15464 raft_consensus.cc:515] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.216838 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcb5f7e52507450c8a6f5a99a9927974" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.216926 15111 raft_consensus.cc:3060] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.216950 14914 leader_election.cc:304] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.217134 15464 leader_election.cc:290] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.217185 15445 raft_consensus.cc:2804] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.217257 15445 raft_consensus.cc:697] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.217382 15445 consensus_queue.cc:237] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.217520 15372 tablet_bootstrap.cc:492] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.217585 15372 ts_tablet_manager.cc:1403] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251025 08:02:26.217803 15111 raft_consensus.cc:2468] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.218107 15372 raft_consensus.cc:359] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.219736 15372 raft_consensus.cc:385] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.219765 15372 raft_consensus.cc:740] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.219849 15372 consensus_queue.cc:260] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.220088 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ae3f4cdb1b14d1abe884c4a0628a6ec" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.220163 15111 raft_consensus.cc:2468] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.220413 14915 leader_election.cc:304] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.220556 15464 raft_consensus.cc:2804] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.220600 15464 raft_consensus.cc:493] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.220641 15464 raft_consensus.cc:3060] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.220906 15372 ts_tablet_manager.cc:1434] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:26.221076 15372 tablet_bootstrap.cc:492] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.221264 15370 tablet_bootstrap.cc:654] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.221563 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ae3f4cdb1b14d1abe884c4a0628a6ec" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.221551 15464 raft_consensus.cc:515] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.221668 15247 raft_consensus.cc:2468] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.221899 15464 leader_election.cc:290] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.222128 15372 tablet_bootstrap.cc:654] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.222338 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ae3f4cdb1b14d1abe884c4a0628a6ec" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.222433 15247 raft_consensus.cc:3060] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.223124 15247 raft_consensus.cc:2468] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.223551 14914 leader_election.cc:304] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.223699 15864 raft_consensus.cc:2804] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.223773 15864 raft_consensus.cc:697] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.223886 15864 consensus_queue.cc:237] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.224267 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7ae3f4cdb1b14d1abe884c4a0628a6ec" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.224354 15111 raft_consensus.cc:3060] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.225168 15111 raft_consensus.cc:2468] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.225688 15642 raft_consensus.cc:493] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.225759 15642 raft_consensus.cc:515] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.226054 15642 leader_election.cc:290] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.226332 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f585455b77df49738b44c31a3d7adb71" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.226400 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e3cd7b63fa174ee192ff909f149e8b17" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.226435 15247 raft_consensus.cc:2468] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.226400 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f585455b77df49738b44c31a3d7adb71" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.226653 15049 leader_election.cc:304] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.226752 15183 leader_election.cc:304] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.226917 15909 raft_consensus.cc:2749] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:26.227032 15048 leader_election.cc:343] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.227162 15642 raft_consensus.cc:2804] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.227242 15642 raft_consensus.cc:493] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.227288 15642 raft_consensus.cc:3060] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.227566 15370 tablet_bootstrap.cc:492] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.227636 15370 ts_tablet_manager.cc:1403] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20251025 08:02:26.227949 15642 raft_consensus.cc:515] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.228049 15370 raft_consensus.cc:359] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.228116 15370 raft_consensus.cc:385] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.228137 15370 raft_consensus.cc:740] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.228226 15370 consensus_queue.cc:260] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.228253 15372 tablet_bootstrap.cc:492] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.228487 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f585455b77df49738b44c31a3d7adb71" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.228514 15370 ts_tablet_manager.cc:1434] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.228557 15372 ts_tablet_manager.cc:1403] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251025 08:02:26.228575 15247 raft_consensus.cc:3060] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.228690 15370 tablet_bootstrap.cc:492] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.229189 15372 raft_consensus.cc:359] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.229301 15372 raft_consensus.cc:385] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.229267 15369 raft_consensus.cc:359] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.229333 15372 raft_consensus.cc:740] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.229351 15369 raft_consensus.cc:385] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.229382 15247 raft_consensus.cc:2468] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.229446 15372 consensus_queue.cc:260] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.229720 15372 ts_tablet_manager.cc:1434] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.229739 15370 tablet_bootstrap.cc:654] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.229990 15372 tablet_bootstrap.cc:492] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.230984 15372 tablet_bootstrap.cc:654] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.231220 15909 raft_consensus.cc:493] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.231297 15049 leader_election.cc:304] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.231293 15909 raft_consensus.cc:515] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.231436 15497 raft_consensus.cc:2804] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.231508 15497 raft_consensus.cc:697] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.231600 15909 leader_election.cc:290] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.231606 15497 consensus_queue.cc:237] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:26.234210 15183 leader_election.cc:343] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: dfb4a050022d462699005fedc4323fdb
W20251025 08:02:26.234454 15185 leader_election.cc:343] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: dfb4a050022d462699005fedc4323fdb
I20251025 08:02:26.234517 15185 leader_election.cc:304] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.234669 15409 raft_consensus.cc:2749] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.229396 15369 raft_consensus.cc:740] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.229569 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f585455b77df49738b44c31a3d7adb71" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.236106 15369 consensus_queue.cc:260] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:26.236372 15048 leader_election.cc:343] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.237331 15369 ts_tablet_manager.cc:1434] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.031s user 0.001s sys 0.000s
I20251025 08:02:26.237363 15497 raft_consensus.cc:493] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.237437 15497 raft_consensus.cc:515] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.237502 15369 tablet_bootstrap.cc:492] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.228286 15642 leader_election.cc:290] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.237722 15497 leader_election.cc:290] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.238365 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8576553f17b49f8bd11436ecac471ed" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.238471 14976 raft_consensus.cc:2468] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.238479 15369 tablet_bootstrap.cc:654] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.239064 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8576553f17b49f8bd11436ecac471ed" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.239162 15247 raft_consensus.cc:2468] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.239583 15049 leader_election.cc:304] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.239689 15370 tablet_bootstrap.cc:492] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.239728 15497 raft_consensus.cc:2804] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.239771 15370 ts_tablet_manager.cc:1403] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251025 08:02:26.239784 15497 raft_consensus.cc:493] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.239832 15497 raft_consensus.cc:3060] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.240160 15370 raft_consensus.cc:359] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.240263 15370 raft_consensus.cc:385] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.240302 15370 raft_consensus.cc:740] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.240427 15370 consensus_queue.cc:260] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.240576 15497 raft_consensus.cc:515] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.240682 15370 ts_tablet_manager.cc:1434] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.240880 15497 leader_election.cc:290] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.240904 15370 tablet_bootstrap.cc:492] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.241614 15372 tablet_bootstrap.cc:492] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.241680 15372 ts_tablet_manager.cc:1403] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20251025 08:02:26.241899 15370 tablet_bootstrap.cc:654] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.242434 15372 raft_consensus.cc:359] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.242528 15372 raft_consensus.cc:385] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.242561 15372 raft_consensus.cc:740] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.242679 15372 consensus_queue.cc:260] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.243489 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8576553f17b49f8bd11436ecac471ed" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.243580 14976 raft_consensus.cc:3060] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.243719 15372 ts_tablet_manager.cc:1434] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.243855 15372 tablet_bootstrap.cc:492] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.244484 14976 raft_consensus.cc:2468] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.244935 15372 tablet_bootstrap.cc:654] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.246064 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f8576553f17b49f8bd11436ecac471ed" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.246160 15247 raft_consensus.cc:3060] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.247444 15048 leader_election.cc:304] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.248309 15497 raft_consensus.cc:2804] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.248401 15497 raft_consensus.cc:697] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.248394 15247 raft_consensus.cc:2468] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.248510 15497 consensus_queue.cc:237] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.248875 15370 tablet_bootstrap.cc:492] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.248940 15370 ts_tablet_manager.cc:1403] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s
I20251025 08:02:26.249328 15370 raft_consensus.cc:359] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.249534 15370 raft_consensus.cc:385] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.249563 15370 raft_consensus.cc:740] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.249672 15370 consensus_queue.cc:260] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.249742 15369 tablet_bootstrap.cc:492] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.249809 15369 ts_tablet_manager.cc:1403] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20251025 08:02:26.249922 15370 ts_tablet_manager.cc:1434] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:26.250109 15370 tablet_bootstrap.cc:492] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.250372 15369 raft_consensus.cc:359] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.250699 15369 raft_consensus.cc:385] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.250731 15369 raft_consensus.cc:740] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.250828 15369 consensus_queue.cc:260] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.251187 15369 ts_tablet_manager.cc:1434] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.251523 15369 tablet_bootstrap.cc:492] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.251722 15370 tablet_bootstrap.cc:654] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.252480 15369 tablet_bootstrap.cc:654] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.254122 15372 tablet_bootstrap.cc:492] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.254230 15372 ts_tablet_manager.cc:1403] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:26.254654 15372 raft_consensus.cc:359] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.254869 15372 raft_consensus.cc:385] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.254915 15372 raft_consensus.cc:740] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.255051 15372 consensus_queue.cc:260] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.255311 15372 ts_tablet_manager.cc:1434] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.255493 15372 tablet_bootstrap.cc:492] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.256428 15372 tablet_bootstrap.cc:654] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.257073 15497 raft_consensus.cc:493] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.257145 15497 raft_consensus.cc:515] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.257346 15369 tablet_bootstrap.cc:492] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.257421 15369 ts_tablet_manager.cc:1403] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251025 08:02:26.257807 15369 raft_consensus.cc:359] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.257886 15369 raft_consensus.cc:385] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.257915 15369 raft_consensus.cc:740] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.258005 15369 consensus_queue.cc:260] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.258270 15369 ts_tablet_manager.cc:1434] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.258414 15369 tablet_bootstrap.cc:492] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.258509 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b3fdc5bd4c7f4506a150f31137e8b091" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.258606 15247 raft_consensus.cc:2468] T b3fdc5bd4c7f4506a150f31137e8b091 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.258834 15049 leader_election.cc:304] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.259215 15497 leader_election.cc:290] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.259258 15369 tablet_bootstrap.cc:654] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.259303 15497 raft_consensus.cc:2804] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.259341 15497 raft_consensus.cc:493] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.259394 15497 raft_consensus.cc:3060] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.260279 15497 raft_consensus.cc:515] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.260505 15369 tablet_bootstrap.cc:492] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.260612 15369 ts_tablet_manager.cc:1403] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:26.260495 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b3fdc5bd4c7f4506a150f31137e8b091" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.260752 14976 raft_consensus.cc:2468] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.260922 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b3fdc5bd4c7f4506a150f31137e8b091" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.260994 15369 raft_consensus.cc:359] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.261088 15369 raft_consensus.cc:385] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.261127 15369 raft_consensus.cc:740] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.261065 15247 raft_consensus.cc:3060] T b3fdc5bd4c7f4506a150f31137e8b091 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.261296 15370 tablet_bootstrap.cc:492] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.261273 15369 consensus_queue.cc:260] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.261374 15370 ts_tablet_manager.cc:1403] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251025 08:02:26.261586 15369 ts_tablet_manager.cc:1434] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.261755 15369 tablet_bootstrap.cc:492] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.261826 15370 raft_consensus.cc:359] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.261942 15370 raft_consensus.cc:385] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.261986 15370 raft_consensus.cc:740] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.262107 15370 consensus_queue.cc:260] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.262353 15497 leader_election.cc:290] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.263020 15909 raft_consensus.cc:493] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.263098 15909 raft_consensus.cc:515] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.263116 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b3fdc5bd4c7f4506a150f31137e8b091" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.263168 15369 tablet_bootstrap.cc:654] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.263190 14976 raft_consensus.cc:3060] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.263453 15909 leader_election.cc:290] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.263520 15909 raft_consensus.cc:493] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.263567 15909 raft_consensus.cc:515] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.263799 15909 leader_election.cc:290] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.264003 15497 raft_consensus.cc:493] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.264108 14976 raft_consensus.cc:2468] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.264362 15048 leader_election.cc:304] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.264554 15497 raft_consensus.cc:515] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.264662 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0310efe286dd409ab857a92daa6ff99f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.264751 15113 raft_consensus.cc:2468] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:26.264881 15497 leader_election.cc:290] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.264931 15642 raft_consensus.cc:2804] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.265000 15642 raft_consensus.cc:697] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.265097 15642 consensus_queue.cc:237] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.265368 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eed2815efb7e46dd8b41f5ffe60daee8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.265457 15246 raft_consensus.cc:2468] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.265588 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0310efe286dd409ab857a92daa6ff99f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.265702 14977 raft_consensus.cc:2468] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
W20251025 08:02:26.265772 15183 leader_election.cc:343] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 88052f79558a42eeb1c8acf44e6b48e1
I20251025 08:02:26.265864 15372 tablet_bootstrap.cc:492] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.265910 15049 leader_election.cc:304] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.265938 15372 ts_tablet_manager.cc:1403] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:26.266064 15497 raft_consensus.cc:2804] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.266111 15497 raft_consensus.cc:493] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251025 08:02:26.266129 15185 leader_election.cc:343] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 88052f79558a42eeb1c8acf44e6b48e1
I20251025 08:02:26.266152 15497 raft_consensus.cc:3060] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.266227 15185 leader_election.cc:304] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.266398 15372 raft_consensus.cc:359] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.266438 15185 leader_election.cc:304] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.266482 15372 raft_consensus.cc:385] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.266522 15372 raft_consensus.cc:740] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.266561 15409 raft_consensus.cc:2749] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.266628 15372 consensus_queue.cc:260] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.266882 15372 ts_tablet_manager.cc:1434] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.267048 15372 tablet_bootstrap.cc:492] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.267072 15497 raft_consensus.cc:515] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.267349 15497 leader_election.cc:290] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.266637 15409 raft_consensus.cc:2804] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.267717 15409 raft_consensus.cc:493] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.267769 15409 raft_consensus.cc:3060] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.267817 15372 tablet_bootstrap.cc:654] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.268550 15409 raft_consensus.cc:515] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.268664 15369 tablet_bootstrap.cc:492] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.268666 15372 tablet_bootstrap.cc:492] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.268725 15369 ts_tablet_manager.cc:1403] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251025 08:02:26.268725 15372 ts_tablet_manager.cc:1403] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.268813 15409 leader_election.cc:290] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.268980 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eed2815efb7e46dd8b41f5ffe60daee8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.269054 15246 raft_consensus.cc:3060] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.269116 15369 raft_consensus.cc:359] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.269203 15369 raft_consensus.cc:385] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.269232 15369 raft_consensus.cc:740] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.269320 15369 consensus_queue.cc:260] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.269526 15369 ts_tablet_manager.cc:1434] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.269670 15369 tablet_bootstrap.cc:492] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.269891 15246 raft_consensus.cc:2468] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.270044 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0310efe286dd409ab857a92daa6ff99f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.270134 15113 raft_consensus.cc:3060] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.270375 15372 raft_consensus.cc:359] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.270465 15372 raft_consensus.cc:385] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.270504 15372 raft_consensus.cc:740] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.270577 15369 tablet_bootstrap.cc:654] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.270619 15372 consensus_queue.cc:260] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.270911 15372 ts_tablet_manager.cc:1434] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.270999 15113 raft_consensus.cc:2468] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:26.271070 15372 tablet_bootstrap.cc:492] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.271193 15049 leader_election.cc:304] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.271330 15642 raft_consensus.cc:493] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.271392 15642 raft_consensus.cc:515] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.271685 15642 leader_election.cc:290] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.271763 15642 raft_consensus.cc:2804] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.271818 15642 raft_consensus.cc:697] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.271879 15372 tablet_bootstrap.cc:654] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.271905 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0310efe286dd409ab857a92daa6ff99f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.271908 15642 consensus_queue.cc:237] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.272001 14977 raft_consensus.cc:3060] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.272888 14977 raft_consensus.cc:2468] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:26.273046 15185 leader_election.cc:304] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.273128 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "821de6815eb244058f1d8a7a06bf48a6" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.273278 15384 raft_consensus.cc:2804] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.273343 15384 raft_consensus.cc:697] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:26.273437 15384 consensus_queue.cc:237] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:26.274787 15049 leader_election.cc:343] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.275693 15370 ts_tablet_manager.cc:1434] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s
I20251025 08:02:26.275857 15370 tablet_bootstrap.cc:492] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.276612 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eed2815efb7e46dd8b41f5ffe60daee8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.276712 15370 tablet_bootstrap.cc:654] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.276714 14977 raft_consensus.cc:3060] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.277438 14977 raft_consensus.cc:2468] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.277456 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "821de6815eb244058f1d8a7a06bf48a6" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.277998 15369 tablet_bootstrap.cc:492] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.278065 15369 ts_tablet_manager.cc:1403] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
W20251025 08:02:26.278231 15048 leader_election.cc:343] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.278290 15048 leader_election.cc:304] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.278426 15497 raft_consensus.cc:2749] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.278446 15369 raft_consensus.cc:359] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.278518 15369 raft_consensus.cc:385] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.278548 15369 raft_consensus.cc:740] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.278645 15369 consensus_queue.cc:260] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.278887 15369 ts_tablet_manager.cc:1434] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:26.279054 15369 tablet_bootstrap.cc:492] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.279768 15369 tablet_bootstrap.cc:654] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.280153 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "eed2815efb7e46dd8b41f5ffe60daee8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.280246 14976 raft_consensus.cc:2376] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1. Re-sending same reply.
I20251025 08:02:26.280589 15380 raft_consensus.cc:493] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.280653 15380 raft_consensus.cc:515] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.280915 15380 leader_election.cc:290] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.281729 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e605f701a474fff80688533f3a398e7" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.281831 15246 raft_consensus.cc:2468] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.282176 15049 leader_election.cc:304] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.282374 15497 raft_consensus.cc:2804] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.282420 15497 raft_consensus.cc:493] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.282452 15497 raft_consensus.cc:3060] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.282577 15372 tablet_bootstrap.cc:492] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.282641 15372 ts_tablet_manager.cc:1403] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20251025 08:02:26.283006 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e605f701a474fff80688533f3a398e7" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.283017 15372 raft_consensus.cc:359] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.283103 15372 raft_consensus.cc:385] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.283098 14976 raft_consensus.cc:2468] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.283135 15372 raft_consensus.cc:740] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.283134 15497 raft_consensus.cc:515] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.283238 15372 consensus_queue.cc:260] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.283433 15497 leader_election.cc:290] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.283600 15372 ts_tablet_manager.cc:1434] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.283900 15372 tablet_bootstrap.cc:492] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.284271 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e605f701a474fff80688533f3a398e7" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.284358 15246 raft_consensus.cc:3060] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.284684 15372 tablet_bootstrap.cc:654] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.285065 15246 raft_consensus.cc:2468] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.285540 15049 leader_election.cc:304] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.285694 15497 raft_consensus.cc:2804] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.285760 15370 tablet_bootstrap.cc:492] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.285831 15370 ts_tablet_manager.cc:1403] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:26.286244 15370 raft_consensus.cc:359] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.286319 15370 raft_consensus.cc:385] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.286345 15370 raft_consensus.cc:740] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.286430 15370 consensus_queue.cc:260] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.286679 15370 ts_tablet_manager.cc:1434] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.286764 15372 tablet_bootstrap.cc:492] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.286811 15372 ts_tablet_manager.cc:1403] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:26.286811 15370 tablet_bootstrap.cc:492] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.287078 15372 raft_consensus.cc:359] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.287160 15372 raft_consensus.cc:385] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.287182 15372 raft_consensus.cc:740] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.287154 15642 consensus_queue.cc:1048] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.287282 15372 consensus_queue.cc:260] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.287485 15372 ts_tablet_manager.cc:1434] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.287590 15372 tablet_bootstrap.cc:492] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.287652 15370 tablet_bootstrap.cc:654] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.288362 15372 tablet_bootstrap.cc:654] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.285753 15497 raft_consensus.cc:697] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.288771 15497 consensus_queue.cc:237] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.289027 15380 raft_consensus.cc:493] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.289098 15380 raft_consensus.cc:515] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.289387 15380 leader_election.cc:290] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.289721 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5e605f701a474fff80688533f3a398e7" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.289808 14976 raft_consensus.cc:3060] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.289875 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf5008728a6241c096c9a76f8e374ceb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.289978 14977 raft_consensus.cc:2468] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.290292 15247 raft_consensus.cc:2468] T b3fdc5bd4c7f4506a150f31137e8b091 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.290644 14976 raft_consensus.cc:2468] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.290673 15048 leader_election.cc:304] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.291306 15409 raft_consensus.cc:493] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.291388 15409 raft_consensus.cc:515] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.291507 15369 tablet_bootstrap.cc:492] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.291576 15369 ts_tablet_manager.cc:1403] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20251025 08:02:26.291646 15409 leader_election.cc:290] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.291687 15380 raft_consensus.cc:2804] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.291730 15380 raft_consensus.cc:493] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.291770 15380 raft_consensus.cc:3060] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.291981 15369 raft_consensus.cc:359] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.292052 15369 raft_consensus.cc:385] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.292023 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8737df10a3c8482c995ac6aadc240c42" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.292078 15369 raft_consensus.cc:740] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.292109 15113 raft_consensus.cc:2468] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:26.292151 15369 consensus_queue.cc:260] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.292369 15369 ts_tablet_manager.cc:1434] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.292412 15185 leader_election.cc:304] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.292549 15369 tablet_bootstrap.cc:492] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.292521 15380 raft_consensus.cc:515] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.292801 15380 leader_election.cc:290] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.292814 15409 raft_consensus.cc:2804] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.292860 15409 raft_consensus.cc:493] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.292892 15409 raft_consensus.cc:3060] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.293442 15409 raft_consensus.cc:515] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.293646 15369 tablet_bootstrap.cc:654] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.293627 15909 raft_consensus.cc:493] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.293699 15909 raft_consensus.cc:515] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.293697 15409 leader_election.cc:290] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.294011 15909 leader_election.cc:290] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.294039 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8737df10a3c8482c995ac6aadc240c42" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.294121 15113 raft_consensus.cc:3060] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.294410 15380 raft_consensus.cc:493] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.294479 15380 raft_consensus.cc:515] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.294720 15380 leader_election.cc:290] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.294850 15113 raft_consensus.cc:2468] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:26.295006 15380 raft_consensus.cc:493] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.295080 15380 raft_consensus.cc:515] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.295171 15185 leader_election.cc:304] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.295323 15909 raft_consensus.cc:2804] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.295363 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f08d0c3446dd4a478f81688a3259bb91" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.295399 15909 raft_consensus.cc:697] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:26.295485 15113 raft_consensus.cc:2393] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:26.295509 15909 consensus_queue.cc:237] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.296203 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8737df10a3c8482c995ac6aadc240c42" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.296321 14978 raft_consensus.cc:2468] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:26.295373 15380 leader_election.cc:290] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.296761 15464 raft_consensus.cc:493] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.296835 15464 raft_consensus.cc:515] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.297134 15464 leader_election.cc:290] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.297845 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a187a088f5042c081aa87c79662c8cf" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.297942 15247 raft_consensus.cc:2468] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.298045 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74d87666abb643899a7b1e576e6cc840" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.298136 14977 raft_consensus.cc:2468] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.298331 14914 leader_election.cc:304] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.298702 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a187a088f5042c081aa87c79662c8cf" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.298714 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88efe498fb6f4ce1a02b5389ff6f5797" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.298801 15113 raft_consensus.cc:2468] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.298971 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf5008728a6241c096c9a76f8e374ceb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.299054 14978 raft_consensus.cc:3060] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.299297 15464 raft_consensus.cc:2804] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.299351 15464 raft_consensus.cc:493] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.299389 15464 raft_consensus.cc:3060] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.299481 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8737df10a3c8482c995ac6aadc240c42" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.299561 14976 raft_consensus.cc:3060] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.299851 14978 raft_consensus.cc:2468] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.300187 15464 raft_consensus.cc:515] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.300253 14976 raft_consensus.cc:2468] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:26.300455 15372 tablet_bootstrap.cc:492] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.300523 15464 leader_election.cc:290] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.300711 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf5008728a6241c096c9a76f8e374ceb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.300810 15247 raft_consensus.cc:2468] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.300864 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a187a088f5042c081aa87c79662c8cf" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.300944 15248 raft_consensus.cc:3060] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.300978 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f08d0c3446dd4a478f81688a3259bb91" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.301211 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf5008728a6241c096c9a76f8e374ceb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.301292 15246 raft_consensus.cc:3060] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.301492 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0a187a088f5042c081aa87c79662c8cf" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.301580 15113 raft_consensus.cc:3060] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.301775 15248 raft_consensus.cc:2468] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.302038 14914 leader_election.cc:304] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.302067 15246 raft_consensus.cc:2468] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.302275 15464 raft_consensus.cc:2804] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.302338 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88efe498fb6f4ce1a02b5389ff6f5797" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.302366 15464 raft_consensus.cc:697] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.302373 15113 raft_consensus.cc:2468] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.302469 15464 consensus_queue.cc:237] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.302515 15372 ts_tablet_manager.cc:1403] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:26.302583 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74d87666abb643899a7b1e576e6cc840" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.302661 15246 raft_consensus.cc:2468] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.302876 15372 raft_consensus.cc:359] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.302973 15372 raft_consensus.cc:385] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.303009 15372 raft_consensus.cc:740] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.303176 15372 consensus_queue.cc:260] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.303469 15372 ts_tablet_manager.cc:1434] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.303608 15372 tablet_bootstrap.cc:492] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.304457 15372 tablet_bootstrap.cc:654] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.305528 15048 leader_election.cc:304] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
W20251025 08:02:26.305709 15048 leader_election.cc:343] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.305805 15048 leader_election.cc:304] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.305912 15642 raft_consensus.cc:2804] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.305977 15642 raft_consensus.cc:493] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.306011 15642 raft_consensus.cc:3060] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.306819 15642 raft_consensus.cc:515] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.307001 15380 raft_consensus.cc:2804] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.307118 15642 leader_election.cc:290] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.307150 15380 raft_consensus.cc:697] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.307255 15380 consensus_queue.cc:237] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.308055 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74d87666abb643899a7b1e576e6cc840" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.308145 14978 raft_consensus.cc:3060] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.308897 14978 raft_consensus.cc:2468] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.310211 15048 leader_election.cc:304] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.310694 15497 raft_consensus.cc:2804] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.310765 15497 raft_consensus.cc:697] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.310853 15497 consensus_queue.cc:237] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.311028 15380 consensus_queue.cc:1048] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.312189 15369 tablet_bootstrap.cc:492] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.312266 15369 ts_tablet_manager.cc:1403] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.000s
I20251025 08:02:26.312619 15369 raft_consensus.cc:359] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.312716 15369 raft_consensus.cc:385] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.312757 15369 raft_consensus.cc:740] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.312858 15369 consensus_queue.cc:260] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.316138 15246 raft_consensus.cc:3060] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.315917 15183 leader_election.cc:304] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.317144 15909 raft_consensus.cc:3060] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.317919 15909 raft_consensus.cc:2749] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.318444 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "74d87666abb643899a7b1e576e6cc840" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.318543 15246 raft_consensus.cc:3060] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.318733 15369 ts_tablet_manager.cc:1434] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
W20251025 08:02:26.318775 15049 leader_election.cc:343] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.318822 15049 leader_election.cc:304] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.318883 15369 tablet_bootstrap.cc:492] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.319069 15246 raft_consensus.cc:2468] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.319314 15497 raft_consensus.cc:493] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.319386 15497 raft_consensus.cc:515] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.319691 15497 leader_election.cc:290] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.319744 15369 tablet_bootstrap.cc:654] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.319770 15497 raft_consensus.cc:2749] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.319851 15497 consensus_queue.cc:1048] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.320087 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7e8a698e8ba408a833bbc3905b2ad04" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:26.320331 15048 leader_election.cc:343] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.321594 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7e8a698e8ba408a833bbc3905b2ad04" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:26.321833 15049 leader_election.cc:343] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.321892 15049 leader_election.cc:304] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.322088 15380 raft_consensus.cc:2749] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.324761 15369 tablet_bootstrap.cc:492] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.324828 15369 ts_tablet_manager.cc:1403] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:26.325194 15369 raft_consensus.cc:359] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.325274 15369 raft_consensus.cc:385] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.325301 15369 raft_consensus.cc:740] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.325387 15369 consensus_queue.cc:260] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.326442 15909 raft_consensus.cc:493] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.326519 15909 raft_consensus.cc:515] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.326802 15909 leader_election.cc:290] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.326963 15369 ts_tablet_manager.cc:1434] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.327025 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8393462039d4bb4aba66aee9e90b94a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.327112 15369 tablet_bootstrap.cc:492] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.327132 14978 raft_consensus.cc:2393] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:26.327172 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a8393462039d4bb4aba66aee9e90b94a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.327675 15183 leader_election.cc:304] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.327802 15909 raft_consensus.cc:3060] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.328608 15909 raft_consensus.cc:2749] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.328811 15369 tablet_bootstrap.cc:654] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.330631 15369 tablet_bootstrap.cc:492] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.330699 15369 ts_tablet_manager.cc:1403] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:26.331048 15369 raft_consensus.cc:359] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.331128 15369 raft_consensus.cc:385] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.331152 15369 raft_consensus.cc:740] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.331234 15369 consensus_queue.cc:260] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.331434 15369 ts_tablet_manager.cc:1434] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.331580 15369 tablet_bootstrap.cc:492] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.331962 15370 tablet_bootstrap.cc:492] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.332046 15370 ts_tablet_manager.cc:1403] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.045s user 0.001s sys 0.000s
I20251025 08:02:26.332504 15369 tablet_bootstrap.cc:654] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.332448 15370 raft_consensus.cc:359] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.332540 15370 raft_consensus.cc:385] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.332568 15370 raft_consensus.cc:740] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.332677 15370 consensus_queue.cc:260] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.332940 15370 ts_tablet_manager.cc:1434] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.333127 15370 tablet_bootstrap.cc:492] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.333827 15369 tablet_bootstrap.cc:492] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.333894 15369 ts_tablet_manager.cc:1403] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.334318 15369 raft_consensus.cc:359] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.334401 15369 raft_consensus.cc:385] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.334434 15369 raft_consensus.cc:740] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.334522 15369 consensus_queue.cc:260] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.334758 15369 ts_tablet_manager.cc:1434] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.334159 15370 tablet_bootstrap.cc:654] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.336932 15380 raft_consensus.cc:493] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.337010 15380 raft_consensus.cc:515] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.337256 15369 tablet_bootstrap.cc:492] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.337350 15380 leader_election.cc:290] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.338160 15369 tablet_bootstrap.cc:654] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.339448 15370 tablet_bootstrap.cc:492] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.339529 15370 ts_tablet_manager.cc:1403] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251025 08:02:26.339828 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf90d2e477b9493e9b78aae6a7d2d3e0" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.339933 15248 raft_consensus.cc:2468] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.339926 15370 raft_consensus.cc:359] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.340004 15370 raft_consensus.cc:385] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.340034 15370 raft_consensus.cc:740] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.340130 15370 consensus_queue.cc:260] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.340227 15049 leader_election.cc:304] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.340400 15370 ts_tablet_manager.cc:1434] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.340444 15642 raft_consensus.cc:2804] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.340493 15642 raft_consensus.cc:493] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.340530 15642 raft_consensus.cc:3060] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.340554 15370 tablet_bootstrap.cc:492] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.341372 15642 raft_consensus.cc:515] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.341682 15642 leader_election.cc:290] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.341850 15370 tablet_bootstrap.cc:654] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.342231 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf90d2e477b9493e9b78aae6a7d2d3e0" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.342326 14976 raft_consensus.cc:2468] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.344097 15246 raft_consensus.cc:3060] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.344278 15372 tablet_bootstrap.cc:492] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.344347 15372 ts_tablet_manager.cc:1403] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.041s user 0.001s sys 0.000s
I20251025 08:02:26.344563 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf90d2e477b9493e9b78aae6a7d2d3e0" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.344641 15248 raft_consensus.cc:3060] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.344762 15372 raft_consensus.cc:359] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.344835 15372 raft_consensus.cc:385] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.344861 15372 raft_consensus.cc:740] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.344960 15372 consensus_queue.cc:260] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.345440 15248 raft_consensus.cc:2468] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.345599 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cf90d2e477b9493e9b78aae6a7d2d3e0" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.345674 14976 raft_consensus.cc:3060] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.346537 14976 raft_consensus.cc:2468] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.346946 15048 leader_election.cc:304] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.347133 15380 raft_consensus.cc:2804] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.347225 15380 raft_consensus.cc:697] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.347352 15380 consensus_queue.cc:237] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.348057 15372 ts_tablet_manager.cc:1434] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:26.348232 15372 tablet_bootstrap.cc:492] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.349576 15369 tablet_bootstrap.cc:492] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.349645 15369 ts_tablet_manager.cc:1403] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20251025 08:02:26.350028 15369 raft_consensus.cc:359] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.350118 15369 raft_consensus.cc:385] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.350145 15369 raft_consensus.cc:740] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.350227 15372 tablet_bootstrap.cc:654] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.350271 15369 consensus_queue.cc:260] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.350567 15369 ts_tablet_manager.cc:1434] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.350733 15369 tablet_bootstrap.cc:492] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.351536 15369 tablet_bootstrap.cc:654] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.350033 15374 raft_consensus.cc:493] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.352242 15374 raft_consensus.cc:515] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.352504 15374 leader_election.cc:290] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.353024 15370 tablet_bootstrap.cc:492] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.353101 15370 ts_tablet_manager.cc:1403] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.001s
I20251025 08:02:26.353191 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72ff369b973b4c5981ea0810e37e8562" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.353346 15246 raft_consensus.cc:2468] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.353545 15370 raft_consensus.cc:359] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.353633 15370 raft_consensus.cc:385] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.353624 14914 leader_election.cc:304] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.353662 15370 raft_consensus.cc:740] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.353757 15370 consensus_queue.cc:260] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.353834 15374 raft_consensus.cc:2804] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.353873 15374 raft_consensus.cc:493] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.353905 15374 raft_consensus.cc:3060] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.354034 15370 ts_tablet_manager.cc:1434] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:26.354238 15370 tablet_bootstrap.cc:492] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.355047 15374 raft_consensus.cc:515] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.355154 15370 tablet_bootstrap.cc:654] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.355374 15374 leader_election.cc:290] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.355665 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72ff369b973b4c5981ea0810e37e8562" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.355763 15113 raft_consensus.cc:2468] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.355839 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72ff369b973b4c5981ea0810e37e8562" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.355902 15380 consensus_queue.cc:1048] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.355928 15248 raft_consensus.cc:3060] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.356734 15248 raft_consensus.cc:2468] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.357052 14914 leader_election.cc:304] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.357224 15374 raft_consensus.cc:2804] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.357308 15374 raft_consensus.cc:697] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.357395 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "72ff369b973b4c5981ea0810e37e8562" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.357412 15374 consensus_queue.cc:237] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.357476 15113 raft_consensus.cc:3060] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.358322 15113 raft_consensus.cc:2468] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.358933 15369 tablet_bootstrap.cc:492] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.359012 15369 ts_tablet_manager.cc:1403] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251025 08:02:26.359336 15369 raft_consensus.cc:359] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.359411 15369 raft_consensus.cc:385] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.359436 15369 raft_consensus.cc:740] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.359509 15369 consensus_queue.cc:260] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.359730 15369 ts_tablet_manager.cc:1434] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.359885 15369 tablet_bootstrap.cc:492] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.360659 15369 tablet_bootstrap.cc:654] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.363821 15372 tablet_bootstrap.cc:492] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.363893 15372 ts_tablet_manager.cc:1403] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20251025 08:02:26.363906 15369 tablet_bootstrap.cc:492] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.363970 15369 ts_tablet_manager.cc:1403] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:26.364107 16078 raft_consensus.cc:493] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.364192 16078 raft_consensus.cc:515] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.364339 15369 raft_consensus.cc:359] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.364342 15372 raft_consensus.cc:359] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.364418 15369 raft_consensus.cc:385] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.364418 15372 raft_consensus.cc:385] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.364449 15369 raft_consensus.cc:740] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.364513 16078 leader_election.cc:290] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.364567 15372 raft_consensus.cc:740] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.364548 15369 consensus_queue.cc:260] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.364708 15372 consensus_queue.cc:260] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.364784 15369 ts_tablet_manager.cc:1434] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.364917 15369 tablet_bootstrap.cc:492] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.365005 15372 ts_tablet_manager.cc:1434] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.365137 15372 tablet_bootstrap.cc:492] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.365792 15369 tablet_bootstrap.cc:654] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.366196 15372 tablet_bootstrap.cc:654] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.367139 15370 tablet_bootstrap.cc:492] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.367215 15370 ts_tablet_manager.cc:1403] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20251025 08:02:26.367439 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "346c0c8bf30b4dbaa92436b45e5fbf47" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.367607 15370 raft_consensus.cc:359] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.367632 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "346c0c8bf30b4dbaa92436b45e5fbf47" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.367681 15370 raft_consensus.cc:385] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.367707 15370 raft_consensus.cc:740] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.367791 15370 consensus_queue.cc:260] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.367995 15370 ts_tablet_manager.cc:1434] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.368158 15370 tablet_bootstrap.cc:492] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.369517 15370 tablet_bootstrap.cc:654] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.370378 15370 tablet_bootstrap.cc:492] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.370442 15370 ts_tablet_manager.cc:1403] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.370760 15370 raft_consensus.cc:359] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.370824 15370 raft_consensus.cc:385] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.370847 15370 raft_consensus.cc:740] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.370929 15370 consensus_queue.cc:260] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:26.371050 15049 leader_election.cc:343] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.371160 15370 ts_tablet_manager.cc:1434] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.371419 15370 tablet_bootstrap.cc:492] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.372143 15370 tablet_bootstrap.cc:654] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.373093 15370 tablet_bootstrap.cc:492] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.373165 15370 ts_tablet_manager.cc:1403] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.373525 15370 raft_consensus.cc:359] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.373621 15370 raft_consensus.cc:385] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.373656 15370 raft_consensus.cc:740] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.373772 15370 consensus_queue.cc:260] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:26.374029 15048 leader_election.cc:343] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.374087 15048 leader_election.cc:304] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.374115 15370 ts_tablet_manager.cc:1434] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.374215 15380 raft_consensus.cc:2749] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.374297 15370 tablet_bootstrap.cc:492] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.374775 15372 tablet_bootstrap.cc:492] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.374861 15372 ts_tablet_manager.cc:1403] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:26.375197 15372 raft_consensus.cc:359] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.375280 15372 raft_consensus.cc:385] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.375293 15370 tablet_bootstrap.cc:654] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.375308 15372 raft_consensus.cc:740] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.375427 15372 consensus_queue.cc:260] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.375731 15372 ts_tablet_manager.cc:1434] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.375990 15372 tablet_bootstrap.cc:492] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.376191 15409 raft_consensus.cc:493] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.376255 15409 raft_consensus.cc:515] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.376488 15409 leader_election.cc:290] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:26.377055 15185 leader_election.cc:343] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 4dd72f76c950485c968409fe868266a2
I20251025 08:02:26.377434 15372 tablet_bootstrap.cc:654] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:26.379447 15183 leader_election.cc:343] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 4dd72f76c950485c968409fe868266a2
I20251025 08:02:26.379519 15183 leader_election.cc:304] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.379640 15409 raft_consensus.cc:2749] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.382369 15246 raft_consensus.cc:3060] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.383869 15783 tablet.cc:1722] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:26.388834 15369 tablet_bootstrap.cc:492] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.388900 15369 ts_tablet_manager.cc:1403] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20251025 08:02:26.389284 15369 raft_consensus.cc:359] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.389364 15369 raft_consensus.cc:385] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.389387 15369 raft_consensus.cc:740] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.389393 15372 tablet_bootstrap.cc:492] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.389457 15372 ts_tablet_manager.cc:1403] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20251025 08:02:26.389467 15369 consensus_queue.cc:260] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.389671 15369 ts_tablet_manager.cc:1434] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:26.389839 15369 tablet_bootstrap.cc:492] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.389842 15372 raft_consensus.cc:359] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.389925 15372 raft_consensus.cc:385] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.389976 15372 raft_consensus.cc:740] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.390055 15372 consensus_queue.cc:260] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.390308 15372 ts_tablet_manager.cc:1434] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.390442 15372 tablet_bootstrap.cc:492] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.390771 15369 tablet_bootstrap.cc:654] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.391301 15372 tablet_bootstrap.cc:654] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.392318 15372 tablet_bootstrap.cc:492] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.392402 15372 ts_tablet_manager.cc:1403] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.392748 15372 raft_consensus.cc:359] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.392832 15372 raft_consensus.cc:385] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.392861 15372 raft_consensus.cc:740] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.392944 15372 consensus_queue.cc:260] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.393172 15372 ts_tablet_manager.cc:1434] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.393321 15372 tablet_bootstrap.cc:492] T adc14c254b0c4974bfbadede727b6c6b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.394142 15372 tablet_bootstrap.cc:654] T adc14c254b0c4974bfbadede727b6c6b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.395617 15380 raft_consensus.cc:493] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.395697 15380 raft_consensus.cc:515] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.396019 15380 leader_election.cc:290] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.396209 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20a3581bd02143bd8a6bdf8e17072faf" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.396297 15246 raft_consensus.cc:2468] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.396433 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20a3581bd02143bd8a6bdf8e17072faf" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.396519 14976 raft_consensus.cc:2468] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.396719 15049 leader_election.cc:304] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.396850 15380 raft_consensus.cc:2804] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.396901 15380 raft_consensus.cc:493] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.396936 15380 raft_consensus.cc:3060] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.398800 15369 tablet_bootstrap.cc:492] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.398880 15369 ts_tablet_manager.cc:1403] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20251025 08:02:26.399297 15369 raft_consensus.cc:359] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.399369 15369 raft_consensus.cc:385] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.399401 15369 raft_consensus.cc:740] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.399502 15369 consensus_queue.cc:260] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.399709 15369 ts_tablet_manager.cc:1434] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.399865 15369 tablet_bootstrap.cc:492] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.400641 15369 tablet_bootstrap.cc:654] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.402232 15409 raft_consensus.cc:493] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.402300 15409 raft_consensus.cc:515] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.402554 15409 leader_election.cc:290] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.402889 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "801d06a391e34bec8e1f74257937f069" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.402977 15113 raft_consensus.cc:2468] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:26.403268 15185 leader_election.cc:304] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.403394 15409 raft_consensus.cc:2804] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.403426 15409 raft_consensus.cc:493] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.403455 15409 raft_consensus.cc:3060] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.404170 15409 raft_consensus.cc:515] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.404431 15409 leader_election.cc:290] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.404856 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "801d06a391e34bec8e1f74257937f069" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.404917 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "801d06a391e34bec8e1f74257937f069" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.404980 15113 raft_consensus.cc:3060] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.405006 14976 raft_consensus.cc:2468] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:26.405009 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "801d06a391e34bec8e1f74257937f069" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.405123 14978 raft_consensus.cc:3060] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.405730 14978 raft_consensus.cc:2468] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:26.406049 15183 leader_election.cc:304] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.406268 15409 raft_consensus.cc:2804] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.406355 15409 raft_consensus.cc:697] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:26.406466 15409 consensus_queue.cc:237] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.406710 15369 tablet_bootstrap.cc:492] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.406772 15369 ts_tablet_manager.cc:1403] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20251025 08:02:26.406807 15372 tablet_bootstrap.cc:492] T adc14c254b0c4974bfbadede727b6c6b P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.406870 15372 ts_tablet_manager.cc:1403] T adc14c254b0c4974bfbadede727b6c6b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20251025 08:02:26.407008 15380 raft_consensus.cc:515] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.407155 15369 raft_consensus.cc:359] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.407250 15369 raft_consensus.cc:385] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.407284 15369 raft_consensus.cc:740] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.407248 15372 raft_consensus.cc:359] T adc14c254b0c4974bfbadede727b6c6b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.407330 15372 raft_consensus.cc:385] T adc14c254b0c4974bfbadede727b6c6b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.407362 15372 raft_consensus.cc:740] T adc14c254b0c4974bfbadede727b6c6b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.407402 15369 consensus_queue.cc:260] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.407454 15380 leader_election.cc:290] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.407497 15372 consensus_queue.cc:260] T adc14c254b0c4974bfbadede727b6c6b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.407646 15369 ts_tablet_manager.cc:1434] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.407836 15369 tablet_bootstrap.cc:492] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.407884 15113 raft_consensus.cc:2468] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:26.408337 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20a3581bd02143bd8a6bdf8e17072faf" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.408443 15246 raft_consensus.cc:3060] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.408504 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "20a3581bd02143bd8a6bdf8e17072faf" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.408586 14978 raft_consensus.cc:3060] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.408736 15369 tablet_bootstrap.cc:654] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.409264 15246 raft_consensus.cc:2468] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.409351 14978 raft_consensus.cc:2468] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.409639 15048 leader_election.cc:304] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.409788 15380 raft_consensus.cc:2804] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.409858 15380 raft_consensus.cc:697] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.409971 15380 consensus_queue.cc:237] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.411054 15372 ts_tablet_manager.cc:1434] T adc14c254b0c4974bfbadede727b6c6b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20251025 08:02:26.411228 15372 tablet_bootstrap.cc:492] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.412578 15372 tablet_bootstrap.cc:654] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.413365 15372 tablet_bootstrap.cc:492] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.413426 15372 ts_tablet_manager.cc:1403] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:26.413759 15370 tablet_bootstrap.cc:492] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.413786 15372 raft_consensus.cc:359] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.413869 15372 raft_consensus.cc:385] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.413898 15372 raft_consensus.cc:740] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.413980 15370 ts_tablet_manager.cc:1403] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20251025 08:02:26.413993 15372 consensus_queue.cc:260] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.414208 15372 ts_tablet_manager.cc:1434] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.414343 15372 tablet_bootstrap.cc:492] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.415196 15372 tablet_bootstrap.cc:654] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.415293 15370 raft_consensus.cc:359] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.415428 15370 raft_consensus.cc:385] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.415498 15370 raft_consensus.cc:740] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.415665 15370 consensus_queue.cc:260] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.416018 15370 ts_tablet_manager.cc:1434] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:26.416250 15370 tablet_bootstrap.cc:492] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:26.417474 15372 tablet_bootstrap.cc:492] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.417537 15372 ts_tablet_manager.cc:1403] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:26.417869 15372 raft_consensus.cc:359] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.417959 15372 raft_consensus.cc:385] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.417990 15372 raft_consensus.cc:740] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.418097 15372 consensus_queue.cc:260] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.418363 15372 ts_tablet_manager.cc:1434] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:26.418509 15372 tablet_bootstrap.cc:492] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.418663 15369 tablet_bootstrap.cc:492] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.418736 15369 ts_tablet_manager.cc:1403] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20251025 08:02:26.419111 15369 raft_consensus.cc:359] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.419224 15369 raft_consensus.cc:385] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.419271 15369 raft_consensus.cc:740] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.419322 15372 tablet_bootstrap.cc:654] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.419387 15369 consensus_queue.cc:260] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.419649 15369 ts_tablet_manager.cc:1434] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.419831 15369 tablet_bootstrap.cc:492] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.420210 15909 raft_consensus.cc:493] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.420282 15909 raft_consensus.cc:515] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.420570 15909 leader_election.cc:290] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.420661 15369 tablet_bootstrap.cc:654] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.420723 15370 tablet_bootstrap.cc:654] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.422856 15369 tablet_bootstrap.cc:492] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.422930 15369 ts_tablet_manager.cc:1403] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:26.423265 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43da3f4fc9604562a95dff59da3c574b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.423314 15369 raft_consensus.cc:359] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.423379 15369 raft_consensus.cc:385] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.423408 15369 raft_consensus.cc:740] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.423447 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "43da3f4fc9604562a95dff59da3c574b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.423516 15369 consensus_queue.cc:260] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.423561 14978 raft_consensus.cc:2393] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:26.423740 15369 ts_tablet_manager.cc:1434] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.423887 15369 tablet_bootstrap.cc:492] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.424314 15183 leader_election.cc:304] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.424491 15909 raft_consensus.cc:3060] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.424755 15369 tablet_bootstrap.cc:654] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.425486 15909 raft_consensus.cc:2749] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.428625 15370 tablet_bootstrap.cc:492] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:26.428705 15370 ts_tablet_manager.cc:1403] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20251025 08:02:26.429133 15370 raft_consensus.cc:359] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.429222 15370 raft_consensus.cc:385] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.429256 15370 raft_consensus.cc:740] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.429363 15370 consensus_queue.cc:260] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.430346 15464 raft_consensus.cc:493] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.430413 15464 raft_consensus.cc:515] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.430675 15464 leader_election.cc:290] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.431034 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "821de6815eb244058f1d8a7a06bf48a6" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.431155 15370 ts_tablet_manager.cc:1434] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:26.431244 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "821de6815eb244058f1d8a7a06bf48a6" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.431337 15113 raft_consensus.cc:2468] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
W20251025 08:02:26.431394 14914 leader_election.cc:343] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.431900 14915 leader_election.cc:304] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.432070 15464 raft_consensus.cc:2804] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.432128 15464 raft_consensus.cc:493] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.432169 15464 raft_consensus.cc:3060] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.432752 15372 tablet_bootstrap.cc:492] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.432869 15372 ts_tablet_manager.cc:1403] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20251025 08:02:26.432968 15464 raft_consensus.cc:515] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.433254 15464 leader_election.cc:290] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.433276 15372 raft_consensus.cc:359] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.433373 15372 raft_consensus.cc:385] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.433408 15372 raft_consensus.cc:740] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.433513 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "821de6815eb244058f1d8a7a06bf48a6" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.433511 15372 consensus_queue.cc:260] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.433765 15372 ts_tablet_manager.cc:1434] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.433938 15372 tablet_bootstrap.cc:492] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.434825 15372 tablet_bootstrap.cc:654] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:26.435757 14914 leader_election.cc:343] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.435887 15372 tablet_bootstrap.cc:492] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.435946 15372 ts_tablet_manager.cc:1403] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.436282 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "821de6815eb244058f1d8a7a06bf48a6" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.436376 15113 raft_consensus.cc:3060] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.437193 15113 raft_consensus.cc:2468] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.438057 14915 leader_election.cc:304] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.438355 15464 raft_consensus.cc:2804] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.438429 15464 raft_consensus.cc:697] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.438522 15464 consensus_queue.cc:237] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.438663 15246 raft_consensus.cc:3060] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.438958 15380 consensus_queue.cc:1048] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.440207 15374 raft_consensus.cc:493] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.440274 15374 raft_consensus.cc:515] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.440392 15783 tablet.cc:1722] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:26.440510 15374 leader_election.cc:290] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.440641 15372 raft_consensus.cc:359] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.440716 15372 raft_consensus.cc:385] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.440752 15372 raft_consensus.cc:740] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.440841 15372 consensus_queue.cc:260] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.441126 15372 ts_tablet_manager.cc:1434] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:26.442054 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88efe498fb6f4ce1a02b5389ff6f5797" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.442139 15248 raft_consensus.cc:2468] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.442540 14914 leader_election.cc:304] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.442631 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88efe498fb6f4ce1a02b5389ff6f5797" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.442699 15374 raft_consensus.cc:2804] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.442711 15113 raft_consensus.cc:2468] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.442744 15374 raft_consensus.cc:493] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.442787 15374 raft_consensus.cc:3060] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.442883 15372 tablet_bootstrap.cc:492] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.443674 15374 raft_consensus.cc:515] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.443794 15372 tablet_bootstrap.cc:654] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.443990 15374 leader_election.cc:290] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.445063 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88efe498fb6f4ce1a02b5389ff6f5797" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.445142 15248 raft_consensus.cc:3060] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.445873 15248 raft_consensus.cc:2468] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.446478 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88efe498fb6f4ce1a02b5389ff6f5797" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.446569 15113 raft_consensus.cc:3060] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.446844 14914 leader_election.cc:304] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.447052 15380 consensus_queue.cc:1048] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.447089 15464 raft_consensus.cc:2804] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.447161 15464 raft_consensus.cc:697] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.447259 15464 consensus_queue.cc:237] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.447356 15113 raft_consensus.cc:2468] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.449260 15864 raft_consensus.cc:493] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.449328 15864 raft_consensus.cc:515] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.449613 15864 leader_election.cc:290] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.451323 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f585455b77df49738b44c31a3d7adb71" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.451452 15248 raft_consensus.cc:2393] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:26.451579 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f585455b77df49738b44c31a3d7adb71" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.453157 15372 tablet_bootstrap.cc:492] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.453348 15248 raft_consensus.cc:3060] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.453352 15380 raft_consensus.cc:493] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.453409 15380 raft_consensus.cc:515] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.453697 15380 leader_election.cc:290] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.453254 15372 ts_tablet_manager.cc:1403] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:26.453882 14915 leader_election.cc:304] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.454070 15374 raft_consensus.cc:3060] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.454409 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f3163f8a4ff49069d55b9acf8a4c19a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.454492 15247 raft_consensus.cc:2468] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.454293 15372 raft_consensus.cc:359] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.454660 15372 raft_consensus.cc:385] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.454705 15372 raft_consensus.cc:740] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.454807 15372 consensus_queue.cc:260] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.454857 15374 raft_consensus.cc:2749] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.455220 15049 leader_election.cc:304] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.455380 15497 raft_consensus.cc:2804] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.455421 15497 raft_consensus.cc:493] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.455454 15497 raft_consensus.cc:3060] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.455628 15374 consensus_queue.cc:1048] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.455647 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f3163f8a4ff49069d55b9acf8a4c19a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.455930 14978 raft_consensus.cc:2468] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.456282 15497 raft_consensus.cc:515] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.456588 15497 leader_election.cc:290] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.456669 15497 raft_consensus.cc:493] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.456735 15497 raft_consensus.cc:515] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.457021 15497 leader_election.cc:290] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.457345 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f3163f8a4ff49069d55b9acf8a4c19a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.457365 15372 ts_tablet_manager.cc:1434] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:26.457429 14978 raft_consensus.cc:3060] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.458003 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a608dd2b2d1d42178bb00b3355bd6470" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.458086 14976 raft_consensus.cc:2468] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.458272 14978 raft_consensus.cc:2468] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.458772 15380 raft_consensus.cc:493] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.458799 15048 leader_election.cc:304] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.458863 15380 raft_consensus.cc:515] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.458950 15048 leader_election.cc:304] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.459187 15380 leader_election.cc:290] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.459312 15380 raft_consensus.cc:2804] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.459359 15380 raft_consensus.cc:493] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.459404 15380 raft_consensus.cc:3060] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.459545 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c9778bd0d94542bec79e9d36c6ce46" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.459642 14978 raft_consensus.cc:2468] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.460223 15380 raft_consensus.cc:515] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.460517 15380 leader_election.cc:290] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.460613 15380 raft_consensus.cc:2804] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.460683 15380 raft_consensus.cc:697] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.460786 15380 consensus_queue.cc:237] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.461957 15048 leader_election.cc:304] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.462463 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a608dd2b2d1d42178bb00b3355bd6470" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.462555 14978 raft_consensus.cc:3060] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.463061 14978 raft_consensus.cc:2468] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.464286 15048 leader_election.cc:304] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.466251 16078 raft_consensus.cc:2804] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.466311 16078 raft_consensus.cc:493] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.466347 16078 raft_consensus.cc:3060] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.467214 16078 raft_consensus.cc:515] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.467542 16078 leader_election.cc:290] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.467625 16078 raft_consensus.cc:2804] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.467676 16078 raft_consensus.cc:697] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.467772 16078 consensus_queue.cc:237] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.467965 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c9778bd0d94542bec79e9d36c6ce46" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.468060 14978 raft_consensus.cc:3060] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.468099 15369 tablet_bootstrap.cc:492] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.468161 15369 ts_tablet_manager.cc:1403] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.044s user 0.001s sys 0.000s
I20251025 08:02:26.468566 15369 raft_consensus.cc:359] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.468654 15369 raft_consensus.cc:385] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.468694 15369 raft_consensus.cc:740] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.468775 14978 raft_consensus.cc:2468] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.468829 15369 consensus_queue.cc:260] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.469080 15369 ts_tablet_manager.cc:1434] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.469271 15369 tablet_bootstrap.cc:492] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.469524 15048 leader_election.cc:304] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.469673 15380 raft_consensus.cc:2804] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.469753 15380 raft_consensus.cc:697] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.469858 15380 consensus_queue.cc:237] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.470144 15369 tablet_bootstrap.cc:654] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.470664 15372 tablet_bootstrap.cc:492] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.470762 15245 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a608dd2b2d1d42178bb00b3355bd6470" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.472114 15244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c9778bd0d94542bec79e9d36c6ce46" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.472174 15245 raft_consensus.cc:2468] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.472210 15244 raft_consensus.cc:3060] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.470822 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4f3163f8a4ff49069d55b9acf8a4c19a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.472313 15248 raft_consensus.cc:3060] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.473049 15244 raft_consensus.cc:2468] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.473130 15248 raft_consensus.cc:2468] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.473431 15374 raft_consensus.cc:493] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.473500 15374 raft_consensus.cc:515] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.473769 15374 leader_election.cc:290] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.473845 15372 tablet_bootstrap.cc:654] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.474552 16078 raft_consensus.cc:493] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.474618 16078 raft_consensus.cc:515] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.474915 16078 leader_election.cc:290] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.475208 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "080d77feb2a242959fb8e375f07e5a5f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.475296 15111 raft_consensus.cc:2468] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.476348 15374 consensus_queue.cc:1048] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.477011 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "080d77feb2a242959fb8e375f07e5a5f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.477084 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1aa4677de4604abaa2dc6e5413c616a3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.477111 15246 raft_consensus.cc:2468] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.477164 14978 raft_consensus.cc:2468] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.471985 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a608dd2b2d1d42178bb00b3355bd6470" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.477249 15249 raft_consensus.cc:3060] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.477385 15048 leader_election.cc:304] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.471844 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95c9778bd0d94542bec79e9d36c6ce46" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.477766 15247 raft_consensus.cc:2376] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1. Re-sending same reply.
I20251025 08:02:26.477990 14914 leader_election.cc:304] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.478034 15249 raft_consensus.cc:2468] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.478174 15464 raft_consensus.cc:2804] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.478237 15464 raft_consensus.cc:493] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.478272 15464 raft_consensus.cc:3060] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.478677 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1aa4677de4604abaa2dc6e5413c616a3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.478770 15246 raft_consensus.cc:2468] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.478905 16078 raft_consensus.cc:2804] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.478953 16078 raft_consensus.cc:493] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.478988 16078 raft_consensus.cc:3060] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.479130 15464 raft_consensus.cc:515] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.479426 15464 leader_election.cc:290] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.479741 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "080d77feb2a242959fb8e375f07e5a5f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.479832 15113 raft_consensus.cc:3060] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.480693 15113 raft_consensus.cc:2468] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.480893 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "080d77feb2a242959fb8e375f07e5a5f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.480947 14915 leader_election.cc:304] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.480981 15246 raft_consensus.cc:3060] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.481292 15369 tablet_bootstrap.cc:492] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.481354 15369 ts_tablet_manager.cc:1403] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20251025 08:02:26.481781 15246 raft_consensus.cc:2468] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.481757 15369 raft_consensus.cc:359] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.481841 15369 raft_consensus.cc:385] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.481868 15369 raft_consensus.cc:740] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.481948 16078 raft_consensus.cc:515] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.481997 15369 consensus_queue.cc:260] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.482156 15445 raft_consensus.cc:2804] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.482234 15445 raft_consensus.cc:697] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.482368 15445 consensus_queue.cc:237] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.482429 16078 leader_election.cc:290] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.482741 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1aa4677de4604abaa2dc6e5413c616a3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.482824 15246 raft_consensus.cc:3060] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.483574 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1aa4677de4604abaa2dc6e5413c616a3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.483632 15246 raft_consensus.cc:2468] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.483659 14978 raft_consensus.cc:3060] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.484349 14978 raft_consensus.cc:2468] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.485873 15049 leader_election.cc:304] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.485944 15374 raft_consensus.cc:493] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.486025 15374 raft_consensus.cc:515] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.486296 15374 leader_election.cc:290] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.487061 15497 raft_consensus.cc:493] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.487123 15497 raft_consensus.cc:515] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.487375 15497 leader_election.cc:290] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.487516 15497 raft_consensus.cc:2804] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.487574 15497 raft_consensus.cc:697] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.487671 15497 consensus_queue.cc:237] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.488241 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adc14c254b0c4974bfbadede727b6c6b" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.488327 15113 raft_consensus.cc:2468] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.488732 14915 leader_election.cc:304] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.489107 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adc14c254b0c4974bfbadede727b6c6b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.489207 15249 raft_consensus.cc:2468] T adc14c254b0c4974bfbadede727b6c6b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.489498 15464 raft_consensus.cc:2804] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.489544 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adc14c254b0c4974bfbadede727b6c6b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.489544 16078 consensus_queue.cc:1048] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.489809 15049 leader_election.cc:304] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.490161 15642 raft_consensus.cc:2804] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.490238 15642 raft_consensus.cc:493] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.490283 15642 raft_consensus.cc:3060] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.491044 16132 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 94a96657c5fd49398b88e9ad615bfe1e)
I20251025 08:02:26.491065 15642 raft_consensus.cc:515] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.491170 16132 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:26.489559 15464 raft_consensus.cc:493] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.491343 15464 raft_consensus.cc:3060] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.491375 15642 leader_election.cc:290] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.491449 15642 consensus_queue.cc:1048] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.492025 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adc14c254b0c4974bfbadede727b6c6b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.492101 15247 raft_consensus.cc:3060] T adc14c254b0c4974bfbadede727b6c6b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.492133 15464 raft_consensus.cc:515] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.492444 15464 leader_election.cc:290] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.492594 14978 raft_consensus.cc:2393] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:26.492821 15247 raft_consensus.cc:2468] T adc14c254b0c4974bfbadede727b6c6b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.493085 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adc14c254b0c4974bfbadede727b6c6b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.493186 14977 raft_consensus.cc:2393] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:26.494323 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adc14c254b0c4974bfbadede727b6c6b" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.494423 15246 raft_consensus.cc:2393] T adc14c254b0c4974bfbadede727b6c6b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:26.494547 15369 ts_tablet_manager.cc:1434] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20251025 08:02:26.494709 15369 tablet_bootstrap.cc:492] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.494908 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adc14c254b0c4974bfbadede727b6c6b" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.495004 15113 raft_consensus.cc:2393] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:26.495572 15369 tablet_bootstrap.cc:654] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.495599 15409 raft_consensus.cc:493] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.495663 15409 raft_consensus.cc:515] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.495776 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adc14c254b0c4974bfbadede727b6c6b" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.495884 15246 raft_consensus.cc:2393] T adc14c254b0c4974bfbadede727b6c6b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:26.495898 15409 leader_election.cc:290] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.496704 15049 leader_election.cc:304] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:26.496987 15380 raft_consensus.cc:2804] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.497061 15380 raft_consensus.cc:697] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.497148 15380 consensus_queue.cc:237] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.497486 14914 leader_election.cc:304] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.497654 15374 raft_consensus.cc:2749] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.497911 15409 raft_consensus.cc:493] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.497997 15409 raft_consensus.cc:515] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.498303 15409 leader_election.cc:290] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:26.499173 15185 leader_election.cc:343] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: ff82c6ab12c844339dd387569fb85526
I20251025 08:02:26.499420 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76a906654cc44bfb96d9e1a936040e57" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.499522 15113 raft_consensus.cc:2393] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:26.500885 16131 raft_consensus.cc:493] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 94a96657c5fd49398b88e9ad615bfe1e)
I20251025 08:02:26.500950 16131 raft_consensus.cc:515] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:26.501221 16131 leader_election.cc:290] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 94a96657c5fd49398b88e9ad615bfe1e (127.14.70.62:39499), 7109d31951574de3bf05a86c94c11d21 (127.14.70.60:34453)
I20251025 08:02:26.502916 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff82c6ab12c844339dd387569fb85526" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.503016 14978 raft_consensus.cc:2468] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:26.503026 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76a906654cc44bfb96d9e1a936040e57" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.504110 15183 leader_election.cc:304] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.504274 15183 leader_election.cc:304] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.504329 15909 raft_consensus.cc:493] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.504376 15384 raft_consensus.cc:2804] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.504391 15909 raft_consensus.cc:515] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.504426 15384 raft_consensus.cc:493] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.504496 15409 raft_consensus.cc:3060] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.504510 15384 raft_consensus.cc:3060] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.504690 15909 leader_election.cc:290] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.505231 15409 raft_consensus.cc:2749] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.505311 15384 raft_consensus.cc:515] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.505539 15384 leader_election.cc:290] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.505594 16132 leader_election.cc:290] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 94a96657c5fd49398b88e9ad615bfe1e (127.14.70.62:39499), 33b7e3c702ec44079d8b76a0ce6bae97 (127.14.70.61:44347)
W20251025 08:02:26.505790 15185 leader_election.cc:343] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: e54e57e850564e079db3dd383347ed30
I20251025 08:02:26.506165 15372 tablet_bootstrap.cc:492] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.506266 15372 ts_tablet_manager.cc:1403] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20251025 08:02:26.506246 15464 raft_consensus.cc:493] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.506317 15464 raft_consensus.cc:515] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.506407 14737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7109d31951574de3bf05a86c94c11d21" candidate_term: 3 candidate_status { last_received { term: 2 index: 402 } } ignore_live_leader: false dest_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" is_pre_election: true
I20251025 08:02:26.506529 14737 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7109d31951574de3bf05a86c94c11d21 for term 3 because replica has last-logged OpId of term: 2 index: 404, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 402.
I20251025 08:02:26.506606 15464 leader_election.cc:290] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:26.506610 15185 leader_election.cc:343] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: ff82c6ab12c844339dd387569fb85526
I20251025 08:02:26.506675 15372 raft_consensus.cc:359] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.506745 15372 raft_consensus.cc:385] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.506778 15372 raft_consensus.cc:740] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.506875 15372 consensus_queue.cc:260] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.506916 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff82c6ab12c844339dd387569fb85526" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.506994 14978 raft_consensus.cc:3060] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.507128 15372 ts_tablet_manager.cc:1434] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.507103 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2091a81ad64a4574b04c081bdeceda1f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.507195 15111 raft_consensus.cc:2468] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.507298 15372 tablet_bootstrap.cc:492] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.507493 14915 leader_election.cc:304] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.507678 14978 raft_consensus.cc:2468] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
W20251025 08:02:26.507997 15183 leader_election.cc:343] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: e54e57e850564e079db3dd383347ed30
I20251025 08:02:26.508059 15183 leader_election.cc:304] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.508286 15372 tablet_bootstrap.cc:654] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.508396 15384 raft_consensus.cc:2749] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.508639 15183 leader_election.cc:304] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.508765 15384 raft_consensus.cc:2804] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.508837 15384 raft_consensus.cc:697] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:26.508937 15384 consensus_queue.cc:237] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.509438 15384 raft_consensus.cc:493] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.509507 15384 raft_consensus.cc:515] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.509577 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2091a81ad64a4574b04c081bdeceda1f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.509642 15249 raft_consensus.cc:2468] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.509773 15384 leader_election.cc:290] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.509876 15464 raft_consensus.cc:2804] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.509917 15464 raft_consensus.cc:493] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.509970 15464 raft_consensus.cc:3060] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.510706 15464 raft_consensus.cc:515] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.511008 15464 leader_election.cc:290] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.511910 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2091a81ad64a4574b04c081bdeceda1f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.512007 15111 raft_consensus.cc:3060] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.512171 16078 raft_consensus.cc:493] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.512239 16078 raft_consensus.cc:515] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.512502 16078 leader_election.cc:290] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.512777 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2091a81ad64a4574b04c081bdeceda1f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.512823 15111 raft_consensus.cc:2468] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.512857 15249 raft_consensus.cc:3060] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.513685 15249 raft_consensus.cc:2468] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.513836 14915 leader_election.cc:304] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.513958 15464 raft_consensus.cc:2804] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.514020 15464 raft_consensus.cc:697] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.514119 15464 consensus_queue.cc:237] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.514874 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f5c6a17507d4a5a8057a725d3299ab9" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.514966 15111 raft_consensus.cc:2468] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:26.515202 15185 leader_election.cc:304] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.515326 15409 raft_consensus.cc:2804] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.515358 15409 raft_consensus.cc:493] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.515389 15409 raft_consensus.cc:3060] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.516088 15409 raft_consensus.cc:515] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.516347 15409 leader_election.cc:290] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.517192 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "792c6d7038624ec29e5e36c0145c64db" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:26.517447 15048 leader_election.cc:343] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.518426 15369 tablet_bootstrap.cc:492] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.518501 15369 ts_tablet_manager.cc:1403] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.000s
I20251025 08:02:26.518802 15369 raft_consensus.cc:359] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.518859 15369 raft_consensus.cc:385] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.518877 15369 raft_consensus.cc:740] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.518960 15369 consensus_queue.cc:260] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.519203 15369 ts_tablet_manager.cc:1434] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.519367 15369 tablet_bootstrap.cc:492] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.519940 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f5c6a17507d4a5a8057a725d3299ab9" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.520026 15111 raft_consensus.cc:3060] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.520726 15111 raft_consensus.cc:2468] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:26.521028 15185 leader_election.cc:304] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.521533 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "792c6d7038624ec29e5e36c0145c64db" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.521545 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f5c6a17507d4a5a8057a725d3299ab9" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.521631 14976 raft_consensus.cc:3060] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.521824 15372 tablet_bootstrap.cc:492] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.521804 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7f5c6a17507d4a5a8057a725d3299ab9" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.521883 15372 ts_tablet_manager.cc:1403] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:26.521993 15384 raft_consensus.cc:2804] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.522084 15384 raft_consensus.cc:697] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:26.522226 15384 consensus_queue.cc:237] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.522325 15372 raft_consensus.cc:359] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.522434 15372 raft_consensus.cc:385] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.522480 15372 raft_consensus.cc:740] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.522490 14976 raft_consensus.cc:2468] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:26.522591 15372 consensus_queue.cc:260] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.522842 15372 ts_tablet_manager.cc:1434] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.522990 15372 tablet_bootstrap.cc:492] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.523773 15642 raft_consensus.cc:493] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.523823 15369 tablet_bootstrap.cc:654] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.523852 15372 tablet_bootstrap.cc:654] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.523851 15642 raft_consensus.cc:515] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.524147 15642 leader_election.cc:290] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
W20251025 08:02:26.524344 15049 leader_election.cc:343] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:26.524415 15049 leader_election.cc:304] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:26.524852 16078 raft_consensus.cc:2749] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.524883 15369 tablet_bootstrap.cc:492] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.524946 15369 ts_tablet_manager.cc:1403] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:26.525364 15369 raft_consensus.cc:359] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.525460 15369 raft_consensus.cc:385] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.525498 15369 raft_consensus.cc:740] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.525592 15369 consensus_queue.cc:260] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.525846 15369 ts_tablet_manager.cc:1434] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.526011 15369 tablet_bootstrap.cc:492] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.526100 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e0cc372400447b48e5fecfc009a11c2" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.526213 15249 raft_consensus.cc:2468] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.526839 15369 tablet_bootstrap.cc:654] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.528611 15049 leader_election.cc:304] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.528856 15642 raft_consensus.cc:2804] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.528908 15642 raft_consensus.cc:493] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.528942 15642 raft_consensus.cc:3060] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.529693 15642 raft_consensus.cc:515] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.530004 15642 leader_election.cc:290] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.530964 15372 tablet_bootstrap.cc:492] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.531050 15372 ts_tablet_manager.cc:1403] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251025 08:02:26.531445 15372 raft_consensus.cc:359] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.531533 15372 raft_consensus.cc:385] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.531562 15372 raft_consensus.cc:740] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.531659 15372 consensus_queue.cc:260] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.531673 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e0cc372400447b48e5fecfc009a11c2" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.531778 15249 raft_consensus.cc:3060] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.531898 15372 ts_tablet_manager.cc:1434] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.532060 15372 tablet_bootstrap.cc:492] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.532519 15249 raft_consensus.cc:2468] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.532893 15372 tablet_bootstrap.cc:654] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.533210 15049 leader_election.cc:304] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.533577 15642 raft_consensus.cc:2804] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.533659 15642 raft_consensus.cc:697] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.533771 15642 consensus_queue.cc:237] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:26.534794 14712 leader_election.cc:336] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 94a96657c5fd49398b88e9ad615bfe1e (127.14.70.62:39499): Network error: Client connection negotiation failed: client connection to 127.14.70.62:39499: connect: Connection refused (error 111)
I20251025 08:02:26.535804 15464 consensus_queue.cc:1048] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.540921 15464 consensus_queue.cc:1048] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.542697 15464 raft_consensus.cc:493] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.542764 15464 raft_consensus.cc:515] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.543058 15464 leader_election.cc:290] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.543318 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e0cc372400447b48e5fecfc009a11c2" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.543401 14976 raft_consensus.cc:2468] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.543494 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8e0cc372400447b48e5fecfc009a11c2" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.543573 14977 raft_consensus.cc:3060] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.544432 14977 raft_consensus.cc:2468] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.544564 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77365d99094541b2a5f7b8bb3bc18739" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.544658 15113 raft_consensus.cc:2468] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.544935 14915 leader_election.cc:304] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.545105 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77365d99094541b2a5f7b8bb3bc18739" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.545207 15249 raft_consensus.cc:2468] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.546798 16078 consensus_queue.cc:1048] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.548171 15464 raft_consensus.cc:2804] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.548228 15464 raft_consensus.cc:493] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.548264 15464 raft_consensus.cc:3060] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.549067 15464 raft_consensus.cc:515] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.549361 15464 leader_election.cc:290] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.550064 15539 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" candidate_term: 3 candidate_status { last_received { term: 2 index: 404 } } ignore_live_leader: false dest_uuid: "7109d31951574de3bf05a86c94c11d21" is_pre_election: true
I20251025 08:02:26.550503 15539 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 33b7e3c702ec44079d8b76a0ce6bae97 in term 2.
I20251025 08:02:26.550693 15369 tablet_bootstrap.cc:492] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.550752 15369 ts_tablet_manager.cc:1403] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.000s
I20251025 08:02:26.550928 14714 leader_election.cc:304] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 33b7e3c702ec44079d8b76a0ce6bae97, 7109d31951574de3bf05a86c94c11d21; no voters: 94a96657c5fd49398b88e9ad615bfe1e
I20251025 08:02:26.551091 15369 raft_consensus.cc:359] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.551151 16131 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20251025 08:02:26.551182 15369 raft_consensus.cc:385] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.551201 16131 raft_consensus.cc:493] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 94a96657c5fd49398b88e9ad615bfe1e)
I20251025 08:02:26.551209 15369 raft_consensus.cc:740] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.551247 16131 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 2 FOLLOWER]: Advancing to term 3
I20251025 08:02:26.551297 15369 consensus_queue.cc:260] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.551574 15369 ts_tablet_manager.cc:1434] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:26.551723 15369 tablet_bootstrap.cc:492] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.552240 16131 raft_consensus.cc:515] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:26.552557 15369 tablet_bootstrap.cc:654] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.552697 16131 leader_election.cc:290] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [CANDIDATE]: Term 3 election: Requested vote from peers 94a96657c5fd49398b88e9ad615bfe1e (127.14.70.62:39499), 7109d31951574de3bf05a86c94c11d21 (127.14.70.60:34453)
I20251025 08:02:26.553447 15372 tablet_bootstrap.cc:492] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.553515 15372 ts_tablet_manager.cc:1403] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20251025 08:02:26.553877 15372 raft_consensus.cc:359] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.553975 15372 raft_consensus.cc:385] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.554003 15372 raft_consensus.cc:740] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.554100 15372 consensus_queue.cc:260] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.554368 15372 ts_tablet_manager.cc:1434] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:26.554533 15372 tablet_bootstrap.cc:492] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.549721 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77365d99094541b2a5f7b8bb3bc18739" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.554994 15249 raft_consensus.cc:3060] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.555822 15249 raft_consensus.cc:2468] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
W20251025 08:02:26.556056 15491 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.70.62:39499: connect: Connection refused (error 111)
I20251025 08:02:26.556234 14914 leader_election.cc:304] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.556509 15539 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" candidate_term: 3 candidate_status { last_received { term: 2 index: 404 } } ignore_live_leader: false dest_uuid: "7109d31951574de3bf05a86c94c11d21"
I20251025 08:02:26.556605 15539 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 2 FOLLOWER]: Advancing to term 3
I20251025 08:02:26.557621 15539 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 33b7e3c702ec44079d8b76a0ce6bae97 in term 3.
I20251025 08:02:26.557934 16078 raft_consensus.cc:493] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.558036 16078 raft_consensus.cc:515] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.558331 16078 leader_election.cc:290] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.558372 14714 leader_election.cc:304] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 33b7e3c702ec44079d8b76a0ce6bae97, 7109d31951574de3bf05a86c94c11d21; no voters:
I20251025 08:02:26.560349 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "45be7daf50e741c9b6f1eeedccae8c8e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.560420 15864 raft_consensus.cc:2804] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.560442 16131 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 3 FOLLOWER]: Leader election won for term 3
I20251025 08:02:26.560458 14977 raft_consensus.cc:2468] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.560500 15864 raft_consensus.cc:697] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.560597 16131 raft_consensus.cc:697] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 3 LEADER]: Becoming Leader. State: Replica: 33b7e3c702ec44079d8b76a0ce6bae97, State: Running, Role: LEADER
I20251025 08:02:26.560602 15864 consensus_queue.cc:237] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.560825 15048 leader_election.cc:304] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.560906 16131 consensus_queue.cc:237] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 402, Committed index: 402, Last appended: 2.404, Last appended by leader: 404, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:26.561376 15642 raft_consensus.cc:2804] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.561422 15642 raft_consensus.cc:493] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.561456 15642 raft_consensus.cc:3060] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.562218 16131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33b7e3c702ec44079d8b76a0ce6bae97. Latest consensus state: current_term: 3 leader_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:26.562235 15642 raft_consensus.cc:515] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.562310 16131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: This master's current role is: LEADER
I20251025 08:02:26.562525 15642 leader_election.cc:290] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.562789 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "45be7daf50e741c9b6f1eeedccae8c8e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.562875 14977 raft_consensus.cc:3060] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.563288 15369 tablet_bootstrap.cc:492] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.563354 15369 ts_tablet_manager.cc:1403] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20251025 08:02:26.563737 15369 raft_consensus.cc:359] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.563830 15369 raft_consensus.cc:385] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.563858 15369 raft_consensus.cc:740] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.563956 15369 consensus_queue.cc:260] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.564168 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77365d99094541b2a5f7b8bb3bc18739" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.564250 15369 ts_tablet_manager.cc:1434] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.564257 15111 raft_consensus.cc:3060] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.564411 15369 tablet_bootstrap.cc:492] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.563750 14977 raft_consensus.cc:2468] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.565079 15048 leader_election.cc:304] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.565132 15111 raft_consensus.cc:2468] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.565299 15369 tablet_bootstrap.cc:654] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.565286 15497 raft_consensus.cc:2804] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.565356 15497 raft_consensus.cc:697] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.565480 15497 consensus_queue.cc:237] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:26.565729 14712 leader_election.cc:336] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 94a96657c5fd49398b88e9ad615bfe1e (127.14.70.62:39499): Network error: Client connection negotiation failed: client connection to 127.14.70.62:39499: connect: Connection refused (error 111)
I20251025 08:02:26.566223 15369 tablet_bootstrap.cc:492] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.566295 15369 ts_tablet_manager.cc:1403] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.566681 15369 raft_consensus.cc:359] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.566776 15369 raft_consensus.cc:385] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.566810 15369 raft_consensus.cc:740] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.566907 15369 consensus_queue.cc:260] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.567165 15369 ts_tablet_manager.cc:1434] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.567636 15464 raft_consensus.cc:493] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.567700 15464 raft_consensus.cc:515] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.568017 15464 leader_election.cc:290] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:26.568569 15491 leader_election.cc:336] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 94a96657c5fd49398b88e9ad615bfe1e (127.14.70.62:39499): Network error: Client connection negotiation failed: client connection to 127.14.70.62:39499: connect: Connection refused (error 111)
I20251025 08:02:26.568645 15491 leader_election.cc:304] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7109d31951574de3bf05a86c94c11d21; no voters: 33b7e3c702ec44079d8b76a0ce6bae97, 94a96657c5fd49398b88e9ad615bfe1e
I20251025 08:02:26.568996 16132 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251025 08:02:26.569922 15369 tablet_bootstrap.cc:492] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:26.570802 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f89313f3d7344132b2fb0fab8941bb3e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.570919 15249 raft_consensus.cc:2468] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.571161 14914 leader_election.cc:304] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.571381 15374 raft_consensus.cc:2804] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.571431 15374 raft_consensus.cc:493] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.571461 15374 raft_consensus.cc:3060] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:26.572453 14915 leader_election.cc:343] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: f89313f3d7344132b2fb0fab8941bb3e
I20251025 08:02:26.574389 15374 raft_consensus.cc:515] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.574698 15374 leader_election.cc:290] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.575714 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f89313f3d7344132b2fb0fab8941bb3e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.575839 15249 raft_consensus.cc:3060] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:26.576498 14915 leader_election.cc:343] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: f89313f3d7344132b2fb0fab8941bb3e
W20251025 08:02:26.577903 14915 consensus_peers.cc:597] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01d9f6636b364e3b9192ae546422de5b. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:26.577913 15369 tablet_bootstrap.cc:654] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.578372 15372 tablet_bootstrap.cc:654] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.578943 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "45be7daf50e741c9b6f1eeedccae8c8e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.579039 15247 raft_consensus.cc:3060] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.579399 15249 raft_consensus.cc:2468] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.579831 15247 raft_consensus.cc:2468] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.580065 15248 raft_consensus.cc:3060] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.580634 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "45be7daf50e741c9b6f1eeedccae8c8e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.580749 15246 raft_consensus.cc:2376] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1. Re-sending same reply.
I20251025 08:02:26.581274 14914 leader_election.cc:304] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.581460 15374 raft_consensus.cc:493] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.581512 15374 raft_consensus.cc:515] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.581557 15464 raft_consensus.cc:2804] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.581571 15380 consensus_queue.cc:1048] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.581640 15464 raft_consensus.cc:697] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.581748 15464 consensus_queue.cc:237] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.581808 15380 consensus_queue.cc:1048] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.582414 15244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea0d438e99864c57999abf3467edc643" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.582504 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea0d438e99864c57999abf3467edc643" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.582531 15244 raft_consensus.cc:2468] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.582598 15111 raft_consensus.cc:2468] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.583676 14914 leader_election.cc:304] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.584841 15409 raft_consensus.cc:493] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.584915 15409 raft_consensus.cc:515] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:26.585052 15464 raft_consensus.cc:2804] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.585095 15464 raft_consensus.cc:493] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.585148 15464 raft_consensus.cc:3060] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.585299 15409 leader_election.cc:290] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:26.585819 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9cd745bd3e42e98b0ae1d145007bee" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.585872 15372 tablet_bootstrap.cc:492] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.585939 15372 ts_tablet_manager.cc:1403] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.031s user 0.000s sys 0.001s
I20251025 08:02:26.585973 15464 raft_consensus.cc:515] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.586274 15464 leader_election.cc:290] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.586421 15372 raft_consensus.cc:359] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.586509 15372 raft_consensus.cc:385] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.586544 15372 raft_consensus.cc:740] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.586642 15372 consensus_queue.cc:260] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.586796 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea0d438e99864c57999abf3467edc643" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.586875 15111 raft_consensus.cc:3060] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.586900 15372 ts_tablet_manager.cc:1434] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.587051 15372 tablet_bootstrap.cc:492] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.587319 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d9cd745bd3e42e98b0ae1d145007bee" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.587718 15111 raft_consensus.cc:2468] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.581786 15374 leader_election.cc:290] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.587767 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea0d438e99864c57999abf3467edc643" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.587853 15246 raft_consensus.cc:3060] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.587970 15372 tablet_bootstrap.cc:654] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.587986 14915 leader_election.cc:304] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.588122 15374 raft_consensus.cc:2804] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.588176 15374 raft_consensus.cc:697] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.588276 15374 consensus_queue.cc:237] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.588688 15246 raft_consensus.cc:2468] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.589181 15372 tablet_bootstrap.cc:492] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.589262 15372 ts_tablet_manager.cc:1403] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:26.589864 15183 leader_election.cc:304] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.589956 15372 raft_consensus.cc:359] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.590049 15372 raft_consensus.cc:385] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.590075 15372 raft_consensus.cc:740] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.590154 15372 consensus_queue.cc:260] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.590442 15372 ts_tablet_manager.cc:1434] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.590713 15372 tablet_bootstrap.cc:492] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:26.590886 15384 raft_consensus.cc:2749] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251025 08:02:26.591782 15372 tablet_bootstrap.cc:654] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:26.592805 15372 tablet_bootstrap.cc:492] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:26.592873 15372 ts_tablet_manager.cc:1403] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:26.593243 15372 raft_consensus.cc:359] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.593322 15372 raft_consensus.cc:385] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.593345 15372 raft_consensus.cc:740] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.593428 15372 consensus_queue.cc:260] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.593642 15372 ts_tablet_manager.cc:1434] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.598213 15380 consensus_queue.cc:1048] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.603098 15374 consensus_queue.cc:1048] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.608526 15445 consensus_queue.cc:1048] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.609927 15369 tablet_bootstrap.cc:492] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:26.610029 15369 ts_tablet_manager.cc:1403] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.040s user 0.000s sys 0.002s
I20251025 08:02:26.610483 15369 raft_consensus.cc:359] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.610567 15369 raft_consensus.cc:385] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:26.610594 15369 raft_consensus.cc:740] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:26.610677 15369 consensus_queue.cc:260] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.610900 15369 ts_tablet_manager.cc:1434] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:26.622020 15409 raft_consensus.cc:493] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.622109 15409 raft_consensus.cc:515] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.622427 15409 leader_election.cc:290] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.622692 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcf414d04305456b80b2ec5dd8fb0ba7" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.622717 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bcf414d04305456b80b2ec5dd8fb0ba7" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.622817 14977 raft_consensus.cc:2393] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:26.623113 15185 leader_election.cc:304] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.623293 15409 raft_consensus.cc:3060] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.624035 15409 raft_consensus.cc:2749] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.642656 15642 consensus_queue.cc:1048] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.646016 15642 consensus_queue.cc:1048] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.652161 15445 raft_consensus.cc:493] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.652251 15445 raft_consensus.cc:515] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.652521 16078 consensus_queue.cc:1048] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.652581 15445 leader_election.cc:290] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.653254 15244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d2697ee09dc74d35abffc3158410aa5e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.653369 15244 raft_consensus.cc:2468] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.653728 14914 leader_election.cc:304] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.653929 15445 raft_consensus.cc:2804] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.653980 15445 raft_consensus.cc:493] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.654018 15445 raft_consensus.cc:3060] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.654541 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d2697ee09dc74d35abffc3158410aa5e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.654644 15111 raft_consensus.cc:2468] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.655890 15445 raft_consensus.cc:515] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.656230 15445 leader_election.cc:290] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.656668 15244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d2697ee09dc74d35abffc3158410aa5e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.656767 15244 raft_consensus.cc:3060] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.657467 15244 raft_consensus.cc:2468] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.657725 14914 leader_election.cc:304] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.658022 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d2697ee09dc74d35abffc3158410aa5e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.658113 15111 raft_consensus.cc:3060] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.658988 15111 raft_consensus.cc:2468] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.659343 15864 raft_consensus.cc:2804] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.659425 15864 raft_consensus.cc:697] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.659544 15864 consensus_queue.cc:237] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.661630 15384 raft_consensus.cc:493] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.661700 15384 raft_consensus.cc:515] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.661774 15464 consensus_queue.cc:1048] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.661984 15384 leader_election.cc:290] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.662350 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3092fd602dc7478693595ffcbc3bcf45" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.662444 14977 raft_consensus.cc:2468] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:26.662446 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3092fd602dc7478693595ffcbc3bcf45" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.662528 15111 raft_consensus.cc:2468] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:26.662735 15185 leader_election.cc:304] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.664507 15384 raft_consensus.cc:2804] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.664568 15384 raft_consensus.cc:493] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.664610 15384 raft_consensus.cc:3060] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.665342 15384 raft_consensus.cc:515] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.665607 15384 leader_election.cc:290] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.665863 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3092fd602dc7478693595ffcbc3bcf45" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.665948 15111 raft_consensus.cc:3060] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.665926 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3092fd602dc7478693595ffcbc3bcf45" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.666028 14977 raft_consensus.cc:3060] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.666781 15111 raft_consensus.cc:2468] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:26.666869 14977 raft_consensus.cc:2468] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:26.667141 15185 leader_election.cc:304] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.667567 15384 raft_consensus.cc:2804] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.667650 15384 raft_consensus.cc:697] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:26.667775 15384 consensus_queue.cc:237] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.677125 15864 consensus_queue.cc:1048] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.679875 15409 raft_consensus.cc:493] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.679984 15409 raft_consensus.cc:515] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.680295 15409 leader_election.cc:290] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.681550 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7e8a698e8ba408a833bbc3905b2ad04" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.681658 14977 raft_consensus.cc:2468] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:26.682355 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7e8a698e8ba408a833bbc3905b2ad04" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.682466 15111 raft_consensus.cc:2468] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:26.682638 15183 leader_election.cc:304] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.682893 15409 raft_consensus.cc:2804] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.682964 15409 raft_consensus.cc:493] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.683010 15409 raft_consensus.cc:3060] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.683888 15409 raft_consensus.cc:515] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.684161 15409 leader_election.cc:290] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.685065 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7e8a698e8ba408a833bbc3905b2ad04" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.685153 15111 raft_consensus.cc:3060] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.685985 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7e8a698e8ba408a833bbc3905b2ad04" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.686053 15111 raft_consensus.cc:2468] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:26.686102 14977 raft_consensus.cc:3060] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.686584 15185 leader_election.cc:304] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.687011 14977 raft_consensus.cc:2468] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:26.687060 15409 raft_consensus.cc:2804] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.687127 15409 raft_consensus.cc:697] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:26.687260 15409 consensus_queue.cc:237] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.693343 15380 consensus_queue.cc:1048] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.698426 16078 raft_consensus.cc:493] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.698503 16078 raft_consensus.cc:515] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.698789 16078 leader_election.cc:290] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.699159 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d25a2805a264574bc20150762c48262" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.699265 15246 raft_consensus.cc:2468] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.699631 15049 leader_election.cc:304] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.699822 16078 raft_consensus.cc:2804] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.699880 16078 raft_consensus.cc:493] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.699913 16078 raft_consensus.cc:3060] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.699892 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d25a2805a264574bc20150762c48262" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.699991 14976 raft_consensus.cc:2468] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.700708 16078 raft_consensus.cc:515] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.701022 16078 leader_election.cc:290] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.701378 16078 consensus_queue.cc:1048] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.701485 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d25a2805a264574bc20150762c48262" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.701555 15246 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5d25a2805a264574bc20150762c48262" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.701582 14976 raft_consensus.cc:3060] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.701649 15246 raft_consensus.cc:3060] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.702498 15246 raft_consensus.cc:2468] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.702498 14976 raft_consensus.cc:2468] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.702782 15048 leader_election.cc:304] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.702924 16078 raft_consensus.cc:2804] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.703002 16078 raft_consensus.cc:697] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.703102 16078 consensus_queue.cc:237] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.708268 15384 consensus_queue.cc:1048] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.712069 16078 consensus_queue.cc:1048] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.717276 16078 consensus_queue.cc:1048] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.719640 15384 consensus_queue.cc:1048] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.722113 16078 consensus_queue.cc:1048] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.726368 16078 consensus_queue.cc:1048] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.731096 16078 consensus_queue.cc:1048] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.731336 16078 consensus_queue.cc:1048] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.733469 15409 consensus_queue.cc:1048] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.733688 15380 consensus_queue.cc:1048] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.737502 15864 consensus_queue.cc:1048] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.739578 15642 consensus_queue.cc:1048] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.741528 15909 raft_consensus.cc:493] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.741629 15909 raft_consensus.cc:515] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.741935 15909 leader_election.cc:290] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.742941 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "792c6d7038624ec29e5e36c0145c64db" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.743052 15113 raft_consensus.cc:2468] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:26.743330 15185 leader_election.cc:304] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.743475 15909 raft_consensus.cc:2804] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.743531 15909 raft_consensus.cc:493] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.743569 15909 raft_consensus.cc:3060] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.744422 15909 raft_consensus.cc:515] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.744736 15909 leader_election.cc:290] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.744745 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "792c6d7038624ec29e5e36c0145c64db" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.744829 14978 raft_consensus.cc:2468] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:26.745204 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "792c6d7038624ec29e5e36c0145c64db" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.745287 14978 raft_consensus.cc:3060] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.745560 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "792c6d7038624ec29e5e36c0145c64db" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.745652 15113 raft_consensus.cc:3060] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.746065 14978 raft_consensus.cc:2468] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:26.746721 15113 raft_consensus.cc:2468] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:26.746982 15185 leader_election.cc:304] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.747117 15909 raft_consensus.cc:2804] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.747200 15909 raft_consensus.cc:697] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:26.747315 15909 consensus_queue.cc:237] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.753827 15464 consensus_queue.cc:1048] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.755949 15445 consensus_queue.cc:1048] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.757956 15445 consensus_queue.cc:1048] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.775573 15384 consensus_queue.cc:1048] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.775712 15464 consensus_queue.cc:1048] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.784363 15642 consensus_queue.cc:1048] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.786365 15445 raft_consensus.cc:493] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.786443 15445 raft_consensus.cc:515] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.786760 15445 leader_election.cc:290] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.787078 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "346c0c8bf30b4dbaa92436b45e5fbf47" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.787204 15111 raft_consensus.cc:2468] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.787535 14915 leader_election.cc:304] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.787758 15445 raft_consensus.cc:2804] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.787730 15244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "346c0c8bf30b4dbaa92436b45e5fbf47" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.787804 15445 raft_consensus.cc:493] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.787844 15445 raft_consensus.cc:3060] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.787837 15244 raft_consensus.cc:2468] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:26.788764 15445 raft_consensus.cc:515] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.789086 15445 leader_election.cc:290] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.789692 15244 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "346c0c8bf30b4dbaa92436b45e5fbf47" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.789801 15244 raft_consensus.cc:3060] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.790789 15244 raft_consensus.cc:2468] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.790871 16078 consensus_queue.cc:1048] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.791250 14914 leader_election.cc:304] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:26.791544 15464 raft_consensus.cc:2804] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.791620 15464 raft_consensus.cc:697] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:26.791715 15464 consensus_queue.cc:237] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.792403 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "346c0c8bf30b4dbaa92436b45e5fbf47" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:26.792503 15111 raft_consensus.cc:3060] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.793404 15111 raft_consensus.cc:2468] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:26.797529 16078 consensus_queue.cc:1048] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.801990 16078 raft_consensus.cc:493] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.802069 16078 raft_consensus.cc:515] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.802388 16078 leader_election.cc:290] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.802596 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b8d94fc010046c7b37804f168471904" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.802695 14976 raft_consensus.cc:2468] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.802902 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b8d94fc010046c7b37804f168471904" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:26.802968 15048 leader_election.cc:304] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.802994 15247 raft_consensus.cc:2468] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:26.803104 16078 raft_consensus.cc:2804] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:26.803150 16078 raft_consensus.cc:493] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:26.803182 16078 raft_consensus.cc:3060] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.803872 16078 raft_consensus.cc:515] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.804199 16078 leader_election.cc:290] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:26.804406 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b8d94fc010046c7b37804f168471904" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:26.804499 14976 raft_consensus.cc:3060] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.805321 14976 raft_consensus.cc:2468] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.805549 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7b8d94fc010046c7b37804f168471904" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:26.805580 15048 leader_election.cc:304] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:26.805639 15247 raft_consensus.cc:3060] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.805717 16078 raft_consensus.cc:2804] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:26.805800 16078 raft_consensus.cc:697] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:26.805899 16078 consensus_queue.cc:237] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:26.806545 15247 raft_consensus.cc:2468] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:26.813840 16078 consensus_queue.cc:1048] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.821851 15497 consensus_queue.cc:1048] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.842275 16199 consensus_queue.cc:1048] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.847915 15409 consensus_queue.cc:1048] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.852859 15380 consensus_queue.cc:1048] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.854753 15384 raft_consensus.cc:493] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:26.854830 15384 raft_consensus.cc:515] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:26.855129 15384 leader_election.cc:290] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:26.855435 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "821de6815eb244058f1d8a7a06bf48a6" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:26.855553 15111 raft_consensus.cc:2393] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:26.856009 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "821de6815eb244058f1d8a7a06bf48a6" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:26.856416 15183 leader_election.cc:304] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:26.856732 15384 raft_consensus.cc:3060] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:26.857553 15384 raft_consensus.cc:2749] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:26.859760 15380 consensus_queue.cc:1048] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.865231 15374 consensus_queue.cc:1048] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.869657 15374 consensus_queue.cc:1048] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.872212 15642 consensus_queue.cc:1048] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.878834 15642 consensus_queue.cc:1048] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.894598 15374 consensus_queue.cc:1048] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.897468 15374 consensus_queue.cc:1048] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.905541 15642 consensus_queue.cc:1048] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.909049 16078 consensus_queue.cc:1048] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.918574 15374 consensus_queue.cc:1048] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.919819 15374 consensus_queue.cc:1048] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.927770 16078 consensus_queue.cc:1048] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.927924 15380 consensus_queue.cc:1048] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.929308 14616 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
/tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.70.62:39499
--webserver_interface=127.14.70.62
--webserver_port=44847
--builtin_ntp_servers=127.14.70.20:37905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20251025 08:02:26.930948 15380 consensus_queue.cc:1048] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.934015 15642 consensus_queue.cc:1048] T adc14c254b0c4974bfbadede727b6c6b P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.942127 15864 consensus_queue.cc:1048] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.942853 15384 consensus_queue.cc:1048] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.948665 15374 consensus_queue.cc:1048] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:26.950294 15185 consensus_peers.cc:597] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff82c6ab12c844339dd387569fb85526. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:26.950219 14693 master_runner.cc:186] Error getting master registration for 127.14.70.62:39499: Network error: Client connection negotiation failed: client connection to 127.14.70.62:39499: connect: Connection refused (error 111),
I20251025 08:02:26.952463 14693 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20251025 08:02:26.953316 15464 consensus_queue.cc:1048] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.954876 16078 consensus_queue.cc:1048] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.959581 15380 consensus_queue.cc:1048] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.963963 16199 consensus_queue.cc:1048] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.966898 15909 consensus_queue.cc:1048] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.978506 15445 consensus_queue.cc:1048] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.978832 15445 consensus_queue.cc:1048] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.982775 15497 consensus_queue.cc:1048] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.983713 15864 consensus_queue.cc:1048] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.984041 15864 consensus_queue.cc:1048] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:26.989718 14915 consensus_peers.cc:597] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f89313f3d7344132b2fb0fab8941bb3e. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:26.993912 15374 consensus_queue.cc:1048] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:26.999248 15380 consensus_queue.cc:1048] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.003489 15864 consensus_queue.cc:1048] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.040190 15374 consensus_queue.cc:1048] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.044370 15374 consensus_queue.cc:1048] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:27.054519 14712 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.70.62:39499: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20251025 08:02:27.055160 14712 consensus_peers.cc:597] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 -> Peer 94a96657c5fd49398b88e9ad615bfe1e (127.14.70.62:39499): Couldn't send request to peer 94a96657c5fd49398b88e9ad615bfe1e. Status: Network error: Client connection negotiation failed: client connection to 127.14.70.62:39499: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:27.085124 15642 consensus_queue.cc:1048] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.089255 15497 consensus_queue.cc:1048] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.090415 16199 consensus_queue.cc:1048] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.096051 16199 consensus_queue.cc:1048] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:27.105211 16226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251025 08:02:27.105407 16226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251025 08:02:27.105485 16226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20251025 08:02:27.108989 16226 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251025 08:02:27.109045 16226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251025 08:02:27.109074 16226 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251025 08:02:27.109115 16226 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251025 08:02:27.113260 16226 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.70.20:37905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.70.62:39499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.14.70.62
--webserver_port=44847
--never_fsync=true
--heap_profile_path=/tmp/kudu.16226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d0cb013a5aad754f2ed06c25f5ec3d8a1873622
build type DEBUG
built by None at 25 Oct 2025 07:43:14 UTC on 24a791456cd2
build id 8706
I20251025 08:02:27.114300 16226 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251025 08:02:27.115329 16226 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251025 08:02:27.117339 16255 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:27.117434 16255 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:27.118436 16255 leader_election.cc:290] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 94a96657c5fd49398b88e9ad615bfe1e (127.14.70.62:39499), 33b7e3c702ec44079d8b76a0ce6bae97 (127.14.70.61:44347)
I20251025 08:02:27.118482 14737 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7109d31951574de3bf05a86c94c11d21" candidate_term: 4 candidate_status { last_received { term: 2 index: 402 } } ignore_live_leader: false dest_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" is_pre_election: true
W20251025 08:02:27.119065 15491 leader_election.cc:336] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 94a96657c5fd49398b88e9ad615bfe1e (127.14.70.62:39499): Network error: Client connection negotiation failed: client connection to 127.14.70.62:39499: connect: Connection refused (error 111)
I20251025 08:02:27.119132 15491 leader_election.cc:304] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7109d31951574de3bf05a86c94c11d21; no voters: 33b7e3c702ec44079d8b76a0ce6bae97, 94a96657c5fd49398b88e9ad615bfe1e
I20251025 08:02:27.119266 16255 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20251025 08:02:27.120906 16259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:27.121001 16226 server_base.cc:1047] running on GCE node
W20251025 08:02:27.120944 16262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20251025 08:02:27.120919 16260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:27.121651 16226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251025 08:02:27.122599 16226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251025 08:02:27.123764 16226 hybrid_clock.cc:648] HybridClock initialized: now 1761379347123693 us; error 82 us; skew 500 ppm
I20251025 08:02:27.125383 16226 webserver.cc:492] Webserver started at http://127.14.70.62:44847/ using document root <none> and password file <none>
I20251025 08:02:27.125880 16226 fs_manager.cc:362] Metadata directory not provided
I20251025 08:02:27.125949 16226 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251025 08:02:27.128998 16226 fs_manager.cc:714] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:27.130885 16268 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251025 08:02:27.131736 16226 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20251025 08:02:27.131842 16226 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data,/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/wal
uuid: "94a96657c5fd49398b88e9ad615bfe1e"
format_stamp: "Formatted at 2025-10-25 08:02:21 on dist-test-slave-2g2p"
I20251025 08:02:27.132194 16226 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251025 08:02:27.148139 16199 consensus_queue.cc:1048] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.156761 15909 consensus_queue.cc:1048] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.160046 16226 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251025 08:02:27.160745 16226 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251025 08:02:27.160948 16226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251025 08:02:27.160950 15497 consensus_queue.cc:1048] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.169744 16226 rpc_server.cc:307] RPC server started. Bound to: 127.14.70.62:39499
I20251025 08:02:27.169963 15642 consensus_queue.cc:1048] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.171075 16226 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-0/data/info.pb
I20251025 08:02:27.172346 16323 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.70.62:39499 every 8 connection(s)
I20251025 08:02:27.175659 15374 consensus_queue.cc:1048] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.177275 16324 sys_catalog.cc:263] Verifying existing consensus state
I20251025 08:02:27.177821 14616 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu as pid 16226
I20251025 08:02:27.179786 16324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Bootstrap starting.
I20251025 08:02:27.179920 15539 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 3 FOLLOWER]: Refusing update from remote peer 33b7e3c702ec44079d8b76a0ce6bae97: Log matching property violated. Preceding OpId in replica: term: 2 index: 402. Preceding OpId from leader: term: 3 index: 405. (index mismatch)
I20251025 08:02:27.180550 16156 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 405, Last known committed idx: 401, Time since last communication: 0.000s
I20251025 08:02:27.182399 16255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33b7e3c702ec44079d8b76a0ce6bae97. Latest consensus state: current_term: 3 leader_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:27.182512 16255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:27.183424 15380 consensus_queue.cc:1048] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.185523 16156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:27.185632 16156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: This master's current role is: LEADER
I20251025 08:02:27.187095 16255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:27.187203 16255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:27.188971 15296 heartbeater.cc:344] Connected to a master server at 127.14.70.62:39499
I20251025 08:02:27.193495 15026 heartbeater.cc:344] Connected to a master server at 127.14.70.62:39499
I20251025 08:02:27.201398 15380 consensus_queue.cc:1048] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.202294 15161 heartbeater.cc:344] Connected to a master server at 127.14.70.62:39499
I20251025 08:02:27.204926 15374 consensus_queue.cc:1048] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.213677 15909 consensus_queue.cc:1048] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.217396 15026 heartbeater.cc:344] Connected to a master server at 127.14.70.62:39499
I20251025 08:02:27.219153 15409 consensus_queue.cc:1048] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:27.220278 16324 log.cc:826] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Log is configured to *not* fsync() on all Append() calls
I20251025 08:02:27.293965 16158 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251025 08:02:27.298594 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_4c672efab2bb448ab1dcfd4325e8c053 [id=0db3af0dc90e4ea5ac9a029e3864ce58]
I20251025 08:02:27.299105 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_4a9fc326b302473f86d8d3f7e7b8040f [id=15a38bbafe4045e9991cb846ec9e452c]
I20251025 08:02:27.299892 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_bb2712f0481c486fa9db6d0113289be2 [id=198c7d73328440ac8c6eef2c24c5e0ad]
I20251025 08:02:27.300137 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_0db7fc431dff4c7f85007159dd715e19 [id=1e1120fd790b44569595d67fea5165c2]
I20251025 08:02:27.300381 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_8fd6304d02a6478fa31556344ab157ae [id=1ee33ee129d749d0bd7f26dc49fca0fe]
I20251025 08:02:27.300731 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_8f781f3f507c4a339ba15100b719fcbb [id=2283253a9522485d93d6c484c5eef6e4]
I20251025 08:02:27.301203 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_c91b6d76e1384dd99d7e69ddee320afb [id=244c5edd72af4af790d96dd294e8d8c4]
I20251025 08:02:27.301797 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]
I20251025 08:02:27.302032 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_eaf82018b440497e86dbf2cfdd3785e5 [id=2ef2d72066f446619f9045da34df7814]
I20251025 08:02:27.302416 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_d57dfa9ab2164520aa85ebfdd8a85546 [id=317c0892e78047c4b33e1836c3e1776d]
I20251025 08:02:27.302873 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]
I20251025 08:02:27.303434 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_c485105a684f427295b74968c29fd30c [id=3abb3c7d3dd74d408db083bf0499f679]
I20251025 08:02:27.303647 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_2d1acf2ab32844f2a253a5d5ab46d842 [id=3abdeeb0fca0413d8af86b1c0ad383b4]
I20251025 08:02:27.303869 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_7387f487853a4b608f5e5237684550d8 [id=3e1281c3f28346a4a1dd2c4fcc990a2e]
I20251025 08:02:27.304098 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24]
I20251025 08:02:27.304327 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_a368af9d0b8d46d78f9158b8f9949b01 [id=425e69ea7f8a407e8d22b735ee62c709]
I20251025 08:02:27.304661 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_b22d946b289a4a0aa9c6ef1135c68e60 [id=46383e9b028a4d2bb7b39e04f147491e]
I20251025 08:02:27.304987 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_b42eeab602164c40a7721a43fb071328 [id=4b8789f2c2234483aa891cad1334c474]
I20251025 08:02:27.305202 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b [id=4e47e7759fc64598807f1ee3a973820f]
I20251025 08:02:27.305430 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_2f4e7934dc164dcdadd6467e1afc563a [id=4f1a1f84f436411db166b8c28873a27b]
I20251025 08:02:27.305646 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_d8110cf18c6748b092f8bf7348349f88 [id=53d57abf556c4926b02a1e265cf34c61]
I20251025 08:02:27.306018 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_28db4c3dec79421c9ad752690a383ea4 [id=593c3f07bdaa45d49e1c8cf97cf0c2c7]
I20251025 08:02:27.306282 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_cd97ecbd521e4d4b8f03836dbb9e15cf [id=59daf7f960b84b148da5d5f30db95bfe]
I20251025 08:02:27.307080 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_f5bf4f0664c44a70aa6d2f0e9143f7a7 [id=6739c1319b784c8eb66fc75125f83056]
I20251025 08:02:27.307546 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_6ae5d8954fba433fa72fd9cbaa925f2a [id=6b4ebc3c554648b48d6ea2f5916e1bad]
I20251025 08:02:27.307785 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]
I20251025 08:02:27.308015 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_20420bbacfa743d4ad1ed935423c4ff5 [id=6c847ade4b8f485fb3353af3d2ec442b]
I20251025 08:02:27.308476 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]
I20251025 08:02:27.312980 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_51c8e80718644971942377f115aee6ea [id=74592e2000d243869f94a1c513fc04e9]
I20251025 08:02:27.313235 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_4b7b9ad86d85404785a42b98239e38cc [id=7505f67ea24847a6aa9c90955f1596fa]
I20251025 08:02:27.313472 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_4598018e26254b78befa93852241f777 [id=78794c8ceec3479ca3ac3ef55594762f]
I20251025 08:02:27.313709 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_56dd2ffb46cc402fa6a8c180e157a2db [id=7956205ae4e9408988c3d82c46db1706]
I20251025 08:02:27.314049 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_5228048f3783458dbb44280a7a6e4816 [id=7fe739c2f676459d8c73632266babedb]
I20251025 08:02:27.314309 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]
I20251025 08:02:27.314551 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_2931abc275064dfd818fc151a0267713 [id=87037802262e424ebe9c070b5ef7ba62]
I20251025 08:02:27.314783 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_4ed89f5fc452467d920d19caa6fb931a [id=8a0e4fe9e4544c539cb23b0279c1deaf]
I20251025 08:02:27.315035 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031]
I20251025 08:02:27.315289 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_3c48d3160e5d42509de4f0be1af855e2 [id=912da5ef8bbf4af29528c084ea7fa633]
I20251025 08:02:27.316428 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_49352274aacf479292f43c128367eeb0 [id=a788bc4f491d4d7580a83895797f5651]
I20251025 08:02:27.316664 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_521f904aba4a4b309e9864df54df659d [id=a95abf5644c64177afde71baad186bca]
I20251025 08:02:27.317108 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_643cee182de94bbf9718fb59a00cf85c [id=aa46eca7031242f3b4a3144dd521cc6b]
I20251025 08:02:27.317471 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_84b80cef0bc442cfb9f5301562ff1cce [id=ab926bc9b7424c45a5415c4763db2b4e]
I20251025 08:02:27.317701 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_8540557c73a34cc2851ad08d71acac22 [id=abe30167767443d0b8e59f9418399d88]
I20251025 08:02:27.317863 15161 heartbeater.cc:344] Connected to a master server at 127.14.70.62:39499
I20251025 08:02:27.317921 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_0f884fc2a3c74502aa6bad6c3a9b49a8 [id=ae530558880e4fa4b18c3f87e21c0fd0]
I20251025 08:02:27.318305 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_fa9d9b9a535648d89d19b74bb940ed9f [id=b3e6b8f18f2f40fc977b978d7d2c1b0b]
I20251025 08:02:27.318542 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_7257511e2df84f9cafdd1fe1ec4a180b [id=b5be4f412cc04aa59c819d0e1cc403bf]
I20251025 08:02:27.318899 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_2631732663a24b55a695edc159006f87 [id=b9853b2d88cf4a96b9fc5e1099f87064]
I20251025 08:02:27.319258 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_541e363972b34e9b9b64f21b771e7ce2 [id=bdcc7cd59c78409fad7b5f687ae81310]
I20251025 08:02:27.319501 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_7a87c8dce3c3439db7879b9d642a745f [id=c571a9bdb4d14249a27b401b9c02f644]
I20251025 08:02:27.319725 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_670e2c0d014c4003af93e44a18490fda [id=c824002e1e954b65be5aee4a39a78cd0]
I20251025 08:02:27.320421 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_782772638c3646fea7dfa5ecc8e01959 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]
I20251025 08:02:27.320652 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_7a2d41df4f9d4874b3403fdef1ae1e72 [id=c8b69f7419b842c18f324e0c08ba840a]
I20251025 08:02:27.320878 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_8436de66616b479fa1982a64ba3579d0 [id=cb6856b315084424836559dacbe12c28]
I20251025 08:02:27.321110 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_a210a38e85814b3db16726f2a0a830b8 [id=cb9294ed7c474aae989ac13159ec3166]
I20251025 08:02:27.321352 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_94e6d6f804c346ce97b427caf864614e [id=ce6a220ddfc540dbb17e28bc74b66449]
I20251025 08:02:27.322032 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]
I20251025 08:02:27.322424 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_e96eec11f48049a9b2a4332b23e60a6f [id=de8b64679bcb4ef582d6edd600342a82]
I20251025 08:02:27.322774 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_808c7980d96b48a181f79124ea5a0adb [id=e3c0ae796ee2421abe38408b729dd2a6]
I20251025 08:02:27.322983 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_b2214744ef8c4a4cb1c28ab1689ddbdb [id=e62c2aba4e5546e2bd881c5f2ae3abd4]
I20251025 08:02:27.323180 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_acf14806991f4da89dc9bb3361537133 [id=e63210d8c6d148e18496c0bc0d326ab9]
I20251025 08:02:27.323475 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_ad3dee0a2af74757a17bc9fd115a69cb [id=e9162dd5a2524394b1cb11594293de96]
I20251025 08:02:27.323661 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_5854b229e0af41b88196de4a1c9c0270 [id=e95f72536b1242469fd4dad2c4d1c276]
I20251025 08:02:27.324085 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_4afe1c6e03a941df9d5f7df4a42cbc61 [id=ef3a1760f2c44935bbb79e518510905f]
I20251025 08:02:27.324586 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]
I20251025 08:02:27.324786 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_4a4b1eeaa5674710a1a13d7f0f395737 [id=f9c1f298fed0456eb9fd34fe9c124190]
I20251025 08:02:27.325006 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_dc0d80dcd5304d218f07109ec6675955 [id=faaa356c17964d04adce7f36bf5784cf]
I20251025 08:02:27.325263 16158 catalog_manager.cc:679] Loaded metadata for table default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a]
I20251025 08:02:27.340794 16158 tablet_loader.cc:96] loaded metadata for tablet 0078dd6fb0e34d01a54889326dd6dfd7 (table default.Table_2f4e7934dc164dcdadd6467e1afc563a [id=4f1a1f84f436411db166b8c28873a27b])
I20251025 08:02:27.341341 16158 tablet_loader.cc:96] loaded metadata for tablet 049cc6add40d44fc9d67c89eca89ce59 (table default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37])
I20251025 08:02:27.342471 16158 tablet_loader.cc:96] loaded metadata for tablet 071220f7bd334f5aad733209193244d4 (table default.Table_7a87c8dce3c3439db7879b9d642a745f [id=c571a9bdb4d14249a27b401b9c02f644])
I20251025 08:02:27.342665 16158 tablet_loader.cc:96] loaded metadata for tablet 080d77feb2a242959fb8e375f07e5a5f (table default.Table_4c672efab2bb448ab1dcfd4325e8c053 [id=0db3af0dc90e4ea5ac9a029e3864ce58])
I20251025 08:02:27.342984 16158 tablet_loader.cc:96] loaded metadata for tablet 0a187a088f5042c081aa87c79662c8cf (table default.Table_b42eeab602164c40a7721a43fb071328 [id=4b8789f2c2234483aa891cad1334c474])
I20251025 08:02:27.344084 16158 tablet_loader.cc:96] loaded metadata for tablet 1aa4677de4604abaa2dc6e5413c616a3 (table default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4])
I20251025 08:02:27.344269 16158 tablet_loader.cc:96] loaded metadata for tablet 1bd788e8b38b401a89cbc250b3695088 (table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865])
I20251025 08:02:27.344444 16158 tablet_loader.cc:96] loaded metadata for tablet 1d7c262b73904f1f87188718617e38a8 (table default.Table_f5bf4f0664c44a70aa6d2f0e9143f7a7 [id=6739c1319b784c8eb66fc75125f83056])
I20251025 08:02:27.344640 16158 tablet_loader.cc:96] loaded metadata for tablet 1ee00271d2354ae38dcb5a3289cea72f (table default.Table_8fd6304d02a6478fa31556344ab157ae [id=1ee33ee129d749d0bd7f26dc49fca0fe])
I20251025 08:02:27.344946 16158 tablet_loader.cc:96] loaded metadata for tablet 2091a81ad64a4574b04c081bdeceda1f (table default.Table_2931abc275064dfd818fc151a0267713 [id=87037802262e424ebe9c070b5ef7ba62])
I20251025 08:02:27.345131 16158 tablet_loader.cc:96] loaded metadata for tablet 20a3581bd02143bd8a6bdf8e17072faf (table default.Table_d57dfa9ab2164520aa85ebfdd8a85546 [id=317c0892e78047c4b33e1836c3e1776d])
I20251025 08:02:27.345438 16158 tablet_loader.cc:96] loaded metadata for tablet 262014e996b54824824aa99c0b7ad771 (table default.Table_e22e6abaeec0420496616ee334cf07eb [id=b3be7f970bc745f7873e9d54a68e3e50])
I20251025 08:02:27.346084 16158 tablet_loader.cc:96] loaded metadata for tablet 2a0a2af3ed1f41fea41962db52cfe7d8 (table default.Table_0db7fc431dff4c7f85007159dd715e19 [id=1e1120fd790b44569595d67fea5165c2])
I20251025 08:02:27.346788 16158 tablet_loader.cc:96] loaded metadata for tablet 3092fd602dc7478693595ffcbc3bcf45 (table default.Table_e96eec11f48049a9b2a4332b23e60a6f [id=de8b64679bcb4ef582d6edd600342a82])
I20251025 08:02:27.346982 16158 tablet_loader.cc:96] loaded metadata for tablet 346c0c8bf30b4dbaa92436b45e5fbf47 (table default.Table_4afe1c6e03a941df9d5f7df4a42cbc61 [id=ef3a1760f2c44935bbb79e518510905f])
I20251025 08:02:27.347513 16158 tablet_loader.cc:96] loaded metadata for tablet 3743a9de419d40689c49aae471edfa01 (table default.Table_56dd2ffb46cc402fa6a8c180e157a2db [id=7956205ae4e9408988c3d82c46db1706])
I20251025 08:02:27.347714 16158 tablet_loader.cc:96] loaded metadata for tablet 3bf26408c98e49298ff9c738a1e26cf9 (table default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae])
I20251025 08:02:27.348362 16158 tablet_loader.cc:96] loaded metadata for tablet 422e2c32a18a4e1ea9a5e371da17dfea (table default.Table_b2214744ef8c4a4cb1c28ab1689ddbdb [id=e62c2aba4e5546e2bd881c5f2ae3abd4])
I20251025 08:02:27.348546 16158 tablet_loader.cc:96] loaded metadata for tablet 43da3f4fc9604562a95dff59da3c574b (table default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031])
I20251025 08:02:27.348820 16158 tablet_loader.cc:96] loaded metadata for tablet 45be7daf50e741c9b6f1eeedccae8c8e (table default.Table_5854b229e0af41b88196de4a1c9c0270 [id=e95f72536b1242469fd4dad2c4d1c276])
I20251025 08:02:27.349291 16158 tablet_loader.cc:96] loaded metadata for tablet 4c301e7a80c64d8e8751ecfa681ab202 (table default.Table_acf14806991f4da89dc9bb3361537133 [id=e63210d8c6d148e18496c0bc0d326ab9])
I20251025 08:02:27.349493 16158 tablet_loader.cc:96] loaded metadata for tablet 4d9cd745bd3e42e98b0ae1d145007bee (table default.Table_8540557c73a34cc2851ad08d71acac22 [id=abe30167767443d0b8e59f9418399d88])
I20251025 08:02:27.349789 16158 tablet_loader.cc:96] loaded metadata for tablet 4f3163f8a4ff49069d55b9acf8a4c19a (table default.Table_2631732663a24b55a695edc159006f87 [id=b9853b2d88cf4a96b9fc5e1099f87064])
I20251025 08:02:27.349988 16158 tablet_loader.cc:96] loaded metadata for tablet 5022f9beb59449828f59dca9d14caa50 (table default.Table_94e6d6f804c346ce97b427caf864614e [id=ce6a220ddfc540dbb17e28bc74b66449])
I20251025 08:02:27.350150 16158 tablet_loader.cc:96] loaded metadata for tablet 53f89ab2ef9b4136812cb4a320a645a6 (table default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e])
I20251025 08:02:27.350694 16158 tablet_loader.cc:96] loaded metadata for tablet 5a70808199034508833e4d2e5550b29b (table default.Table_49352274aacf479292f43c128367eeb0 [id=a788bc4f491d4d7580a83895797f5651])
I20251025 08:02:27.350852 16158 tablet_loader.cc:96] loaded metadata for tablet 5a940a0698d64770bf5826d9290117b4 (table default.Table_782772638c3646fea7dfa5ecc8e01959 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155])
I20251025 08:02:27.351156 16158 tablet_loader.cc:96] loaded metadata for tablet 5b49d48b94b0427aa2dcc39dae45a4eb (table default.Table_20420bbacfa743d4ad1ed935423c4ff5 [id=6c847ade4b8f485fb3353af3d2ec442b])
I20251025 08:02:27.351351 16158 tablet_loader.cc:96] loaded metadata for tablet 5bf286568e8343b7921ac256a9313e63 (table default.Table_b22d946b289a4a0aa9c6ef1135c68e60 [id=46383e9b028a4d2bb7b39e04f147491e])
I20251025 08:02:27.351543 16158 tablet_loader.cc:96] loaded metadata for tablet 5d25a2805a264574bc20150762c48262 (table default.Table_4a9fc326b302473f86d8d3f7e7b8040f [id=15a38bbafe4045e9991cb846ec9e452c])
I20251025 08:02:27.352475 16158 tablet_loader.cc:96] loaded metadata for tablet 72ff369b973b4c5981ea0810e37e8562 (table default.Table_4ed89f5fc452467d920d19caa6fb931a [id=8a0e4fe9e4544c539cb23b0279c1deaf])
I20251025 08:02:27.352788 16158 tablet_loader.cc:96] loaded metadata for tablet 76a906654cc44bfb96d9e1a936040e57 (table default.Table_4598018e26254b78befa93852241f777 [id=78794c8ceec3479ca3ac3ef55594762f])
I20251025 08:02:27.353351 16158 tablet_loader.cc:96] loaded metadata for tablet 792c6d7038624ec29e5e36c0145c64db (table default.Table_4b7b9ad86d85404785a42b98239e38cc [id=7505f67ea24847a6aa9c90955f1596fa])
I20251025 08:02:27.353662 16158 tablet_loader.cc:96] loaded metadata for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec (table default.Table_28db4c3dec79421c9ad752690a383ea4 [id=593c3f07bdaa45d49e1c8cf97cf0c2c7])
I20251025 08:02:27.353864 16158 tablet_loader.cc:96] loaded metadata for tablet 7b8d94fc010046c7b37804f168471904 (table default.Table_521f904aba4a4b309e9864df54df659d [id=a95abf5644c64177afde71baad186bca])
I20251025 08:02:27.354060 16158 tablet_loader.cc:96] loaded metadata for tablet 7f5c6a17507d4a5a8057a725d3299ab9 (table default.Table_7257511e2df84f9cafdd1fe1ec4a180b [id=b5be4f412cc04aa59c819d0e1cc403bf])
I20251025 08:02:27.354290 16158 tablet_loader.cc:96] loaded metadata for tablet 801d06a391e34bec8e1f74257937f069 (table default.Table_cd97ecbd521e4d4b8f03836dbb9e15cf [id=59daf7f960b84b148da5d5f30db95bfe])
I20251025 08:02:27.354718 16158 tablet_loader.cc:96] loaded metadata for tablet 821de6815eb244058f1d8a7a06bf48a6 (table default.Table_c485105a684f427295b74968c29fd30c [id=3abb3c7d3dd74d408db083bf0499f679])
I20251025 08:02:27.355029 16158 tablet_loader.cc:96] loaded metadata for tablet 8737df10a3c8482c995ac6aadc240c42 (table default.Table_7a2d41df4f9d4874b3403fdef1ae1e72 [id=c8b69f7419b842c18f324e0c08ba840a])
I20251025 08:02:27.355378 16158 tablet_loader.cc:96] loaded metadata for tablet 88efe498fb6f4ce1a02b5389ff6f5797 (table default.Table_670e2c0d014c4003af93e44a18490fda [id=c824002e1e954b65be5aee4a39a78cd0])
I20251025 08:02:27.355615 16158 tablet_loader.cc:96] loaded metadata for tablet 8e0cc372400447b48e5fecfc009a11c2 (table default.Table_ad3dee0a2af74757a17bc9fd115a69cb [id=e9162dd5a2524394b1cb11594293de96])
I20251025 08:02:27.355818 16158 tablet_loader.cc:96] loaded metadata for tablet 90bb43eb01c949b09f7a4c703a99dc7e (table default.Table_2d1acf2ab32844f2a253a5d5ab46d842 [id=3abdeeb0fca0413d8af86b1c0ad383b4])
I20251025 08:02:27.356478 16158 tablet_loader.cc:96] loaded metadata for tablet 93779f31ade9494f9056cc15665efb0d (table default.Table_0f884fc2a3c74502aa6bad6c3a9b49a8 [id=ae530558880e4fa4b18c3f87e21c0fd0])
I20251025 08:02:27.356825 16158 tablet_loader.cc:96] loaded metadata for tablet 95c9778bd0d94542bec79e9d36c6ce46 (table default.Table_7387f487853a4b608f5e5237684550d8 [id=3e1281c3f28346a4a1dd2c4fcc990a2e])
I20251025 08:02:27.357316 16158 tablet_loader.cc:96] loaded metadata for tablet 997c8c5921ad4ec18914fd50c97fc33e (table default.Table_a210a38e85814b3db16726f2a0a830b8 [id=cb9294ed7c474aae989ac13159ec3166])
I20251025 08:02:27.357517 16158 tablet_loader.cc:96] loaded metadata for tablet 9ca9757e456d40a4891750a39c037598 (table default.Table_dc0d80dcd5304d218f07109ec6675955 [id=faaa356c17964d04adce7f36bf5784cf])
I20251025 08:02:27.357826 16158 tablet_loader.cc:96] loaded metadata for tablet a25116c3ecda411bb480cc47a3ca6bf5 (table default.Table_51c8e80718644971942377f115aee6ea [id=74592e2000d243869f94a1c513fc04e9])
I20251025 08:02:27.358368 16158 tablet_loader.cc:96] loaded metadata for tablet a608dd2b2d1d42178bb00b3355bd6470 (table default.Table_808c7980d96b48a181f79124ea5a0adb [id=e3c0ae796ee2421abe38408b729dd2a6])
I20251025 08:02:27.358546 16158 tablet_loader.cc:96] loaded metadata for tablet a68d3a248e944a83ba77b651793cc480 (table default.Table_bd3b1a4a23a447bead9ce165c79693e6 [id=000ce64aa9d14e45ae6570f8948bb0a3])
I20251025 08:02:27.358738 16158 tablet_loader.cc:96] loaded metadata for tablet a8393462039d4bb4aba66aee9e90b94a (table default.Table_c91b6d76e1384dd99d7e69ddee320afb [id=244c5edd72af4af790d96dd294e8d8c4])
I20251025 08:02:27.359339 16158 tablet_loader.cc:96] loaded metadata for tablet adc14c254b0c4974bfbadede727b6c6b (table default.Table_d8110cf18c6748b092f8bf7348349f88 [id=53d57abf556c4926b02a1e265cf34c61])
I20251025 08:02:27.359833 16158 tablet_loader.cc:96] loaded metadata for tablet b3fdc5bd4c7f4506a150f31137e8b091 (table default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a])
I20251025 08:02:27.360129 16158 tablet_loader.cc:96] loaded metadata for tablet b7e8a698e8ba408a833bbc3905b2ad04 (table default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09])
I20251025 08:02:27.360487 16158 tablet_loader.cc:96] loaded metadata for tablet bcb5f7e52507450c8a6f5a99a9927974 (table default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97])
I20251025 08:02:27.360705 16158 tablet_loader.cc:96] loaded metadata for tablet bcf414d04305456b80b2ec5dd8fb0ba7 (table default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24])
I20251025 08:02:27.361161 16158 tablet_loader.cc:96] loaded metadata for tablet c20947edc1f24e338cabf72b18282d24 (table default.Table_8436de66616b479fa1982a64ba3579d0 [id=cb6856b315084424836559dacbe12c28])
I20251025 08:02:27.361642 16158 tablet_loader.cc:96] loaded metadata for tablet c6ee2b8cfe7743d29714910fe8060083 (table default.Table_643cee182de94bbf9718fb59a00cf85c [id=aa46eca7031242f3b4a3144dd521cc6b])
I20251025 08:02:27.362562 16158 tablet_loader.cc:96] loaded metadata for tablet d14e12c45323420b84de06d828238caa (table default.Table_6ae5d8954fba433fa72fd9cbaa925f2a [id=6b4ebc3c554648b48d6ea2f5916e1bad])
I20251025 08:02:27.362785 16158 tablet_loader.cc:96] loaded metadata for tablet d2697ee09dc74d35abffc3158410aa5e (table default.Table_541e363972b34e9b9b64f21b771e7ce2 [id=bdcc7cd59c78409fad7b5f687ae81310])
I20251025 08:02:27.363920 16158 tablet_loader.cc:96] loaded metadata for tablet e0635cb57c4d4d51bed5897b28cc3dcd (table default.Table_bb2712f0481c486fa9db6d0113289be2 [id=198c7d73328440ac8c6eef2c24c5e0ad])
I20251025 08:02:27.364157 16158 tablet_loader.cc:96] loaded metadata for tablet e2b014e0f49c4f7da8e65b7d4c98ea63 (table default.Table_5228048f3783458dbb44280a7a6e4816 [id=7fe739c2f676459d8c73632266babedb])
I20251025 08:02:27.364392 16158 tablet_loader.cc:96] loaded metadata for tablet e3cd7b63fa174ee192ff909f149e8b17 (table default.Table_a368af9d0b8d46d78f9158b8f9949b01 [id=425e69ea7f8a407e8d22b735ee62c709])
I20251025 08:02:27.364606 16158 tablet_loader.cc:96] loaded metadata for tablet e4f92b0605754327883b144fb6c96aea (table default.Table_eaf82018b440497e86dbf2cfdd3785e5 [id=2ef2d72066f446619f9045da34df7814])
I20251025 08:02:27.365250 16158 tablet_loader.cc:96] loaded metadata for tablet e66c7b43490a4391a59e09f1832a53b3 (table default.Table_fa9d9b9a535648d89d19b74bb940ed9f [id=b3e6b8f18f2f40fc977b978d7d2c1b0b])
I20251025 08:02:27.365486 16158 tablet_loader.cc:96] loaded metadata for tablet ea0d438e99864c57999abf3467edc643 (table default.Table_3c48d3160e5d42509de4f0be1af855e2 [id=912da5ef8bbf4af29528c084ea7fa633])
I20251025 08:02:27.365818 16158 tablet_loader.cc:96] loaded metadata for tablet eed2815efb7e46dd8b41f5ffe60daee8 (table default.Table_4a4b1eeaa5674710a1a13d7f0f395737 [id=f9c1f298fed0456eb9fd34fe9c124190])
I20251025 08:02:27.366142 16158 tablet_loader.cc:96] loaded metadata for tablet f08d0c3446dd4a478f81688a3259bb91 (table default.Table_84b80cef0bc442cfb9f5301562ff1cce [id=ab926bc9b7424c45a5415c4763db2b4e])
I20251025 08:02:27.366971 16158 tablet_loader.cc:96] loaded metadata for tablet f8576553f17b49f8bd11436ecac471ed (table default.Table_8f781f3f507c4a339ba15100b719fcbb [id=2283253a9522485d93d6c484c5eef6e4])
I20251025 08:02:27.367327 16158 tablet_loader.cc:96] loaded metadata for tablet fc5f892ca7a246a28a556fe0eb3f5442 (table default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b [id=4e47e7759fc64598807f1ee3a973820f])
I20251025 08:02:27.367995 16158 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251025 08:02:27.370851 16158 catalog_manager.cc:1269] Loaded cluster ID: f2d8b893da824042af3b8623826039ce
I20251025 08:02:27.370908 16158 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251025 08:02:27.373651 16158 catalog_manager.cc:1514] Loading token signing keys...
I20251025 08:02:27.379083 16158 catalog_manager.cc:6033] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Loaded TSK: 0
I20251025 08:02:27.380038 16158 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251025 08:02:27.392813 15296 heartbeater.cc:344] Connected to a master server at 127.14.70.62:39499
I20251025 08:02:27.394347 14725 catalog_manager.cc:5649] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:27.400168 14726 catalog_manager.cc:5649] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:27.414188 14726 catalog_manager.cc:5649] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:27.423246 14723 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_035df9ac9f6541dd9b042857523d0659"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:27.423527 14719 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_96eed584de4f4711b66e6f802a78ca6f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:27.423794 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_67238f79fb2446bd9c19c32182814dd0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:27.424057 14724 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_7a2d41df4f9d4874b3403fdef1ae1e72" } new_table_name: "default.Table_475579a80dad4c89bfd895cd2fdaafaf" modify_external_catalogs: true
I20251025 08:02:27.424202 14718 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_c93b71eeb33d4dcc9501dd2efdde7556"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.424328 14723 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_035df9ac9f6541dd9b042857523d0659 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:27.424460 14718 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.424846 14718 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_acf14806991f4da89dc9bb3361537133"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:27.425055 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_027f43c7a0d34932a84b5f0922e7da40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.425122 14718 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acf14806991f4da89dc9bb3361537133 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:27.425247 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67238f79fb2446bd9c19c32182814dd0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:27.425330 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_027f43c7a0d34932a84b5f0922e7da40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.425379 14718 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_89703a34a83e4da8973b625249c4a03d" } modify_external_catalogs: true
I20251025 08:02:27.425462 14718 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_89703a34a83e4da8973b625249c4a03d" } modify_external_catalogs: true
W20251025 08:02:27.425745 14719 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_96eed584de4f4711b66e6f802a78ca6f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.426395 14720 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_891766baabb34ace9d4695004f20f425"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.426604 14720 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_891766baabb34ace9d4695004f20f425 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.426759 14720 master_service.cc:954] ReplaceTablet: received request to replace tablet eed2815efb7e46dd8b41f5ffe60daee8 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:27.427337 14721 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_e19c72b5fee34ad6803d4f2eb019c071"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.427565 14721 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e19c72b5fee34ad6803d4f2eb019c071 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.431823 14726 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_fc9c7434bd43470c9134da3d60417d99" } modify_external_catalogs: true
I20251025 08:02:27.431957 14726 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_fc9c7434bd43470c9134da3d60417d99" } modify_external_catalogs: true
I20251025 08:02:27.432799 15027 heartbeater.cc:499] Master 127.14.70.61:44347 was elected leader, sending a full tablet report...
I20251025 08:02:27.438109 14718 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet bcb5f7e52507450c8a6f5a99a9927974
W20251025 08:02:27.440832 14724 catalog_manager.cc:5101] could not convert tablet's 8737df10a3c8482c995ac6aadc240c42 schema from PB: OK
I20251025 08:02:27.442806 14720 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet eed2815efb7e46dd8b41f5ffe60daee8
I20251025 08:02:27.443069 14720 catalog_manager.cc:6719] ReplaceTablet: tablet eed2815efb7e46dd8b41f5ffe60daee8 deleted and replaced by tablet 7711a974f4a84d639f1c3077da9d855f
I20251025 08:02:27.443215 14720 master_service.cc:954] ReplaceTablet: received request to replace tablet 5d25a2805a264574bc20150762c48262 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:27.443759 14723 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_dc0d80dcd5304d218f07109ec6675955" } modify_external_catalogs: true
I20251025 08:02:27.443854 14723 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_dc0d80dcd5304d218f07109ec6675955" } modify_external_catalogs: true
I20251025 08:02:27.444002 14725 master_service.cc:954] ReplaceTablet: received request to replace tablet d2697ee09dc74d35abffc3158410aa5e from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:27.444171 14719 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_bb2712f0481c486fa9db6d0113289be2" } modify_external_catalogs: true
I20251025 08:02:27.444260 14719 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_bb2712f0481c486fa9db6d0113289be2" } modify_external_catalogs: true
I20251025 08:02:27.447096 14724 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_7a87c8dce3c3439db7879b9d642a745f" } new_table_name: "default.Table_52aa8e04fcc241078c3c06f3157a5e4b" modify_external_catalogs: true
I20251025 08:02:27.452850 14721 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_b42eeab602164c40a7721a43fb071328" } modify_external_catalogs: true
I20251025 08:02:27.452965 14721 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_b42eeab602164c40a7721a43fb071328" } modify_external_catalogs: true
I20251025 08:02:27.453207 14727 master_service.cc:954] ReplaceTablet: received request to replace tablet a608dd2b2d1d42178bb00b3355bd6470 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:27.455127 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet bcb5f7e52507450c8a6f5a99a9927974 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.455312 15162 heartbeater.cc:499] Master 127.14.70.61:44347 was elected leader, sending a full tablet report...
I20251025 08:02:27.456552 15219 tablet_service.cc:1552] Processing DeleteTablet for tablet eed2815efb7e46dd8b41f5ffe60daee8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7711a974f4a84d639f1c3077da9d855f) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.459084 16364 tablet_replica.cc:333] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.460738 16364 raft_consensus.cc:2243] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.460893 16364 raft_consensus.cc:2272] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.461506 16364 ts_tablet_manager.cc:1916] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.463785 14725 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet d2697ee09dc74d35abffc3158410aa5e
I20251025 08:02:27.463837 16364 ts_tablet_manager.cc:1929] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.463904 16364 log.cc:1199] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/bcb5f7e52507450c8a6f5a99a9927974
I20251025 08:02:27.464046 14725 catalog_manager.cc:6719] ReplaceTablet: tablet d2697ee09dc74d35abffc3158410aa5e deleted and replaced by tablet 04d3488a6b814223b742f0d5c946362f
I20251025 08:02:27.464196 16364 ts_tablet_manager.cc:1950] T bcb5f7e52507450c8a6f5a99a9927974 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:27.464725 16364 tablet_replica.cc:333] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.464840 16364 raft_consensus.cc:2243] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.464928 16364 raft_consensus.cc:2272] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.466250 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet bcb5f7e52507450c8a6f5a99a9927974 (table default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]) successfully deleted
I20251025 08:02:27.466826 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet d2697ee09dc74d35abffc3158410aa5e with delete_type TABLET_DATA_DELETED (replaced by tablet 04d3488a6b814223b742f0d5c946362f) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.467206 14722 master_service.cc:954] ReplaceTablet: received request to replace tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:27.469035 14720 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 5d25a2805a264574bc20150762c48262
I20251025 08:02:27.469085 14727 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet a608dd2b2d1d42178bb00b3355bd6470
I20251025 08:02:27.469272 14720 catalog_manager.cc:6719] ReplaceTablet: tablet 5d25a2805a264574bc20150762c48262 deleted and replaced by tablet 221f4c5432bc45e18728f5ed1453ad0f
I20251025 08:02:27.469328 14727 catalog_manager.cc:6719] ReplaceTablet: tablet a608dd2b2d1d42178bb00b3355bd6470 deleted and replaced by tablet c59083b54df24c21a3114c34a73dd638
I20251025 08:02:27.469400 14720 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_2631732663a24b55a695edc159006f87" } new_table_name: "default.Table_1acaea81b51b4fe48d3777375cde2fff" modify_external_catalogs: true
I20251025 08:02:27.469475 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_d4e0362387994cd8a9584073e55c7b32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.469738 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d4e0362387994cd8a9584073e55c7b32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.470510 16364 ts_tablet_manager.cc:1916] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.470772 15219 tablet_service.cc:1552] Processing DeleteTablet for tablet 5d25a2805a264574bc20150762c48262 with delete_type TABLET_DATA_DELETED (replaced by tablet 221f4c5432bc45e18728f5ed1453ad0f) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.471410 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet a608dd2b2d1d42178bb00b3355bd6470 with delete_type TABLET_DATA_DELETED (replaced by tablet c59083b54df24c21a3114c34a73dd638) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.472385 16364 ts_tablet_manager.cc:1929] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.472462 16364 log.cc:1199] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/eed2815efb7e46dd8b41f5ffe60daee8
I20251025 08:02:27.472730 16364 ts_tablet_manager.cc:1950] T eed2815efb7e46dd8b41f5ffe60daee8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:27.473268 16364 tablet_replica.cc:333] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.473635 14723 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet 9ca9757e456d40a4891750a39c037598
I20251025 08:02:27.473730 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet eed2815efb7e46dd8b41f5ffe60daee8 (table default.Table_4a4b1eeaa5674710a1a13d7f0f395737 [id=f9c1f298fed0456eb9fd34fe9c124190]) successfully deleted
I20251025 08:02:27.473814 14723 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_cd97ecbd521e4d4b8f03836dbb9e15cf" } new_table_name: "default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8" modify_external_catalogs: true
I20251025 08:02:27.477463 14722 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec
I20251025 08:02:27.477677 16364 raft_consensus.cc:2243] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.477726 14722 catalog_manager.cc:6719] ReplaceTablet: tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec deleted and replaced by tablet 51fca67cb1b84e44a491b6a788c01062
I20251025 08:02:27.478276 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec with delete_type TABLET_DATA_DELETED (replaced by tablet 51fca67cb1b84e44a491b6a788c01062) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.478294 16364 raft_consensus.cc:2272] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.480134 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet bcb5f7e52507450c8a6f5a99a9927974 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.480253 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet d2697ee09dc74d35abffc3158410aa5e with delete_type TABLET_DATA_DELETED (replaced by tablet 04d3488a6b814223b742f0d5c946362f) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.480352 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet eed2815efb7e46dd8b41f5ffe60daee8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7711a974f4a84d639f1c3077da9d855f) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.480397 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec with delete_type TABLET_DATA_DELETED (replaced by tablet 51fca67cb1b84e44a491b6a788c01062) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.480515 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 5d25a2805a264574bc20150762c48262 with delete_type TABLET_DATA_DELETED (replaced by tablet 221f4c5432bc45e18728f5ed1453ad0f) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.480563 16370 tablet.cc:1722] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.480620 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet a608dd2b2d1d42178bb00b3355bd6470 with delete_type TABLET_DATA_DELETED (replaced by tablet c59083b54df24c21a3114c34a73dd638) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.481057 16364 ts_tablet_manager.cc:1916] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.481333 14718 catalog_manager.cc:5649] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:27.481505 14718 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 43da3f4fc9604562a95dff59da3c574b (table default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031]). Expected version 2 got 0
I20251025 08:02:27.481572 16365 tablet.cc:1722] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.481670 14718 catalog_manager.cc:5649] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:27.481864 16366 tablet.cc:1722] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.481918 14718 catalog_manager.cc:5649] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:27.482116 14718 catalog_manager.cc:5649] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:27.482299 14718 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 0a187a088f5042c081aa87c79662c8cf (table default.Table_b42eeab602164c40a7721a43fb071328 [id=4b8789f2c2234483aa891cad1334c474]). Expected version 1 got 0
I20251025 08:02:27.482453 14718 catalog_manager.cc:5649] T adc14c254b0c4974bfbadede727b6c6b P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:27.482616 14718 catalog_manager.cc:5649] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:27.482743 14718 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet b3fdc5bd4c7f4506a150f31137e8b091 (table default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a]). Expected version 1 got 0
I20251025 08:02:27.482877 14718 catalog_manager.cc:5649] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:27.483065 14718 catalog_manager.cc:5649] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:27.483183 16364 ts_tablet_manager.cc:1929] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.483196 14718 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 95c9778bd0d94542bec79e9d36c6ce46 (table default.Table_7387f487853a4b608f5e5237684550d8 [id=3e1281c3f28346a4a1dd2c4fcc990a2e]). Expected version 2 got 0
I20251025 08:02:27.483348 14718 catalog_manager.cc:5649] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:27.483577 14718 catalog_manager.cc:5649] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:27.483688 14718 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 4f3163f8a4ff49069d55b9acf8a4c19a (table default.Table_2631732663a24b55a695edc159006f87 [id=b9853b2d88cf4a96b9fc5e1099f87064]). Expected version 1 got 0
I20251025 08:02:27.483764 14718 catalog_manager.cc:5649] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:27.483927 14718 catalog_manager.cc:5649] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:27.484076 14718 catalog_manager.cc:5649] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:27.484169 14718 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet bcf414d04305456b80b2ec5dd8fb0ba7 (table default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24]). Expected version 1 got 0
I20251025 08:02:27.484251 16364 log.cc:1199] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/d2697ee09dc74d35abffc3158410aa5e
I20251025 08:02:27.484251 14718 catalog_manager.cc:5649] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:27.484372 14718 catalog_manager.cc:5649] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:27.484514 14718 catalog_manager.cc:5649] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:27.484632 14718 catalog_manager.cc:5649] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:27.485208 16364 ts_tablet_manager.cc:1950] T d2697ee09dc74d35abffc3158410aa5e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:27.486671 16364 tablet_replica.cc:333] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.486845 16371 tablet_replica.cc:333] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:27.487035 16371 raft_consensus.cc:2243] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:27.487269 16371 raft_consensus.cc:2272] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.487267 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet d2697ee09dc74d35abffc3158410aa5e (table default.Table_541e363972b34e9b9b64f21b771e7ce2 [id=bdcc7cd59c78409fad7b5f687ae81310]) successfully deleted
I20251025 08:02:27.487454 16364 raft_consensus.cc:2243] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.487607 16364 raft_consensus.cc:2272] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.487710 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_c72833b153cc441eaeff12a70a584954"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.488057 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c72833b153cc441eaeff12a70a584954 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.488531 16371 ts_tablet_manager.cc:1916] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.489656 14727 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_f5bf4f0664c44a70aa6d2f0e9143f7a7" } new_table_name: "default.Table_dab6241c02794509a694715ad8cfd171" modify_external_catalogs: true
I20251025 08:02:27.490844 16364 ts_tablet_manager.cc:1916] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.493242 16371 ts_tablet_manager.cc:1929] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.494262 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet bcb5f7e52507450c8a6f5a99a9927974 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.494458 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet eed2815efb7e46dd8b41f5ffe60daee8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7711a974f4a84d639f1c3077da9d855f) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.494585 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet d2697ee09dc74d35abffc3158410aa5e with delete_type TABLET_DATA_DELETED (replaced by tablet 04d3488a6b814223b742f0d5c946362f) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.494699 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec with delete_type TABLET_DATA_DELETED (replaced by tablet 51fca67cb1b84e44a491b6a788c01062) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.494709 14718 catalog_manager.cc:5649] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:27.494585 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 5d25a2805a264574bc20150762c48262 with delete_type TABLET_DATA_DELETED (replaced by tablet 221f4c5432bc45e18728f5ed1453ad0f) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.495256 14718 catalog_manager.cc:5649] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:27.495515 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet a608dd2b2d1d42178bb00b3355bd6470 with delete_type TABLET_DATA_DELETED (replaced by tablet c59083b54df24c21a3114c34a73dd638) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.495664 14718 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 346c0c8bf30b4dbaa92436b45e5fbf47 (table default.Table_4afe1c6e03a941df9d5f7df4a42cbc61 [id=ef3a1760f2c44935bbb79e518510905f]). Expected version 1 got 0
I20251025 08:02:27.496160 14718 catalog_manager.cc:5649] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:27.496531 14718 catalog_manager.cc:5649] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:27.496840 14718 catalog_manager.cc:5649] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:27.497052 14718 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 4d9cd745bd3e42e98b0ae1d145007bee (table default.Table_8540557c73a34cc2851ad08d71acac22 [id=abe30167767443d0b8e59f9418399d88]). Expected version 1 got 0
I20251025 08:02:27.497232 14718 catalog_manager.cc:5649] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:27.497447 14718 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet ea0d438e99864c57999abf3467edc643 (table default.Table_3c48d3160e5d42509de4f0be1af855e2 [id=912da5ef8bbf4af29528c084ea7fa633]). Expected version 1 got 0
I20251025 08:02:27.499162 14718 catalog_manager.cc:5649] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:27.499399 14718 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 72ff369b973b4c5981ea0810e37e8562 (table default.Table_4ed89f5fc452467d920d19caa6fb931a [id=8a0e4fe9e4544c539cb23b0279c1deaf]). Expected version 1 got 0
I20251025 08:02:27.499564 14718 catalog_manager.cc:5649] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:27.499809 14718 catalog_manager.cc:5649] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:27.500057 14718 catalog_manager.cc:5649] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:27.500947 16364 ts_tablet_manager.cc:1929] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.501075 16364 log.cc:1199] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/5d25a2805a264574bc20150762c48262
I20251025 08:02:27.505151 16364 ts_tablet_manager.cc:1950] T 5d25a2805a264574bc20150762c48262 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:27.502056 14914 consensus_peers.cc:597] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d2697ee09dc74d35abffc3158410aa5e. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:27.505329 16371 log.cc:1199] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/bcb5f7e52507450c8a6f5a99a9927974
I20251025 08:02:27.505966 16364 tablet_replica.cc:333] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.506036 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 5d25a2805a264574bc20150762c48262 (table default.Table_4a9fc326b302473f86d8d3f7e7b8040f [id=15a38bbafe4045e9991cb846ec9e452c]) successfully deleted
I20251025 08:02:27.506376 16371 ts_tablet_manager.cc:1950] T bcb5f7e52507450c8a6f5a99a9927974 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:27.506810 16371 tablet_replica.cc:333] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:27.506897 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet bcb5f7e52507450c8a6f5a99a9927974 (table default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]) successfully deleted
I20251025 08:02:27.507007 16364 raft_consensus.cc:2243] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.507181 16371 raft_consensus.cc:2243] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:27.507314 16364 raft_consensus.cc:2272] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.507516 16371 raft_consensus.cc:2272] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.508044 16364 ts_tablet_manager.cc:1916] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.511188 14718 catalog_manager.cc:5649] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:27.511541 16372 tablet_replica.cc:333] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:27.511714 16372 raft_consensus.cc:2243] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.511864 16372 raft_consensus.cc:2272] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:27.511646 14727 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d7c262b73904f1f87188718617e38a8 has no consensus state
I20251025 08:02:27.512447 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_5409b3ddf1af4457a122ed2c85fa24f0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.512746 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5409b3ddf1af4457a122ed2c85fa24f0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.513486 16372 ts_tablet_manager.cc:1916] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.512048 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_6a66d07dc986487694277236df040244"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.515064 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6a66d07dc986487694277236df040244 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.515350 16324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Bootstrap replayed 1/1 log segments. Stats: ops{read=404 overwritten=0 applied=401 ignored=0} inserts{seen=296 ignored=0} mutations{seen=449 ignored=0} orphaned_commits=0. Pending: 3 replicates
I20251025 08:02:27.515626 16371 ts_tablet_manager.cc:1916] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.516111 15161 heartbeater.cc:344] Connected to a master server at 127.14.70.62:39499
I20251025 08:02:27.516618 14718 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 76a906654cc44bfb96d9e1a936040e57 (table default.Table_4598018e26254b78befa93852241f777 [id=78794c8ceec3479ca3ac3ef55594762f]). Expected version 2 got 0
I20251025 08:02:27.516806 14718 catalog_manager.cc:5649] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:27.517033 14718 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet f08d0c3446dd4a478f81688a3259bb91 (table default.Table_84b80cef0bc442cfb9f5301562ff1cce [id=ab926bc9b7424c45a5415c4763db2b4e]). Expected version 1 got 0
I20251025 08:02:27.517177 14718 catalog_manager.cc:5649] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:27.517429 14718 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 8737df10a3c8482c995ac6aadc240c42 (table default.Table_475579a80dad4c89bfd895cd2fdaafaf [id=c8b69f7419b842c18f324e0c08ba840a]). Expected version 1 got 0
I20251025 08:02:27.517820 16364 ts_tablet_manager.cc:1929] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.515825 16324 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Bootstrap complete.
I20251025 08:02:27.521922 16371 ts_tablet_manager.cc:1929] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.523011 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_eb227195b7e4404bb817d7d5e6a87e14"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.523286 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_eb227195b7e4404bb817d7d5e6a87e14 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.523849 16371 log.cc:1199] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/d2697ee09dc74d35abffc3158410aa5e
I20251025 08:02:27.524102 16371 ts_tablet_manager.cc:1950] T d2697ee09dc74d35abffc3158410aa5e P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:27.524593 16371 tablet_replica.cc:333] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:27.524714 16371 raft_consensus.cc:2243] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.524796 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet d2697ee09dc74d35abffc3158410aa5e (table default.Table_541e363972b34e9b9b64f21b771e7ce2 [id=bdcc7cd59c78409fad7b5f687ae81310]) successfully deleted
I20251025 08:02:27.525583 16372 ts_tablet_manager.cc:1929] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.525655 16372 log.cc:1199] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/bcb5f7e52507450c8a6f5a99a9927974
I20251025 08:02:27.523240 15297 heartbeater.cc:499] Master 127.14.70.61:44347 was elected leader, sending a full tablet report...
I20251025 08:02:27.526760 16324 raft_consensus.cc:359] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 2 FOLLOWER]: Replica starting. Triggering 3 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:27.530298 16364 log.cc:1199] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/a608dd2b2d1d42178bb00b3355bd6470
I20251025 08:02:27.530562 16364 ts_tablet_manager.cc:1950] T a608dd2b2d1d42178bb00b3355bd6470 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:27.531127 16371 raft_consensus.cc:2272] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.531407 16372 ts_tablet_manager.cc:1950] T bcb5f7e52507450c8a6f5a99a9927974 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:27.531847 16324 raft_consensus.cc:740] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94a96657c5fd49398b88e9ad615bfe1e, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.531953 16372 tablet_replica.cc:333] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:27.532078 16372 raft_consensus.cc:2243] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:27.532272 16372 raft_consensus.cc:2272] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.532788 16371 ts_tablet_manager.cc:1916] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.532825 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet a608dd2b2d1d42178bb00b3355bd6470 (table default.Table_808c7980d96b48a181f79124ea5a0adb [id=e3c0ae796ee2421abe38408b729dd2a6]) successfully deleted
I20251025 08:02:27.533407 16324 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 401, Last appended: 2.404, Last appended by leader: 404, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:27.533638 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet bcb5f7e52507450c8a6f5a99a9927974 (table default.Table_89703a34a83e4da8973b625249c4a03d [id=2cb5883aa98b4e52b3f989fe51ad1f97]) successfully deleted
I20251025 08:02:27.534441 16371 ts_tablet_manager.cc:1929] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.534505 16371 log.cc:1199] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/eed2815efb7e46dd8b41f5ffe60daee8
I20251025 08:02:27.534742 16371 ts_tablet_manager.cc:1950] T eed2815efb7e46dd8b41f5ffe60daee8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:27.535199 16371 tablet_replica.cc:333] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:27.535324 16371 raft_consensus.cc:2243] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:27.535470 16371 raft_consensus.cc:2272] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.535552 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet eed2815efb7e46dd8b41f5ffe60daee8 (table default.Table_4a4b1eeaa5674710a1a13d7f0f395737 [id=f9c1f298fed0456eb9fd34fe9c124190]) successfully deleted
I20251025 08:02:27.535641 16364 tablet_replica.cc:333] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.535768 16364 raft_consensus.cc:2243] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.535862 16364 raft_consensus.cc:2272] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.536470 16364 ts_tablet_manager.cc:1916] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.537611 16371 ts_tablet_manager.cc:1916] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.538585 16364 ts_tablet_manager.cc:1929] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.538707 16364 log.cc:1199] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/7ae3f4cdb1b14d1abe884c4a0628a6ec
I20251025 08:02:27.539017 16364 ts_tablet_manager.cc:1950] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:27.539600 16371 ts_tablet_manager.cc:1929] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.539712 16371 log.cc:1199] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/7ae3f4cdb1b14d1abe884c4a0628a6ec
I20251025 08:02:27.539987 16371 ts_tablet_manager.cc:1950] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:27.540289 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec (table default.Table_28db4c3dec79421c9ad752690a383ea4 [id=593c3f07bdaa45d49e1c8cf97cf0c2c7]) successfully deleted
I20251025 08:02:27.540795 16371 tablet_replica.cc:333] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:27.540863 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec (table default.Table_28db4c3dec79421c9ad752690a383ea4 [id=593c3f07bdaa45d49e1c8cf97cf0c2c7]) successfully deleted
I20251025 08:02:27.540973 16371 raft_consensus.cc:2243] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.541083 16371 raft_consensus.cc:2272] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.541563 16371 ts_tablet_manager.cc:1916] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.541669 16324 sys_catalog.cc:565] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: configured and running, proceeding with master startup.
I20251025 08:02:27.542574 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 43da3f4fc9604562a95dff59da3c574b (table default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031]). Expected version 2 got 0
I20251025 08:02:27.543098 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet b3fdc5bd4c7f4506a150f31137e8b091 (table default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a]). Expected version 1 got 0
I20251025 08:02:27.543494 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet bcf414d04305456b80b2ec5dd8fb0ba7 (table default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24]). Expected version 1 got 0
I20251025 08:02:27.543650 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 4f3163f8a4ff49069d55b9acf8a4c19a (table default.Table_2631732663a24b55a695edc159006f87 [id=b9853b2d88cf4a96b9fc5e1099f87064]). Expected version 1 got 0
I20251025 08:02:27.543856 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 346c0c8bf30b4dbaa92436b45e5fbf47 (table default.Table_4afe1c6e03a941df9d5f7df4a42cbc61 [id=ef3a1760f2c44935bbb79e518510905f]). Expected version 1 got 0
I20251025 08:02:27.545116 16374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:27.545333 16374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:27.545584 16371 ts_tablet_manager.cc:1929] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.545703 16371 log.cc:1199] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/5d25a2805a264574bc20150762c48262
I20251025 08:02:27.546090 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 4d9cd745bd3e42e98b0ae1d145007bee (table default.Table_8540557c73a34cc2851ad08d71acac22 [id=abe30167767443d0b8e59f9418399d88]). Expected version 1 got 0
I20251025 08:02:27.546248 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet ea0d438e99864c57999abf3467edc643 (table default.Table_3c48d3160e5d42509de4f0be1af855e2 [id=912da5ef8bbf4af29528c084ea7fa633]). Expected version 1 got 0
I20251025 08:02:27.546319 16371 ts_tablet_manager.cc:1950] T 5d25a2805a264574bc20150762c48262 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:27.546362 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 72ff369b973b4c5981ea0810e37e8562 (table default.Table_4ed89f5fc452467d920d19caa6fb931a [id=8a0e4fe9e4544c539cb23b0279c1deaf]). Expected version 1 got 0
I20251025 08:02:27.546605 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 95c9778bd0d94542bec79e9d36c6ce46 (table default.Table_7387f487853a4b608f5e5237684550d8 [id=3e1281c3f28346a4a1dd2c4fcc990a2e]). Expected version 2 got 0
I20251025 08:02:27.546765 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 76a906654cc44bfb96d9e1a936040e57 (table default.Table_4598018e26254b78befa93852241f777 [id=78794c8ceec3479ca3ac3ef55594762f]). Expected version 2 got 0
I20251025 08:02:27.546882 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet f08d0c3446dd4a478f81688a3259bb91 (table default.Table_84b80cef0bc442cfb9f5301562ff1cce [id=ab926bc9b7424c45a5415c4763db2b4e]). Expected version 1 got 0
I20251025 08:02:27.546983 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 5d25a2805a264574bc20150762c48262 (table default.Table_4a9fc326b302473f86d8d3f7e7b8040f [id=15a38bbafe4045e9991cb846ec9e452c]) successfully deleted
I20251025 08:02:27.547042 16371 tablet_replica.cc:333] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:27.547170 16371 raft_consensus.cc:2243] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.547262 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 8737df10a3c8482c995ac6aadc240c42 (table default.Table_475579a80dad4c89bfd895cd2fdaafaf [id=c8b69f7419b842c18f324e0c08ba840a]). Expected version 1 got 0
I20251025 08:02:27.547314 16371 raft_consensus.cc:2272] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.549805 16372 ts_tablet_manager.cc:1916] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.555117 16371 ts_tablet_manager.cc:1916] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.556052 15026 heartbeater.cc:344] Connected to a master server at 127.14.70.62:39499
I20251025 08:02:27.557368 16371 ts_tablet_manager.cc:1929] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.557433 16371 log.cc:1199] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/a608dd2b2d1d42178bb00b3355bd6470
I20251025 08:02:27.557670 16371 ts_tablet_manager.cc:1950] T a608dd2b2d1d42178bb00b3355bd6470 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:27.558254 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet a608dd2b2d1d42178bb00b3355bd6470 (table default.Table_808c7980d96b48a181f79124ea5a0adb [id=e3c0ae796ee2421abe38408b729dd2a6]) successfully deleted
I20251025 08:02:27.560040 16287 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" instance_seqno: 1761379342300428) as {username='slave'} at 127.14.70.1:54701; Asking this server to re-register.
I20251025 08:02:27.560645 15026 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:27.561419 16372 ts_tablet_manager.cc:1929] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.561486 16372 log.cc:1199] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/eed2815efb7e46dd8b41f5ffe60daee8
I20251025 08:02:27.561887 16372 ts_tablet_manager.cc:1950] T eed2815efb7e46dd8b41f5ffe60daee8 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:27.562494 16372 tablet_replica.cc:333] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:27.562657 16372 raft_consensus.cc:2243] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.562659 16287 ts_manager.cc:194] Registered new tserver with Master: ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:27.562801 16372 raft_consensus.cc:2272] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.563360 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet eed2815efb7e46dd8b41f5ffe60daee8 (table default.Table_4a4b1eeaa5674710a1a13d7f0f395737 [id=f9c1f298fed0456eb9fd34fe9c124190]) successfully deleted
I20251025 08:02:27.563570 16372 ts_tablet_manager.cc:1916] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.565232 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 64ebf3a6aca8403fa811202af7e3fe01 (DEFAULT_TABLE table=default.Table_96eed584de4f4711b66e6f802a78ca6f [id=115470413d904ac0a4a3acecc6e6723e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.565397 16372 ts_tablet_manager.cc:1929] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.565443 16372 log.cc:1199] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/d2697ee09dc74d35abffc3158410aa5e
I20251025 08:02:27.565481 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ebf3a6aca8403fa811202af7e3fe01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.565604 16372 ts_tablet_manager.cc:1950] T d2697ee09dc74d35abffc3158410aa5e P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:27.565970 16372 tablet_replica.cc:333] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:27.566068 16372 raft_consensus.cc:2243] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.566128 16372 raft_consensus.cc:2272] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.566644 16372 ts_tablet_manager.cc:1916] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.567191 14953 tablet_service.cc:1505] Processing CreateTablet for tablet 64ebf3a6aca8403fa811202af7e3fe01 (DEFAULT_TABLE table=default.Table_96eed584de4f4711b66e6f802a78ca6f [id=115470413d904ac0a4a3acecc6e6723e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.567471 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ebf3a6aca8403fa811202af7e3fe01. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:27.569978 14712 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 1d7c262b73904f1f87188718617e38a8 (table default.Table_dab6241c02794509a694715ad8cfd171 [id=6739c1319b784c8eb66fc75125f83056], current schema version=4) failed: Not found: failed to reset TS proxy: No leader found: Tablet 1d7c262b73904f1f87188718617e38a8 consensus state has no leader
I20251025 08:02:27.570274 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet d2697ee09dc74d35abffc3158410aa5e (table default.Table_541e363972b34e9b9b64f21b771e7ce2 [id=bdcc7cd59c78409fad7b5f687ae81310]) successfully deleted
I20251025 08:02:27.570729 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 64ebf3a6aca8403fa811202af7e3fe01 (DEFAULT_TABLE table=default.Table_96eed584de4f4711b66e6f802a78ca6f [id=115470413d904ac0a4a3acecc6e6723e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.570978 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64ebf3a6aca8403fa811202af7e3fe01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.571317 16390 tablet_bootstrap.cc:492] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:27.572472 16390 tablet_bootstrap.cc:654] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.572762 14722 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet b3fdc5bd4c7f4506a150f31137e8b091 (table default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a]). Expected version 1 got 0
I20251025 08:02:27.572943 14722 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 4f3163f8a4ff49069d55b9acf8a4c19a (table default.Table_2631732663a24b55a695edc159006f87 [id=b9853b2d88cf4a96b9fc5e1099f87064]). Expected version 1 got 0
I20251025 08:02:27.573287 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 3faddc4af6ef4019be369ceb023cbc9d (DEFAULT_TABLE table=default.Table_035df9ac9f6541dd9b042857523d0659 [id=2c373de1732c4d18ad45968e90a65608]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.573493 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3faddc4af6ef4019be369ceb023cbc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.573521 16390 tablet_bootstrap.cc:492] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:27.573591 16390 ts_tablet_manager.cc:1403] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:27.574043 16390 raft_consensus.cc:359] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.574136 16390 raft_consensus.cc:385] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.574165 16390 raft_consensus.cc:740] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.574301 16390 consensus_queue.cc:260] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.574551 16390 ts_tablet_manager.cc:1434] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:27.574743 16385 catalog_manager.cc:1269] Loaded cluster ID: f2d8b893da824042af3b8623826039ce
I20251025 08:02:27.574782 16385 catalog_manager.cc:1562] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: loading cluster ID for follower catalog manager: success
I20251025 08:02:27.573050 14722 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 95c9778bd0d94542bec79e9d36c6ce46 (table default.Table_7387f487853a4b608f5e5237684550d8 [id=3e1281c3f28346a4a1dd2c4fcc990a2e]). Expected version 2 got 0
I20251025 08:02:27.575495 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 4c301e7a80c64d8e8751ecfa681ab202 (DEFAULT_TABLE table=default.Table_acf14806991f4da89dc9bb3361537133 [id=e63210d8c6d148e18496c0bc0d326ab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.575599 14722 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 43da3f4fc9604562a95dff59da3c574b (table default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031]). Expected version 2 got 0
I20251025 08:02:27.575711 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c301e7a80c64d8e8751ecfa681ab202. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.575839 14722 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet bcf414d04305456b80b2ec5dd8fb0ba7 (table default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24]). Expected version 1 got 0
I20251025 08:02:27.576032 14722 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 4d9cd745bd3e42e98b0ae1d145007bee (table default.Table_8540557c73a34cc2851ad08d71acac22 [id=abe30167767443d0b8e59f9418399d88]). Expected version 1 got 0
I20251025 08:02:27.576131 14722 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 346c0c8bf30b4dbaa92436b45e5fbf47 (table default.Table_4afe1c6e03a941df9d5f7df4a42cbc61 [id=ef3a1760f2c44935bbb79e518510905f]). Expected version 1 got 0
I20251025 08:02:27.576365 14722 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet ea0d438e99864c57999abf3467edc643 (table default.Table_3c48d3160e5d42509de4f0be1af855e2 [id=912da5ef8bbf4af29528c084ea7fa633]). Expected version 1 got 0
I20251025 08:02:27.576463 14722 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 72ff369b973b4c5981ea0810e37e8562 (table default.Table_4ed89f5fc452467d920d19caa6fb931a [id=8a0e4fe9e4544c539cb23b0279c1deaf]). Expected version 1 got 0
I20251025 08:02:27.576611 14722 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 76a906654cc44bfb96d9e1a936040e57 (table default.Table_4598018e26254b78befa93852241f777 [id=78794c8ceec3479ca3ac3ef55594762f]). Expected version 2 got 0
I20251025 08:02:27.576675 14722 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet f08d0c3446dd4a478f81688a3259bb91 (table default.Table_84b80cef0bc442cfb9f5301562ff1cce [id=ab926bc9b7424c45a5415c4763db2b4e]). Expected version 1 got 0
I20251025 08:02:27.578199 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 5a940a0698d64770bf5826d9290117b4 (DEFAULT_TABLE table=default.Table_782772638c3646fea7dfa5ecc8e01959 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.578416 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a940a0698d64770bf5826d9290117b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.579682 14721 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 0a187a088f5042c081aa87c79662c8cf
I20251025 08:02:27.579977 14954 tablet_service.cc:1505] Processing CreateTablet for tablet 5a940a0698d64770bf5826d9290117b4 (DEFAULT_TABLE table=default.Table_782772638c3646fea7dfa5ecc8e01959 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.580230 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a940a0698d64770bf5826d9290117b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.580683 15091 tablet_service.cc:1505] Processing CreateTablet for tablet e66c7b43490a4391a59e09f1832a53b3 (DEFAULT_TABLE table=default.Table_fa9d9b9a535648d89d19b74bb940ed9f [id=b3e6b8f18f2f40fc977b978d7d2c1b0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.580902 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66c7b43490a4391a59e09f1832a53b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.582222 14719 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet e0635cb57c4d4d51bed5897b28cc3dcd
I20251025 08:02:27.582548 16392 tablet_bootstrap.cc:492] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:27.582572 14726 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 3bf26408c98e49298ff9c738a1e26cf9
I20251025 08:02:27.583125 14952 tablet_service.cc:1505] Processing CreateTablet for tablet e66c7b43490a4391a59e09f1832a53b3 (DEFAULT_TABLE table=default.Table_fa9d9b9a535648d89d19b74bb940ed9f [id=b3e6b8f18f2f40fc977b978d7d2c1b0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.583328 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66c7b43490a4391a59e09f1832a53b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.583645 16392 tablet_bootstrap.cc:654] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.585393 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 93779f31ade9494f9056cc15665efb0d (DEFAULT_TABLE table=default.Table_0f884fc2a3c74502aa6bad6c3a9b49a8 [id=ae530558880e4fa4b18c3f87e21c0fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.585585 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93779f31ade9494f9056cc15665efb0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.585999 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet e0635cb57c4d4d51bed5897b28cc3dcd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.586138 15087 tablet_service.cc:1552] Processing DeleteTablet for tablet e0635cb57c4d4d51bed5897b28cc3dcd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.587455 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 0a187a088f5042c081aa87c79662c8cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.589231 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 0078dd6fb0e34d01a54889326dd6dfd7 (DEFAULT_TABLE table=default.Table_2f4e7934dc164dcdadd6467e1afc563a [id=4f1a1f84f436411db166b8c28873a27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.589362 14949 tablet_service.cc:1505] Processing CreateTablet for tablet e4f92b0605754327883b144fb6c96aea (DEFAULT_TABLE table=default.Table_eaf82018b440497e86dbf2cfdd3785e5 [id=2ef2d72066f446619f9045da34df7814]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.589442 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0078dd6fb0e34d01a54889326dd6dfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.589545 14949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f92b0605754327883b144fb6c96aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.589744 14950 tablet_service.cc:1505] Processing CreateTablet for tablet 7711a974f4a84d639f1c3077da9d855f (DEFAULT_TABLE table=default.Table_4a4b1eeaa5674710a1a13d7f0f395737 [id=f9c1f298fed0456eb9fd34fe9c124190]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.589959 14950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7711a974f4a84d639f1c3077da9d855f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.589231 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 1bd788e8b38b401a89cbc250b3695088 (DEFAULT_TABLE table=default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.590420 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd788e8b38b401a89cbc250b3695088. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.591935 14951 tablet_service.cc:1505] Processing CreateTablet for tablet 1d7c262b73904f1f87188718617e38a8 (DEFAULT_TABLE table=default.Table_dab6241c02794509a694715ad8cfd171 [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.592252 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d7c262b73904f1f87188718617e38a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.592212 14948 tablet_service.cc:1505] Processing CreateTablet for tablet 049cc6add40d44fc9d67c89eca89ce59 (DEFAULT_TABLE table=default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.592401 14948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049cc6add40d44fc9d67c89eca89ce59. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.593513 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 5a940a0698d64770bf5826d9290117b4 (DEFAULT_TABLE table=default.Table_782772638c3646fea7dfa5ecc8e01959 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.593729 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a940a0698d64770bf5826d9290117b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.593808 15219 tablet_service.cc:1505] Processing CreateTablet for tablet 4c301e7a80c64d8e8751ecfa681ab202 (DEFAULT_TABLE table=default.Table_acf14806991f4da89dc9bb3361537133 [id=e63210d8c6d148e18496c0bc0d326ab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.594035 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c301e7a80c64d8e8751ecfa681ab202. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.594367 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 7711a974f4a84d639f1c3077da9d855f (DEFAULT_TABLE table=default.Table_4a4b1eeaa5674710a1a13d7f0f395737 [id=f9c1f298fed0456eb9fd34fe9c124190]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.594585 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7711a974f4a84d639f1c3077da9d855f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.594875 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 3faddc4af6ef4019be369ceb023cbc9d (DEFAULT_TABLE table=default.Table_035df9ac9f6541dd9b042857523d0659 [id=2c373de1732c4d18ad45968e90a65608]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.595093 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3faddc4af6ef4019be369ceb023cbc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.595706 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 53f89ab2ef9b4136812cb4a320a645a6 (DEFAULT_TABLE table=default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.595906 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f89ab2ef9b4136812cb4a320a645a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.595968 15227 tablet_service.cc:1505] Processing CreateTablet for tablet e66c7b43490a4391a59e09f1832a53b3 (DEFAULT_TABLE table=default.Table_fa9d9b9a535648d89d19b74bb940ed9f [id=b3e6b8f18f2f40fc977b978d7d2c1b0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.596177 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66c7b43490a4391a59e09f1832a53b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.596405 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 049cc6add40d44fc9d67c89eca89ce59 (DEFAULT_TABLE table=default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.596593 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049cc6add40d44fc9d67c89eca89ce59. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.596787 15220 tablet_service.cc:1552] Processing DeleteTablet for tablet 3bf26408c98e49298ff9c738a1e26cf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.597234 15222 tablet_service.cc:1505] Processing CreateTablet for tablet a25116c3ecda411bb480cc47a3ca6bf5 (DEFAULT_TABLE table=default.Table_51c8e80718644971942377f115aee6ea [id=74592e2000d243869f94a1c513fc04e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.597440 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25116c3ecda411bb480cc47a3ca6bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.597673 15226 tablet_service.cc:1552] Processing DeleteTablet for tablet 0a187a088f5042c081aa87c79662c8cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.597872 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 1bd788e8b38b401a89cbc250b3695088 (DEFAULT_TABLE table=default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.598058 15221 tablet_service.cc:1552] Processing DeleteTablet for tablet e0635cb57c4d4d51bed5897b28cc3dcd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.598327 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 0078dd6fb0e34d01a54889326dd6dfd7 (DEFAULT_TABLE table=default.Table_2f4e7934dc164dcdadd6467e1afc563a [id=4f1a1f84f436411db166b8c28873a27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.598445 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 93779f31ade9494f9056cc15665efb0d (DEFAULT_TABLE table=default.Table_0f884fc2a3c74502aa6bad6c3a9b49a8 [id=ae530558880e4fa4b18c3f87e21c0fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.598747 15216 tablet_service.cc:1505] Processing CreateTablet for tablet e4f92b0605754327883b144fb6c96aea (DEFAULT_TABLE table=default.Table_eaf82018b440497e86dbf2cfdd3785e5 [id=2ef2d72066f446619f9045da34df7814]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.598773 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 3bf26408c98e49298ff9c738a1e26cf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.598083 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd788e8b38b401a89cbc250b3695088. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.599747 15214 tablet_service.cc:1505] Processing CreateTablet for tablet 1d7c262b73904f1f87188718617e38a8 (DEFAULT_TABLE table=default.Table_dab6241c02794509a694715ad8cfd171 [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.599973 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d7c262b73904f1f87188718617e38a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.600836 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f92b0605754327883b144fb6c96aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.602795 16199 raft_consensus.cc:493] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:27.602871 16199 raft_consensus.cc:515] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.603228 16199 leader_election.cc:290] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:27.603468 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0078dd6fb0e34d01a54889326dd6dfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.603793 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93779f31ade9494f9056cc15665efb0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.606794 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ebf3a6aca8403fa811202af7e3fe01" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:27.598328 16390 tablet_bootstrap.cc:492] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:27.607821 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ebf3a6aca8403fa811202af7e3fe01" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:27.608031 16390 tablet_bootstrap.cc:654] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:27.608187 15183 leader_election.cc:343] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:27.608767 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 53f89ab2ef9b4136812cb4a320a645a6 (DEFAULT_TABLE table=default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.608994 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f89ab2ef9b4136812cb4a320a645a6. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:27.610584 15185 leader_election.cc:343] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:27.610653 15185 leader_election.cc:304] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:27.610879 15409 raft_consensus.cc:2749] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:27.611033 16365 tablet.cc:1722] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.612480 14952 tablet_service.cc:1505] Processing CreateTablet for tablet a25116c3ecda411bb480cc47a3ca6bf5 (DEFAULT_TABLE table=default.Table_51c8e80718644971942377f115aee6ea [id=74592e2000d243869f94a1c513fc04e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.612550 16391 tablet_bootstrap.cc:492] T 64ebf3a6aca8403fa811202af7e3fe01 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:27.612675 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25116c3ecda411bb480cc47a3ca6bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.613418 16391 tablet_bootstrap.cc:654] T 64ebf3a6aca8403fa811202af7e3fe01 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.614681 16366 tablet.cc:1722] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.615356 16288 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e51a2be794f04642b89386067ecbc77e" instance_seqno: 1761379342456414) as {username='slave'} at 127.14.70.2:47395; Asking this server to re-register.
W20251025 08:02:27.616240 15048 consensus_peers.cc:597] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d25a2805a264574bc20150762c48262. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:27.616410 15161 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:27.616436 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 0a187a088f5042c081aa87c79662c8cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.616457 16385 catalog_manager.cc:1584] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: acquiring CA information for follower catalog manager: success
I20251025 08:02:27.616739 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 4c301e7a80c64d8e8751ecfa681ab202 (DEFAULT_TABLE table=default.Table_acf14806991f4da89dc9bb3361537133 [id=e63210d8c6d148e18496c0bc0d326ab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.617386 16370 tablet.cc:1722] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.617657 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c301e7a80c64d8e8751ecfa681ab202. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.617866 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 53f89ab2ef9b4136812cb4a320a645a6 (DEFAULT_TABLE table=default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.618060 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53f89ab2ef9b4136812cb4a320a645a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.619403 14953 tablet_service.cc:1505] Processing CreateTablet for tablet 3faddc4af6ef4019be369ceb023cbc9d (DEFAULT_TABLE table=default.Table_035df9ac9f6541dd9b042857523d0659 [id=2c373de1732c4d18ad45968e90a65608]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.619593 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3faddc4af6ef4019be369ceb023cbc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.621728 16385 catalog_manager.cc:1612] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20251025 08:02:27.621762 14954 tablet_service.cc:1505] Processing CreateTablet for tablet 93779f31ade9494f9056cc15665efb0d (DEFAULT_TABLE table=default.Table_0f884fc2a3c74502aa6bad6c3a9b49a8 [id=ae530558880e4fa4b18c3f87e21c0fd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.621963 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93779f31ade9494f9056cc15665efb0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.622716 16392 tablet_bootstrap.cc:492] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:27.622838 16392 ts_tablet_manager.cc:1403] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20251025 08:02:27.624269 16390 tablet_bootstrap.cc:492] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:27.624346 16390 ts_tablet_manager.cc:1403] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.002s
I20251025 08:02:27.623306 16392 raft_consensus.cc:359] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.624751 16392 raft_consensus.cc:385] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.624735 16390 raft_consensus.cc:359] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.624833 16390 raft_consensus.cc:385] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.624884 16390 raft_consensus.cc:740] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.624862 16392 raft_consensus.cc:740] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.625013 16390 consensus_queue.cc:260] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.625152 16392 consensus_queue.cc:260] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.625317 16390 ts_tablet_manager.cc:1434] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:27.625502 16390 tablet_bootstrap.cc:492] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:27.625633 16392 ts_tablet_manager.cc:1434] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:27.625861 16392 tablet_bootstrap.cc:492] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:27.627477 16287 ts_manager.cc:194] Registered new tserver with Master: e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:27.627470 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 7711a974f4a84d639f1c3077da9d855f (DEFAULT_TABLE table=default.Table_4a4b1eeaa5674710a1a13d7f0f395737 [id=f9c1f298fed0456eb9fd34fe9c124190]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.627660 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7711a974f4a84d639f1c3077da9d855f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.627923 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 0078dd6fb0e34d01a54889326dd6dfd7 (DEFAULT_TABLE table=default.Table_2f4e7934dc164dcdadd6467e1afc563a [id=4f1a1f84f436411db166b8c28873a27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.628119 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0078dd6fb0e34d01a54889326dd6dfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.628194 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 1d7c262b73904f1f87188718617e38a8 (DEFAULT_TABLE table=default.Table_dab6241c02794509a694715ad8cfd171 [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.628382 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d7c262b73904f1f87188718617e38a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.629504 15086 tablet_service.cc:1505] Processing CreateTablet for tablet 049cc6add40d44fc9d67c89eca89ce59 (DEFAULT_TABLE table=default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.629678 15086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 049cc6add40d44fc9d67c89eca89ce59. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.630098 15088 tablet_service.cc:1505] Processing CreateTablet for tablet a25116c3ecda411bb480cc47a3ca6bf5 (DEFAULT_TABLE table=default.Table_51c8e80718644971942377f115aee6ea [id=74592e2000d243869f94a1c513fc04e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.630417 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a25116c3ecda411bb480cc47a3ca6bf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.630386 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 1bd788e8b38b401a89cbc250b3695088 (DEFAULT_TABLE table=default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.630561 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bd788e8b38b401a89cbc250b3695088. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.631280 16288 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" instance_seqno: 1761379342623763) as {username='slave'} at 127.14.70.3:37907; Asking this server to re-register.
I20251025 08:02:27.632901 15091 tablet_service.cc:1505] Processing CreateTablet for tablet e4f92b0605754327883b144fb6c96aea (DEFAULT_TABLE table=default.Table_eaf82018b440497e86dbf2cfdd3785e5 [id=2ef2d72066f446619f9045da34df7814]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.634567 16390 tablet_bootstrap.cc:654] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.635718 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f92b0605754327883b144fb6c96aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.636344 15296 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:27.638780 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 3bf26408c98e49298ff9c738a1e26cf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.638998 16370 tablet.cc:1722] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.639263 16364 tablet_replica.cc:333] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.639396 16364 raft_consensus.cc:2243] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.639487 16364 raft_consensus.cc:2272] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.639923 16364 ts_tablet_manager.cc:1916] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.640029 16366 tablet.cc:1722] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.643819 14724 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_49352274aacf479292f43c128367eeb0" } new_table_name: "default.Table_fb3af07031d2433fa1949ff417c1e03f" modify_external_catalogs: true
I20251025 08:02:27.643967 14726 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_84b80cef0bc442cfb9f5301562ff1cce" } modify_external_catalogs: true
I20251025 08:02:27.644116 16364 ts_tablet_manager.cc:1929] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.644114 14726 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_84b80cef0bc442cfb9f5301562ff1cce" } modify_external_catalogs: true
I20251025 08:02:27.644170 16364 log.cc:1199] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/3bf26408c98e49298ff9c738a1e26cf9
I20251025 08:02:27.644656 14720 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_49bbc2328aab41cda10e05a7fb925cd9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.644959 14720 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49bbc2328aab41cda10e05a7fb925cd9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.644454 16364 ts_tablet_manager.cc:1950] T 3bf26408c98e49298ff9c738a1e26cf9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:27.645665 14723 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_9ab03dea59b04746968d5f6753b931d6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.645937 14723 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ab03dea59b04746968d5f6753b931d6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.647681 16364 tablet_replica.cc:333] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.647799 16364 raft_consensus.cc:2243] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.647887 16364 raft_consensus.cc:2272] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.647987 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 3bf26408c98e49298ff9c738a1e26cf9 (table default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]) successfully deleted
I20251025 08:02:27.648401 16372 ts_tablet_manager.cc:1929] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.648469 16372 log.cc:1199] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/7ae3f4cdb1b14d1abe884c4a0628a6ec
I20251025 08:02:27.648576 16391 tablet_bootstrap.cc:492] T 64ebf3a6aca8403fa811202af7e3fe01 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:27.648679 16391 ts_tablet_manager.cc:1403] T 64ebf3a6aca8403fa811202af7e3fe01 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.000s
I20251025 08:02:27.648942 16365 tablet.cc:1722] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.649042 16364 ts_tablet_manager.cc:1916] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.649165 16391 raft_consensus.cc:359] T 64ebf3a6aca8403fa811202af7e3fe01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.649284 16391 raft_consensus.cc:385] T 64ebf3a6aca8403fa811202af7e3fe01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.649315 16372 ts_tablet_manager.cc:1950] T 7ae3f4cdb1b14d1abe884c4a0628a6ec P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:27.649323 16391 raft_consensus.cc:740] T 64ebf3a6aca8403fa811202af7e3fe01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.649425 16391 consensus_queue.cc:260] T 64ebf3a6aca8403fa811202af7e3fe01 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.649605 16372 tablet_replica.cc:333] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:27.649685 16391 ts_tablet_manager.cc:1434] T 64ebf3a6aca8403fa811202af7e3fe01 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:27.649713 16372 raft_consensus.cc:2243] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:27.649852 16391 tablet_bootstrap.cc:492] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:27.649873 16372 raft_consensus.cc:2272] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.650837 16391 tablet_bootstrap.cc:654] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.651726 16364 ts_tablet_manager.cc:1929] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.651786 16364 log.cc:1199] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/0a187a088f5042c081aa87c79662c8cf
I20251025 08:02:27.652012 16364 ts_tablet_manager.cc:1950] T 0a187a088f5042c081aa87c79662c8cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:27.654449 16371 tablet_replica.cc:333] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:27.654578 16371 raft_consensus.cc:2243] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:27.654729 16371 raft_consensus.cc:2272] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.655093 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 0a187a088f5042c081aa87c79662c8cf (table default.Table_b42eeab602164c40a7721a43fb071328 [id=4b8789f2c2234483aa891cad1334c474]) successfully deleted
I20251025 08:02:27.655210 16371 ts_tablet_manager.cc:1916] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.655305 16364 tablet_replica.cc:333] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.655419 16364 raft_consensus.cc:2243] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.655599 16364 raft_consensus.cc:2272] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.655967 16364 ts_tablet_manager.cc:1916] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.656920 14719 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_df3848a55c7646b1bd519eb12aa88aa1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:27.656944 14721 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_b074f35366374acd92bf7528094773a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.657238 14719 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_df3848a55c7646b1bd519eb12aa88aa1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:27.657281 14721 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b074f35366374acd92bf7528094773a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.658725 14727 master_service.cc:954] ReplaceTablet: received request to replace tablet b7e8a698e8ba408a833bbc3905b2ad04 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:27.659257 16298 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 2 FOLLOWER]: Advancing to term 3
I20251025 08:02:27.659577 16371 ts_tablet_manager.cc:1929] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.659638 16371 log.cc:1199] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/e0635cb57c4d4d51bed5897b28cc3dcd
I20251025 08:02:27.659917 16371 ts_tablet_manager.cc:1950] T e0635cb57c4d4d51bed5897b28cc3dcd P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:27.660454 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet e0635cb57c4d4d51bed5897b28cc3dcd (table default.Table_bb2712f0481c486fa9db6d0113289be2 [id=198c7d73328440ac8c6eef2c24c5e0ad]) successfully deleted
I20251025 08:02:27.660604 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec (table default.Table_28db4c3dec79421c9ad752690a383ea4 [id=593c3f07bdaa45d49e1c8cf97cf0c2c7]) successfully deleted
I20251025 08:02:27.661166 16364 ts_tablet_manager.cc:1929] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.661273 16364 log.cc:1199] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/e0635cb57c4d4d51bed5897b28cc3dcd
I20251025 08:02:27.661294 16370 tablet.cc:1722] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.661528 16364 ts_tablet_manager.cc:1950] T e0635cb57c4d4d51bed5897b28cc3dcd P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:27.662262 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet e0635cb57c4d4d51bed5897b28cc3dcd (table default.Table_bb2712f0481c486fa9db6d0113289be2 [id=198c7d73328440ac8c6eef2c24c5e0ad]) successfully deleted
I20251025 08:02:27.663699 16366 tablet.cc:1722] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.665174 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 40f70d2139534907ab929dae893c740d (DEFAULT_TABLE table=default.Table_6a66d07dc986487694277236df040244 [id=d720a49cc25f487fbfecb3771c5e5f73]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.665236 15225 tablet_service.cc:1505] Processing CreateTablet for tablet ff20cd7d33a440bab24bd4a61fff1f30 (DEFAULT_TABLE table=default.Table_5409b3ddf1af4457a122ed2c85fa24f0 [id=40bbd91ee80d45cebf7aa038f726f799]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.665402 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f70d2139534907ab929dae893c740d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.665452 15212 tablet_service.cc:1505] Processing CreateTablet for tablet fcc08d74df2d46c58ca27f5d467e060f (DEFAULT_TABLE table=default.Table_eb227195b7e4404bb817d7d5e6a87e14 [id=8b67aaea93414dcb9b66d5124952bcee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.665555 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 0f55c551037a4619808e18e461940d6d (DEFAULT_TABLE table=default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.665638 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc08d74df2d46c58ca27f5d467e060f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.665776 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f55c551037a4619808e18e461940d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.666451 15214 tablet_service.cc:1505] Processing CreateTablet for tablet 6e0ce41dddc54e8d90a7f84d924d200b (DEFAULT_TABLE table=default.Table_e19c72b5fee34ad6803d4f2eb019c071 [id=ebfa83131bd946d0897b32ef3c188c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.666666 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e0ce41dddc54e8d90a7f84d924d200b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.668085 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff20cd7d33a440bab24bd4a61fff1f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.670552 15218 tablet_service.cc:1505] Processing CreateTablet for tablet f9a7f96be1e2427bb0c4e109c6bac400 (DEFAULT_TABLE table=default.Table_d4e0362387994cd8a9584073e55c7b32 [id=03f81977ce8b4edbaf54dceff38426af]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.670675 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 221f4c5432bc45e18728f5ed1453ad0f (DEFAULT_TABLE table=default.Table_4a9fc326b302473f86d8d3f7e7b8040f [id=15a38bbafe4045e9991cb846ec9e452c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.670758 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a7f96be1e2427bb0c4e109c6bac400. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.670866 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 221f4c5432bc45e18728f5ed1453ad0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.671391 15225 tablet_service.cc:1505] Processing CreateTablet for tablet c59083b54df24c21a3114c34a73dd638 (DEFAULT_TABLE table=default.Table_808c7980d96b48a181f79124ea5a0adb [id=e3c0ae796ee2421abe38408b729dd2a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.671587 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c59083b54df24c21a3114c34a73dd638. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.673420 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 4d84ee63450243f8910ad4bd1ec6459e (DEFAULT_TABLE table=default.Table_67238f79fb2446bd9c19c32182814dd0 [id=3c97ef2101a945cd900b30a00a1c8459]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.673619 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d84ee63450243f8910ad4bd1ec6459e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.673579 14721 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_35b83947962a41b7be7d363c364404d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.673871 14721 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_35b83947962a41b7be7d363c364404d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.675498 15094 tablet_service.cc:1505] Processing CreateTablet for tablet fcc08d74df2d46c58ca27f5d467e060f (DEFAULT_TABLE table=default.Table_eb227195b7e4404bb817d7d5e6a87e14 [id=8b67aaea93414dcb9b66d5124952bcee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.675755 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc08d74df2d46c58ca27f5d467e060f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.675717 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 6e0ce41dddc54e8d90a7f84d924d200b (DEFAULT_TABLE table=default.Table_e19c72b5fee34ad6803d4f2eb019c071 [id=ebfa83131bd946d0897b32ef3c188c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.676076 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 221f4c5432bc45e18728f5ed1453ad0f (DEFAULT_TABLE table=default.Table_4a9fc326b302473f86d8d3f7e7b8040f [id=15a38bbafe4045e9991cb846ec9e452c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.676225 15085 tablet_service.cc:1505] Processing CreateTablet for tablet f9a7f96be1e2427bb0c4e109c6bac400 (DEFAULT_TABLE table=default.Table_d4e0362387994cd8a9584073e55c7b32 [id=03f81977ce8b4edbaf54dceff38426af]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.676642 15086 tablet_service.cc:1505] Processing CreateTablet for tablet 04d3488a6b814223b742f0d5c946362f (DEFAULT_TABLE table=default.Table_541e363972b34e9b9b64f21b771e7ce2 [id=bdcc7cd59c78409fad7b5f687ae81310]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.677026 14719 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_6a66d07dc986487694277236df040244" } modify_external_catalogs: true
I20251025 08:02:27.677119 14719 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_6a66d07dc986487694277236df040244" } modify_external_catalogs: true
I20251025 08:02:27.677524 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 40f70d2139534907ab929dae893c740d (DEFAULT_TABLE table=default.Table_6a66d07dc986487694277236df040244 [id=d720a49cc25f487fbfecb3771c5e5f73]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.677744 15089 tablet_service.cc:1505] Processing CreateTablet for tablet c59083b54df24c21a3114c34a73dd638 (DEFAULT_TABLE table=default.Table_808c7980d96b48a181f79124ea5a0adb [id=e3c0ae796ee2421abe38408b729dd2a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.677825 15214 tablet_service.cc:1505] Processing CreateTablet for tablet 04d3488a6b814223b742f0d5c946362f (DEFAULT_TABLE table=default.Table_541e363972b34e9b9b64f21b771e7ce2 [id=bdcc7cd59c78409fad7b5f687ae81310]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.678046 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d3488a6b814223b742f0d5c946362f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.679407 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e0ce41dddc54e8d90a7f84d924d200b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.680167 14723 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_9f2128ef54374befaec2adc1a1295f27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.680424 14723 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f2128ef54374befaec2adc1a1295f27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.681694 14720 master_service.cc:954] ReplaceTablet: received request to replace tablet 76a906654cc44bfb96d9e1a936040e57 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:27.681963 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 221f4c5432bc45e18728f5ed1453ad0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.682574 14726 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet f08d0c3446dd4a478f81688a3259bb91
I20251025 08:02:27.683248 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a7f96be1e2427bb0c4e109c6bac400. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.683951 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 4d84ee63450243f8910ad4bd1ec6459e (DEFAULT_TABLE table=default.Table_67238f79fb2446bd9c19c32182814dd0 [id=3c97ef2101a945cd900b30a00a1c8459]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.684142 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d84ee63450243f8910ad4bd1ec6459e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.685544 14727 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet b7e8a698e8ba408a833bbc3905b2ad04
I20251025 08:02:27.686875 15086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d3488a6b814223b742f0d5c946362f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.689077 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f70d2139534907ab929dae893c740d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.690418 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c59083b54df24c21a3114c34a73dd638. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.690623 14719 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 40f70d2139534907ab929dae893c740d
I20251025 08:02:27.692696 16391 tablet_bootstrap.cc:492] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:27.692775 16391 ts_tablet_manager.cc:1403] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.000s
I20251025 08:02:27.693312 16391 raft_consensus.cc:359] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.693459 16391 raft_consensus.cc:385] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.693537 16391 raft_consensus.cc:740] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.693719 16391 consensus_queue.cc:260] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.694039 16391 ts_tablet_manager.cc:1434] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:27.694283 16391 tablet_bootstrap.cc:492] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:27.695143 16391 tablet_bootstrap.cc:654] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.699491 14951 tablet_service.cc:1505] Processing CreateTablet for tablet 04d3488a6b814223b742f0d5c946362f (DEFAULT_TABLE table=default.Table_541e363972b34e9b9b64f21b771e7ce2 [id=bdcc7cd59c78409fad7b5f687ae81310]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.699630 14957 tablet_service.cc:1505] Processing CreateTablet for tablet f9a7f96be1e2427bb0c4e109c6bac400 (DEFAULT_TABLE table=default.Table_d4e0362387994cd8a9584073e55c7b32 [id=03f81977ce8b4edbaf54dceff38426af]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.699703 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d3488a6b814223b742f0d5c946362f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.699832 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a7f96be1e2427bb0c4e109c6bac400. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.699815 14948 tablet_service.cc:1505] Processing CreateTablet for tablet c59083b54df24c21a3114c34a73dd638 (DEFAULT_TABLE table=default.Table_808c7980d96b48a181f79124ea5a0adb [id=e3c0ae796ee2421abe38408b729dd2a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.699857 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 40f70d2139534907ab929dae893c740d (DEFAULT_TABLE table=default.Table_6a66d07dc986487694277236df040244 [id=d720a49cc25f487fbfecb3771c5e5f73]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.700007 14948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c59083b54df24c21a3114c34a73dd638. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.700134 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 0f55c551037a4619808e18e461940d6d (DEFAULT_TABLE table=default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.700156 14949 tablet_service.cc:1505] Processing CreateTablet for tablet 221f4c5432bc45e18728f5ed1453ad0f (DEFAULT_TABLE table=default.Table_4a9fc326b302473f86d8d3f7e7b8040f [id=15a38bbafe4045e9991cb846ec9e452c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.700323 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f55c551037a4619808e18e461940d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.700376 14956 tablet_service.cc:1552] Processing DeleteTablet for tablet f08d0c3446dd4a478f81688a3259bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.699682 14953 tablet_service.cc:1505] Processing CreateTablet for tablet fcc08d74df2d46c58ca27f5d467e060f (DEFAULT_TABLE table=default.Table_eb227195b7e4404bb817d7d5e6a87e14 [id=8b67aaea93414dcb9b66d5124952bcee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.700608 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc08d74df2d46c58ca27f5d467e060f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.699504 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 4d84ee63450243f8910ad4bd1ec6459e (DEFAULT_TABLE table=default.Table_67238f79fb2446bd9c19c32182814dd0 [id=3c97ef2101a945cd900b30a00a1c8459]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.702284 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f70d2139534907ab929dae893c740d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.702610 14950 tablet_service.cc:1552] Processing DeleteTablet for tablet b7e8a698e8ba408a833bbc3905b2ad04 with delete_type TABLET_DATA_DELETED (replaced by tablet b04e5c106dd7400aa039dbf6666ad3aa) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.702802 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 6e0ce41dddc54e8d90a7f84d924d200b (DEFAULT_TABLE table=default.Table_e19c72b5fee34ad6803d4f2eb019c071 [id=ebfa83131bd946d0897b32ef3c188c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.702978 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e0ce41dddc54e8d90a7f84d924d200b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.704746 14949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 221f4c5432bc45e18728f5ed1453ad0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.706017 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 0f55c551037a4619808e18e461940d6d (DEFAULT_TABLE table=default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.706252 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f55c551037a4619808e18e461940d6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.706339 16403 tablet.cc:1722] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.706809 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d84ee63450243f8910ad4bd1ec6459e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.708822 16374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 33b7e3c702ec44079d8b76a0ce6bae97. Latest consensus state: current_term: 3 leader_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:27.708920 16374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:27.708986 16374 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:27.709031 16374 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:27.710983 15091 tablet_service.cc:1505] Processing CreateTablet for tablet ff20cd7d33a440bab24bd4a61fff1f30 (DEFAULT_TABLE table=default.Table_5409b3ddf1af4457a122ed2c85fa24f0 [id=40bbd91ee80d45cebf7aa038f726f799]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.711236 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff20cd7d33a440bab24bd4a61fff1f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.713590 14954 tablet_service.cc:1505] Processing CreateTablet for tablet ff20cd7d33a440bab24bd4a61fff1f30 (DEFAULT_TABLE table=default.Table_5409b3ddf1af4457a122ed2c85fa24f0 [id=40bbd91ee80d45cebf7aa038f726f799]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.713687 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet b7e8a698e8ba408a833bbc3905b2ad04 with delete_type TABLET_DATA_DELETED (replaced by tablet b04e5c106dd7400aa039dbf6666ad3aa) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.713871 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff20cd7d33a440bab24bd4a61fff1f30. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.714519 14721 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_5409b3ddf1af4457a122ed2c85fa24f0" } new_table_name: "default.Table_b1e1deafd90b45ec8e77ad538bb9b20b" modify_external_catalogs: true
I20251025 08:02:27.715646 16364 tablet_replica.cc:333] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.715842 16364 raft_consensus.cc:2243] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:27.716055 16364 raft_consensus.cc:2272] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.716672 14723 master_service.cc:954] ReplaceTablet: received request to replace tablet 4f3163f8a4ff49069d55b9acf8a4c19a from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:27.716857 16364 ts_tablet_manager.cc:1916] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.715121 16288 ts_manager.cc:194] Registered new tserver with Master: f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:27.719028 16364 ts_tablet_manager.cc:1929] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.719080 16364 log.cc:1199] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/b7e8a698e8ba408a833bbc3905b2ad04
I20251025 08:02:27.719318 16364 ts_tablet_manager.cc:1950] T b7e8a698e8ba408a833bbc3905b2ad04 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:27.722347 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet f08d0c3446dd4a478f81688a3259bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.723461 14722 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_475579a80dad4c89bfd895cd2fdaafaf [id=c8b69f7419b842c18f324e0c08ba840a] alter complete (version 1)
I20251025 08:02:27.726158 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet 0a187a088f5042c081aa87c79662c8cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.726315 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 3bf26408c98e49298ff9c738a1e26cf9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.726423 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet a608dd2b2d1d42178bb00b3355bd6470 with delete_type TABLET_DATA_DELETED (replaced by tablet c59083b54df24c21a3114c34a73dd638) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.726326 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet e54e57e850564e079db3dd383347ed30 with delete_type TABLET_DATA_DELETED (replaced by tablet 95c9778bd0d94542bec79e9d36c6ce46) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.727936 14720 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 76a906654cc44bfb96d9e1a936040e57
I20251025 08:02:27.728504 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 5e605f701a474fff80688533f3a398e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:42694
W20251025 08:02:27.729830 14721 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ff20cd7d33a440bab24bd4a61fff1f30 consensus state has no leader
I20251025 08:02:27.730057 14721 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_bf30187847774d5891dcdc95939db83b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.730592 14721 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf30187847774d5891dcdc95939db83b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.731439 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 51fca67cb1b84e44a491b6a788c01062 (DEFAULT_TABLE table=default.Table_28db4c3dec79421c9ad752690a383ea4 [id=593c3f07bdaa45d49e1c8cf97cf0c2c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.731657 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51fca67cb1b84e44a491b6a788c01062. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.732129 14951 tablet_service.cc:1505] Processing CreateTablet for tablet 51fca67cb1b84e44a491b6a788c01062 (DEFAULT_TABLE table=default.Table_28db4c3dec79421c9ad752690a383ea4 [id=593c3f07bdaa45d49e1c8cf97cf0c2c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.732177 15090 tablet_service.cc:1505] Processing CreateTablet for tablet e87bae31e5e642a5a34a8c170c62fdca (DEFAULT_TABLE table=default.Table_027f43c7a0d34932a84b5f0922e7da40 [id=edf9af4acd364a30814a645d32d35224]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.732336 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51fca67cb1b84e44a491b6a788c01062. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.732414 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87bae31e5e642a5a34a8c170c62fdca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.732542 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 51fca67cb1b84e44a491b6a788c01062 (DEFAULT_TABLE table=default.Table_28db4c3dec79421c9ad752690a383ea4 [id=593c3f07bdaa45d49e1c8cf97cf0c2c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.732733 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51fca67cb1b84e44a491b6a788c01062. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.733592 14723 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 4f3163f8a4ff49069d55b9acf8a4c19a
I20251025 08:02:27.733834 14723 catalog_manager.cc:6719] ReplaceTablet: tablet 4f3163f8a4ff49069d55b9acf8a4c19a deleted and replaced by tablet 27d1e084fbdf43e2a1cc60fb6dfd194b
I20251025 08:02:27.734019 14723 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_075d43596a3d4f1e889c2cd50b615157"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:27.734139 15212 tablet_service.cc:1505] Processing CreateTablet for tablet e87bae31e5e642a5a34a8c170c62fdca (DEFAULT_TABLE table=default.Table_027f43c7a0d34932a84b5f0922e7da40 [id=edf9af4acd364a30814a645d32d35224]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.734362 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87bae31e5e642a5a34a8c170c62fdca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.734382 16199 raft_consensus.cc:493] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:27.734436 16199 raft_consensus.cc:515] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.734769 16199 leader_election.cc:290] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:27.735174 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a940a0698d64770bf5826d9290117b4" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:27.736300 16392 tablet_bootstrap.cc:654] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.736447 14720 catalog_manager.cc:6719] ReplaceTablet: tablet 76a906654cc44bfb96d9e1a936040e57 deleted and replaced by tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4
I20251025 08:02:27.736464 14955 tablet_service.cc:1505] Processing CreateTablet for tablet e87bae31e5e642a5a34a8c170c62fdca (DEFAULT_TABLE table=default.Table_027f43c7a0d34932a84b5f0922e7da40 [id=edf9af4acd364a30814a645d32d35224]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:27.736107 15183 leader_election.cc:343] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:27.736661 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e87bae31e5e642a5a34a8c170c62fdca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.736637 14720 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_2ddd7375c83b44f2817d62efca908cd1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.736908 14720 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2ddd7375c83b44f2817d62efca908cd1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.736917 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 4f3163f8a4ff49069d55b9acf8a4c19a with delete_type TABLET_DATA_DELETED (replaced by tablet 27d1e084fbdf43e2a1cc60fb6dfd194b) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.737385 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 76a906654cc44bfb96d9e1a936040e57 with delete_type TABLET_DATA_DELETED (replaced by tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.737694 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 4f3163f8a4ff49069d55b9acf8a4c19a with delete_type TABLET_DATA_DELETED (replaced by tablet 27d1e084fbdf43e2a1cc60fb6dfd194b) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.738046 14719 master_service.cc:954] ReplaceTablet: received request to replace tablet 071220f7bd334f5aad733209193244d4 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:27.738158 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet 4f3163f8a4ff49069d55b9acf8a4c19a with delete_type TABLET_DATA_DELETED (replaced by tablet 27d1e084fbdf43e2a1cc60fb6dfd194b) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.738453 14726 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_e9a56ee98afd4b14bb77f82f256e8379"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.738765 14726 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9a56ee98afd4b14bb77f82f256e8379 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:27.739670 14723 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_075d43596a3d4f1e889c2cd50b615157 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.740180 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a940a0698d64770bf5826d9290117b4" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:27.740271 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 40f70d2139534907ab929dae893c740d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.740326 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 40f70d2139534907ab929dae893c740d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.740540 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet b7e8a698e8ba408a833bbc3905b2ad04 (table default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]) successfully deleted
I20251025 08:02:27.740690 14724 master_service.cc:954] ReplaceTablet: received request to replace tablet 1bd788e8b38b401a89cbc250b3695088 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:27.740957 14727 catalog_manager.cc:6719] ReplaceTablet: tablet b7e8a698e8ba408a833bbc3905b2ad04 deleted and replaced by tablet b04e5c106dd7400aa039dbf6666ad3aa
I20251025 08:02:27.741087 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet 5e605f701a474fff80688533f3a398e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.741719 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet cf90d2e477b9493e9b78aae6a7d2d3e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.741895 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec with delete_type TABLET_DATA_DELETED (replaced by tablet 51fca67cb1b84e44a491b6a788c01062) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.741981 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet e0635cb57c4d4d51bed5897b28cc3dcd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.742115 14949 tablet_service.cc:1552] Processing DeleteTablet for tablet f89313f3d7344132b2fb0fab8941bb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.742609 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet cf5008728a6241c096c9a76f8e374ceb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.742718 14949 tablet_service.cc:1552] Processing DeleteTablet for tablet 0310efe286dd409ab857a92daa6ff99f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.743496 14949 tablet_service.cc:1552] Processing DeleteTablet for tablet 77365d99094541b2a5f7b8bb3bc18739 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.743578 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet 74d87666abb643899a7b1e576e6cc840 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b8d94fc010046c7b37804f168471904) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.743691 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet f585455b77df49738b44c31a3d7adb71 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.743716 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet a608dd2b2d1d42178bb00b3355bd6470 with delete_type TABLET_DATA_DELETED (replaced by tablet c59083b54df24c21a3114c34a73dd638) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.743817 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet 5d25a2805a264574bc20150762c48262 with delete_type TABLET_DATA_DELETED (replaced by tablet 221f4c5432bc45e18728f5ed1453ad0f) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.743830 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet bcb5f7e52507450c8a6f5a99a9927974 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.744004 16363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:27.744091 16363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: This master's current role is: LEADER
I20251025 08:02:27.745188 16370 tablet.cc:1722] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.746457 16366 tablet.cc:1722] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.747859 16366 tablet.cc:1722] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.747982 14949 tablet_service.cc:1552] Processing DeleteTablet for tablet 01d9f6636b364e3b9192ae546422de5b with delete_type TABLET_DATA_DELETED (replaced by tablet 53f89ab2ef9b4136812cb4a320a645a6) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.748090 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet ff82c6ab12c844339dd387569fb85526 with delete_type TABLET_DATA_DELETED (replaced by tablet 8737df10a3c8482c995ac6aadc240c42) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.747881 16373 mvcc.cc:204] Tried to move back new op lower bound from 7214609807779721216 to 7214609803516416000. Current Snapshot: MvccSnapshot[applied={T|T < 7214609807779721216 or (T in {7214609807779721216})}]
I20251025 08:02:27.755411 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet eed2815efb7e46dd8b41f5ffe60daee8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7711a974f4a84d639f1c3077da9d855f) from {username='slave'} at 127.0.0.1:41754
W20251025 08:02:27.756050 15185 leader_election.cc:343] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:27.756124 15185 leader_election.cc:304] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:27.756124 16366 tablet.cc:1722] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.756357 16199 raft_consensus.cc:2749] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:27.756557 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet d2697ee09dc74d35abffc3158410aa5e with delete_type TABLET_DATA_DELETED (replaced by tablet 04d3488a6b814223b742f0d5c946362f) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.757412 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet cf90d2e477b9493e9b78aae6a7d2d3e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.758005 16371 tablet_replica.cc:333] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:27.757992 16366 tablet.cc:1722] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.758242 16371 raft_consensus.cc:2243] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:27.758455 16371 raft_consensus.cc:2272] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.759356 16366 tablet.cc:1722] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.760090 16391 tablet_bootstrap.cc:492] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:27.760179 16391 ts_tablet_manager.cc:1403] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.066s user 0.002s sys 0.000s
I20251025 08:02:27.760643 16391 raft_consensus.cc:359] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.760749 16391 raft_consensus.cc:385] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.760782 16391 raft_consensus.cc:740] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.760885 16391 consensus_queue.cc:260] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.761170 16391 ts_tablet_manager.cc:1434] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:27.761348 16391 tablet_bootstrap.cc:492] T e66c7b43490a4391a59e09f1832a53b3 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:27.765133 14719 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 071220f7bd334f5aad733209193244d4
I20251025 08:02:27.765426 14719 catalog_manager.cc:6719] ReplaceTablet: tablet 071220f7bd334f5aad733209193244d4 deleted and replaced by tablet e48ddcfccc1340d39d21ce94bec4bf27
I20251025 08:02:27.766078 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 76a906654cc44bfb96d9e1a936040e57 with delete_type TABLET_DATA_DELETED (replaced by tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.766227 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 40f70d2139534907ab929dae893c740d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.766330 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet f08d0c3446dd4a478f81688a3259bb91 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.766928 15084 tablet_service.cc:1552] Processing DeleteTablet for tablet f585455b77df49738b44c31a3d7adb71 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.767074 15084 tablet_service.cc:1552] Processing DeleteTablet for tablet bcb5f7e52507450c8a6f5a99a9927974 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.767186 15084 tablet_service.cc:1552] Processing DeleteTablet for tablet eed2815efb7e46dd8b41f5ffe60daee8 with delete_type TABLET_DATA_DELETED (replaced by tablet 7711a974f4a84d639f1c3077da9d855f) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.767216 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet cf90d2e477b9493e9b78aae6a7d2d3e0 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.767280 15083 tablet_service.cc:1552] Processing DeleteTablet for tablet d2697ee09dc74d35abffc3158410aa5e with delete_type TABLET_DATA_DELETED (replaced by tablet 04d3488a6b814223b742f0d5c946362f) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.767339 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet cf5008728a6241c096c9a76f8e374ceb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.767390 15082 tablet_service.cc:1552] Processing DeleteTablet for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec with delete_type TABLET_DATA_DELETED (replaced by tablet 51fca67cb1b84e44a491b6a788c01062) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.767474 15087 tablet_service.cc:1552] Processing DeleteTablet for tablet 77365d99094541b2a5f7b8bb3bc18739 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.767904 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet b7e8a698e8ba408a833bbc3905b2ad04 with delete_type TABLET_DATA_DELETED (replaced by tablet b04e5c106dd7400aa039dbf6666ad3aa) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.768060 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 4d9cd745bd3e42e98b0ae1d145007bee (table default.Table_8540557c73a34cc2851ad08d71acac22 [id=abe30167767443d0b8e59f9418399d88]). Expected version 1 got 0
I20251025 08:02:27.768208 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 74d87666abb643899a7b1e576e6cc840 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b8d94fc010046c7b37804f168471904) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.768278 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 95c9778bd0d94542bec79e9d36c6ce46 (table default.Table_7387f487853a4b608f5e5237684550d8 [id=3e1281c3f28346a4a1dd2c4fcc990a2e]). Expected version 2 got 0
I20251025 08:02:27.768308 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 0310efe286dd409ab857a92daa6ff99f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.768412 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 5e605f701a474fff80688533f3a398e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.768508 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 5a70808199034508833e4d2e5550b29b (table default.Table_fb3af07031d2433fa1949ff417c1e03f [id=a788bc4f491d4d7580a83895797f5651]). Expected version 1 got 0
I20251025 08:02:27.768693 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet bcf414d04305456b80b2ec5dd8fb0ba7 (table default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24]). Expected version 1 got 0
I20251025 08:02:27.768996 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 43da3f4fc9604562a95dff59da3c574b (table default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031]). Expected version 2 got 0
I20251025 08:02:27.769253 14725 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet b3fdc5bd4c7f4506a150f31137e8b091 (table default.Table_096e271857534077bea9b8e03894dfe0 [id=ff44f0c128c44faa9f36925f9477c66a]). Expected version 1 got 0
I20251025 08:02:27.773952 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet f585455b77df49738b44c31a3d7adb71 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.774119 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet f89313f3d7344132b2fb0fab8941bb3e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.774235 15217 tablet_service.cc:1552] Processing DeleteTablet for tablet 74d87666abb643899a7b1e576e6cc840 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b8d94fc010046c7b37804f168471904) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.774269 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 77365d99094541b2a5f7b8bb3bc18739 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.774241 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 0310efe286dd409ab857a92daa6ff99f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.774343 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 01d9f6636b364e3b9192ae546422de5b with delete_type TABLET_DATA_DELETED (replaced by tablet 53f89ab2ef9b4136812cb4a320a645a6) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.774420 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet dfb4a050022d462699005fedc4323fdb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.774434 15217 tablet_service.cc:1552] Processing DeleteTablet for tablet ff82c6ab12c844339dd387569fb85526 with delete_type TABLET_DATA_DELETED (replaced by tablet 8737df10a3c8482c995ac6aadc240c42) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.774497 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet cf5008728a6241c096c9a76f8e374ceb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:25 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.774526 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 88052f79558a42eeb1c8acf44e6b48e1 with delete_type TABLET_DATA_DELETED (replaced by tablet f8576553f17b49f8bd11436ecac471ed) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.774577 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet 4dd72f76c950485c968409fe868266a2 with delete_type TABLET_DATA_DELETED (replaced by tablet 4f3163f8a4ff49069d55b9acf8a4c19a) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.774610 15217 tablet_service.cc:1552] Processing DeleteTablet for tablet 071220f7bd334f5aad733209193244d4 with delete_type TABLET_DATA_DELETED (replaced by tablet e48ddcfccc1340d39d21ce94bec4bf27) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.775285 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet e0635cb57c4d4d51bed5897b28cc3dcd with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.775413 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec with delete_type TABLET_DATA_DELETED (replaced by tablet 51fca67cb1b84e44a491b6a788c01062) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.776784 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 071220f7bd334f5aad733209193244d4 with delete_type TABLET_DATA_DELETED (replaced by tablet e48ddcfccc1340d39d21ce94bec4bf27) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.778585 16366 tablet.cc:1722] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.764671 16370 tablet.cc:1722] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.780213 16370 tablet.cc:1722] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.781644 16370 tablet.cc:1722] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.783028 16370 tablet.cc:1722] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.770718 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 071220f7bd334f5aad733209193244d4 with delete_type TABLET_DATA_DELETED (replaced by tablet e48ddcfccc1340d39d21ce94bec4bf27) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.767814 16371 ts_tablet_manager.cc:1916] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.770749 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet 76a906654cc44bfb96d9e1a936040e57 with delete_type TABLET_DATA_DELETED (replaced by tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.786777 16371 ts_tablet_manager.cc:1929] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:27.786896 16371 log.cc:1199] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/0a187a088f5042c081aa87c79662c8cf
I20251025 08:02:27.787220 16371 ts_tablet_manager.cc:1950] T 0a187a088f5042c081aa87c79662c8cf P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:27.787637 16403 tablet.cc:1722] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.787739 16415 tablet.cc:1722] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.787819 16371 tablet_replica.cc:333] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:27.787937 16371 raft_consensus.cc:2243] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:27.788106 16371 raft_consensus.cc:2272] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.788443 16371 ts_tablet_manager.cc:1916] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.789449 16403 tablet.cc:1722] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.790462 16371 ts_tablet_manager.cc:1929] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.790984 16403 tablet.cc:1722] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.791405 16364 tablet_replica.cc:333] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.791564 16364 raft_consensus.cc:2243] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.791698 16364 pending_rounds.cc:70] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 1 pending ops.
I20251025 08:02:27.791765 16364 pending_rounds.cc:77] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7214609808378494976 op_type: ALTER_SCHEMA_OP alter_schema_request { tablet_id: "f08d0c3446dd4a478f81688a3259bb91" schema { columns { id: 10 name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } schema_version: 1 new_table_name: "default.Table_84b80cef0bc442cfb9f5301562ff1cce" dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" new_extra_config { } }
I20251025 08:02:27.791996 16364 raft_consensus.cc:2272] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.792075 16372 ts_tablet_manager.cc:1916] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.792771 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 0a187a088f5042c081aa87c79662c8cf (table default.Table_b42eeab602164c40a7721a43fb071328 [id=4b8789f2c2234483aa891cad1334c474]) successfully deleted
I20251025 08:02:27.794411 14726 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_2931abc275064dfd818fc151a0267713" } modify_external_catalogs: true
I20251025 08:02:27.794533 14726 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_2931abc275064dfd818fc151a0267713" } modify_external_catalogs: true
I20251025 08:02:27.794661 14724 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 1bd788e8b38b401a89cbc250b3695088
I20251025 08:02:27.794907 14724 catalog_manager.cc:6719] ReplaceTablet: tablet 1bd788e8b38b401a89cbc250b3695088 deleted and replaced by tablet e106f20977444dd4a49b6e4ae0f45380
I20251025 08:02:27.795085 14720 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_2ddd7375c83b44f2817d62efca908cd1" } modify_external_catalogs: true
I20251025 08:02:27.795174 14720 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_2ddd7375c83b44f2817d62efca908cd1" } modify_external_catalogs: true
I20251025 08:02:27.796150 14724 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_027f43c7a0d34932a84b5f0922e7da40" } new_table_name: "default.Table_3ad0d85469a7485ba556f83ce20cecdf" modify_external_catalogs: true
I20251025 08:02:27.797153 14719 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_475579a80dad4c89bfd895cd2fdaafaf" } modify_external_catalogs: true
I20251025 08:02:27.797230 14719 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_475579a80dad4c89bfd895cd2fdaafaf" } modify_external_catalogs: true
I20251025 08:02:27.797739 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet 1bd788e8b38b401a89cbc250b3695088 with delete_type TABLET_DATA_DELETED (replaced by tablet e106f20977444dd4a49b6e4ae0f45380) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.798751 16403 tablet.cc:1722] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.803455 16372 ts_tablet_manager.cc:1929] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.803571 16372 log.cc:1199] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/5d25a2805a264574bc20150762c48262
I20251025 08:02:27.803867 16372 ts_tablet_manager.cc:1950] T 5d25a2805a264574bc20150762c48262 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:27.804428 16372 tablet_replica.cc:333] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:27.804593 16372 raft_consensus.cc:2243] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:27.804813 16372 raft_consensus.cc:2272] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.805335 16372 ts_tablet_manager.cc:1916] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.808352 14726 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 2091a81ad64a4574b04c081bdeceda1f
I20251025 08:02:27.808786 14720 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet d621f8b5a2f744c6be120d565753d4c6
W20251025 08:02:27.809036 14724 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e87bae31e5e642a5a34a8c170c62fdca consensus state has no leader
I20251025 08:02:27.810482 14724 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_096e271857534077bea9b8e03894dfe0" } new_table_name: "default.Table_a01a1e605d7944fc9e89f1b656ccd903" modify_external_catalogs: true
I20251025 08:02:27.811157 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet 2091a81ad64a4574b04c081bdeceda1f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.812155 14720 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_8f781f3f507c4a339ba15100b719fcbb" } new_table_name: "default.Table_b67672426aa24686a8955d366f86ff2d" modify_external_catalogs: true
I20251025 08:02:27.814637 16366 tablet.cc:1722] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.816905 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 1bd788e8b38b401a89cbc250b3695088 with delete_type TABLET_DATA_DELETED (replaced by tablet e106f20977444dd4a49b6e4ae0f45380) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.817032 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 2091a81ad64a4574b04c081bdeceda1f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.818835 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 5d25a2805a264574bc20150762c48262 (table default.Table_4a9fc326b302473f86d8d3f7e7b8040f [id=15a38bbafe4045e9991cb846ec9e452c]) successfully deleted
I20251025 08:02:27.821234 16390 tablet_bootstrap.cc:492] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:27.821322 16390 ts_tablet_manager.cc:1403] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.196s user 0.002s sys 0.000s
I20251025 08:02:27.821739 16390 raft_consensus.cc:359] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.821863 16390 raft_consensus.cc:385] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.821900 16390 raft_consensus.cc:740] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.822033 16390 consensus_queue.cc:260] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.822398 16390 ts_tablet_manager.cc:1434] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:27.822557 16390 tablet_bootstrap.cc:492] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:27.815893 16417 tablet.cc:1722] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.823498 16390 tablet_bootstrap.cc:654] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.824371 16425 tablet.cc:1722] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:27.822033 16441 consensus_queue.cc:1175] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" status { last_received { term: 1 index: 2 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 2 } }
I20251025 08:02:27.762182 16391 tablet_bootstrap.cc:654] T e66c7b43490a4391a59e09f1832a53b3 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.799157 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet 1bd788e8b38b401a89cbc250b3695088 with delete_type TABLET_DATA_DELETED (replaced by tablet e106f20977444dd4a49b6e4ae0f45380) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.811039 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 2091a81ad64a4574b04c081bdeceda1f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.814807 16370 tablet.cc:1722] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.828451 16371 log.cc:1199] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/3bf26408c98e49298ff9c738a1e26cf9
I20251025 08:02:27.828718 16371 ts_tablet_manager.cc:1950] T 3bf26408c98e49298ff9c738a1e26cf9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:27.829278 16371 tablet_replica.cc:333] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:27.829429 16371 raft_consensus.cc:2243] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:27.829615 16371 raft_consensus.cc:2272] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.830122 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 3bf26408c98e49298ff9c738a1e26cf9 (table default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]) successfully deleted
I20251025 08:02:27.830493 16364 ts_tablet_manager.cc:1916] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.831314 16371 ts_tablet_manager.cc:1916] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.832329 16364 ts_tablet_manager.cc:1929] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:27.832441 16364 log.cc:1199] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/f08d0c3446dd4a478f81688a3259bb91
I20251025 08:02:27.832723 16364 ts_tablet_manager.cc:1950] T f08d0c3446dd4a478f81688a3259bb91 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:27.833452 16403 tablet.cc:1722] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.833585 16372 ts_tablet_manager.cc:1929] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.833639 16372 log.cc:1199] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/a608dd2b2d1d42178bb00b3355bd6470
I20251025 08:02:27.833848 16372 ts_tablet_manager.cc:1950] T a608dd2b2d1d42178bb00b3355bd6470 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:27.834029 16364 tablet_replica.cc:333] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.834487 16364 raft_consensus.cc:2243] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.834717 16390 tablet_bootstrap.cc:492] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:27.834775 16364 raft_consensus.cc:2272] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.834793 16390 ts_tablet_manager.cc:1403] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20251025 08:02:27.835054 16364 ts_tablet_manager.cc:1916] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.835171 16390 raft_consensus.cc:359] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.835265 16390 raft_consensus.cc:385] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.835294 16390 raft_consensus.cc:740] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.835394 16390 consensus_queue.cc:260] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.835637 16390 ts_tablet_manager.cc:1434] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:27.835789 16390 tablet_bootstrap.cc:492] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:27.836328 16370 tablet.cc:1722] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.836753 16390 tablet_bootstrap.cc:654] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.837508 16366 tablet.cc:1722] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.838254 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet f08d0c3446dd4a478f81688a3259bb91 (table default.Table_84b80cef0bc442cfb9f5301562ff1cce [id=ab926bc9b7424c45a5415c4763db2b4e]) successfully deleted
W20251025 08:02:27.838483 14713 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 0a187a088f5042c081aa87c79662c8cf because the tablet was not found. No further retry: Not found: Tablet not found: 0a187a088f5042c081aa87c79662c8cf
W20251025 08:02:27.838613 14713 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 3bf26408c98e49298ff9c738a1e26cf9 because the tablet was not found. No further retry: Not found: Tablet not found: 3bf26408c98e49298ff9c738a1e26cf9
I20251025 08:02:27.839448 14723 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet ea0d438e99864c57999abf3467edc643 (table default.Table_3c48d3160e5d42509de4f0be1af855e2 [id=912da5ef8bbf4af29528c084ea7fa633]). Expected version 1 got 0
I20251025 08:02:27.839645 14723 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 72ff369b973b4c5981ea0810e37e8562 (table default.Table_4ed89f5fc452467d920d19caa6fb931a [id=8a0e4fe9e4544c539cb23b0279c1deaf]). Expected version 1 got 0
I20251025 08:02:27.839809 14723 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 346c0c8bf30b4dbaa92436b45e5fbf47 (table default.Table_4afe1c6e03a941df9d5f7df4a42cbc61 [id=ef3a1760f2c44935bbb79e518510905f]). Expected version 1 got 0
W20251025 08:02:27.840162 14713 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet a608dd2b2d1d42178bb00b3355bd6470 because the tablet was not found. No further retry: Not found: Tablet not found: a608dd2b2d1d42178bb00b3355bd6470
I20251025 08:02:27.841157 16366 tablet.cc:1722] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.841933 14719 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 8737df10a3c8482c995ac6aadc240c42
I20251025 08:02:27.842450 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet 8737df10a3c8482c995ac6aadc240c42 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.842907 16390 tablet_bootstrap.cc:492] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:27.842978 16390 ts_tablet_manager.cc:1403] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
I20251025 08:02:27.842962 16372 tablet_replica.cc:333] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:27.843113 16372 raft_consensus.cc:2243] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.843156 14725 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe] alter complete (version 1)
I20251025 08:02:27.843204 16372 raft_consensus.cc:2272] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.843390 16390 raft_consensus.cc:359] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.843488 16390 raft_consensus.cc:385] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.843521 16390 raft_consensus.cc:740] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.843567 16372 ts_tablet_manager.cc:1916] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.843628 16390 consensus_queue.cc:260] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.843883 16390 ts_tablet_manager.cc:1434] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:27.844030 16390 tablet_bootstrap.cc:492] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:27.844906 16390 tablet_bootstrap.cc:654] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.845189 16366 tablet.cc:1722] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.846020 16371 ts_tablet_manager.cc:1929] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:27.846103 16371 log.cc:1199] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/f08d0c3446dd4a478f81688a3259bb91
I20251025 08:02:27.846166 16365 tablet.cc:1722] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.846374 16371 ts_tablet_manager.cc:1950] T f08d0c3446dd4a478f81688a3259bb91 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:27.846832 16371 tablet_replica.cc:333] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:27.846957 16371 raft_consensus.cc:2243] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.847059 16371 raft_consensus.cc:2272] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.848690 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet f08d0c3446dd4a478f81688a3259bb91 (table default.Table_84b80cef0bc442cfb9f5301562ff1cce [id=ab926bc9b7424c45a5415c4763db2b4e]) successfully deleted
I20251025 08:02:27.848953 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 0a187a088f5042c081aa87c79662c8cf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.851907 14723 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet b3fdc5bd4c7f4506a150f31137e8b091 (table default.Table_a01a1e605d7944fc9e89f1b656ccd903 [id=ff44f0c128c44faa9f36925f9477c66a]). Expected version 2 got 1
I20251025 08:02:27.854056 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet 8737df10a3c8482c995ac6aadc240c42 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:27.855363 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet a608dd2b2d1d42178bb00b3355bd6470 (table default.Table_808c7980d96b48a181f79124ea5a0adb [id=e3c0ae796ee2421abe38408b729dd2a6]) successfully deleted
I20251025 08:02:27.856551 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 8737df10a3c8482c995ac6aadc240c42 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.856838 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 5d25a2805a264574bc20150762c48262 with delete_type TABLET_DATA_DELETED (replaced by tablet 221f4c5432bc45e18728f5ed1453ad0f) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.857039 14723 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031] alter complete (version 2)
I20251025 08:02:27.858122 16371 ts_tablet_manager.cc:1916] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.858522 16199 raft_consensus.cc:493] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:27.858596 16199 raft_consensus.cc:515] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:27.858877 16199 leader_election.cc:290] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:27.859812 15183 leader_election.cc:343] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 88052f79558a42eeb1c8acf44e6b48e1
I20251025 08:02:27.860443 14723 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_3c48d3160e5d42509de4f0be1af855e2 [id=912da5ef8bbf4af29528c084ea7fa633] alter complete (version 1)
W20251025 08:02:27.862529 15185 leader_election.cc:343] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 88052f79558a42eeb1c8acf44e6b48e1
I20251025 08:02:27.862515 16366 tablet.cc:1722] T b3fdc5bd4c7f4506a150f31137e8b091 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.862610 15185 leader_election.cc:304] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:27.862732 16199 raft_consensus.cc:2749] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:27.815780 16424 tablet.cc:1722] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.864131 16372 ts_tablet_manager.cc:1929] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.864629 16372 log.cc:1199] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/e0635cb57c4d4d51bed5897b28cc3dcd
I20251025 08:02:27.865370 14723 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_4afe1c6e03a941df9d5f7df4a42cbc61 [id=ef3a1760f2c44935bbb79e518510905f] alter complete (version 1)
I20251025 08:02:27.870031 16372 ts_tablet_manager.cc:1950] T e0635cb57c4d4d51bed5897b28cc3dcd P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:27.872257 15864 raft_consensus.cc:493] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:27.872330 15864 raft_consensus.cc:515] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.872617 15864 leader_election.cc:290] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:27.873028 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c301e7a80c64d8e8751ecfa681ab202" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:27.873270 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c301e7a80c64d8e8751ecfa681ab202" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:27.873323 14915 leader_election.cc:343] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:27.873368 15238 raft_consensus.cc:2468] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:27.873795 14914 leader_election.cc:304] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:27.874110 15464 raft_consensus.cc:2804] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:27.874159 15464 raft_consensus.cc:493] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:27.874233 15464 raft_consensus.cc:3060] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:27.875062 15464 raft_consensus.cc:515] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.875370 15464 leader_election.cc:290] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:27.875398 16372 tablet_replica.cc:333] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:27.876274 16372 raft_consensus.cc:2243] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.877584 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c301e7a80c64d8e8751ecfa681ab202" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:27.877794 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c301e7a80c64d8e8751ecfa681ab202" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:27.877883 15238 raft_consensus.cc:3060] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:27.877856 14915 leader_election.cc:343] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:27.878338 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet e0635cb57c4d4d51bed5897b28cc3dcd (table default.Table_bb2712f0481c486fa9db6d0113289be2 [id=198c7d73328440ac8c6eef2c24c5e0ad]) successfully deleted
I20251025 08:02:27.878156 16372 raft_consensus.cc:2272] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.878851 15238 raft_consensus.cc:2468] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:27.879235 16371 ts_tablet_manager.cc:1929] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.879817 16371 log.cc:1199] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/b7e8a698e8ba408a833bbc3905b2ad04
I20251025 08:02:27.880268 14914 leader_election.cc:304] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:27.880468 15864 raft_consensus.cc:2804] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:27.880541 15864 raft_consensus.cc:697] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:27.880667 15864 consensus_queue.cc:237] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.881251 16372 ts_tablet_manager.cc:1916] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.881525 14719 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_67e95c34b6c44449abf8828cc3b6e9c2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.881884 14719 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67e95c34b6c44449abf8828cc3b6e9c2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.881841 16371 ts_tablet_manager.cc:1950] T b7e8a698e8ba408a833bbc3905b2ad04 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:27.883249 14720 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_a6bf9c572cb3485f9ecced6d0d55877d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.883560 14720 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a6bf9c572cb3485f9ecced6d0d55877d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.884627 14725 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_165ff894c5ab455e8daf5d1cf318b785"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:27.884627 16365 tablet.cc:1722] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20251025 08:02:27.885306 14725 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_165ff894c5ab455e8daf5d1cf318b785 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.888010 16403 tablet.cc:1722] T b3fdc5bd4c7f4506a150f31137e8b091 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.888316 14719 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_7b738fa61be04903bdb5b03ee75099a0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.888674 14719 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7b738fa61be04903bdb5b03ee75099a0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.889469 16403 tablet.cc:1722] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.889540 16365 tablet.cc:1722] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.890197 16364 ts_tablet_manager.cc:1929] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:27.891010 16365 tablet.cc:1722] T b3fdc5bd4c7f4506a150f31137e8b091 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:27.901207 16364 log.cc:1199] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/e54e57e850564e079db3dd383347ed30
I20251025 08:02:27.901456 16364 ts_tablet_manager.cc:1950] T e54e57e850564e079db3dd383347ed30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:27.902070 16364 tablet_replica.cc:333] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.902377 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet e54e57e850564e079db3dd383347ed30 (table default.Table_7387f487853a4b608f5e5237684550d8 [id=3e1281c3f28346a4a1dd2c4fcc990a2e]) successfully deleted
I20251025 08:02:27.902632 16364 raft_consensus.cc:2243] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.902763 16364 raft_consensus.cc:2272] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.903304 16364 ts_tablet_manager.cc:1916] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.903240 16371 tablet_replica.cc:333] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:27.904284 16371 raft_consensus.cc:2243] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.904547 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet b7e8a698e8ba408a833bbc3905b2ad04 (table default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]) successfully deleted
I20251025 08:02:27.905154 16364 ts_tablet_manager.cc:1929] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.905279 16364 log.cc:1199] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/5e605f701a474fff80688533f3a398e7
I20251025 08:02:27.905572 16364 ts_tablet_manager.cc:1950] T 5e605f701a474fff80688533f3a398e7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:27.906271 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 5e605f701a474fff80688533f3a398e7 (table default.Table_e650e0b918954a7f8c97ff7e8e9bcffd [id=dfe9146b50254c54ad1b75080a2ee201]) successfully deleted
I20251025 08:02:27.825399 16416 tablet.cc:1722] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.907066 16390 tablet_bootstrap.cc:492] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:27.907141 16390 ts_tablet_manager.cc:1403] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.063s user 0.001s sys 0.001s
I20251025 08:02:27.907333 14723 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_4ed89f5fc452467d920d19caa6fb931a [id=8a0e4fe9e4544c539cb23b0279c1deaf] alter complete (version 1)
I20251025 08:02:27.907555 16390 raft_consensus.cc:359] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.907629 16390 raft_consensus.cc:385] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.907652 16390 raft_consensus.cc:740] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.907745 16390 consensus_queue.cc:260] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.907974 16390 ts_tablet_manager.cc:1434] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:27.908113 16390 tablet_bootstrap.cc:492] T e66c7b43490a4391a59e09f1832a53b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:27.908958 16390 tablet_bootstrap.cc:654] T e66c7b43490a4391a59e09f1832a53b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.904968 16371 raft_consensus.cc:2272] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.911101 16199 raft_consensus.cc:493] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:27.911171 16199 raft_consensus.cc:515] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:27.911453 16199 leader_election.cc:290] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:27.912097 15183 leader_election.cc:343] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: dfb4a050022d462699005fedc4323fdb
W20251025 08:02:27.912339 15185 leader_election.cc:343] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: dfb4a050022d462699005fedc4323fdb
I20251025 08:02:27.912420 15185 leader_election.cc:304] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:27.912708 16199 raft_consensus.cc:2749] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:27.914235 14725 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_d646c0b533324af5a468616714a7a44c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.914680 14725 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d646c0b533324af5a468616714a7a44c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.915555 16417 tablet.cc:1722] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.916100 16463 tablet.cc:1722] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.916653 16371 ts_tablet_manager.cc:1916] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.916847 14719 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_335f460fbdde453797ee3c1260214c09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:27.917151 14719 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_335f460fbdde453797ee3c1260214c09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:27.918743 16371 ts_tablet_manager.cc:1929] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:27.918855 16371 log.cc:1199] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/4f3163f8a4ff49069d55b9acf8a4c19a
I20251025 08:02:27.920687 14723 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_7387f487853a4b608f5e5237684550d8 [id=3e1281c3f28346a4a1dd2c4fcc990a2e] alter complete (version 2)
I20251025 08:02:27.923455 16390 tablet_bootstrap.cc:492] T e66c7b43490a4391a59e09f1832a53b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:27.923530 16390 ts_tablet_manager.cc:1403] T e66c7b43490a4391a59e09f1832a53b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.001s
I20251025 08:02:27.923961 16390 raft_consensus.cc:359] T e66c7b43490a4391a59e09f1832a53b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.924042 16390 raft_consensus.cc:385] T e66c7b43490a4391a59e09f1832a53b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.924073 16390 raft_consensus.cc:740] T e66c7b43490a4391a59e09f1832a53b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.924175 16390 consensus_queue.cc:260] T e66c7b43490a4391a59e09f1832a53b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.924419 16390 ts_tablet_manager.cc:1434] T e66c7b43490a4391a59e09f1832a53b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:27.924559 16390 tablet_bootstrap.cc:492] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:27.925444 16390 tablet_bootstrap.cc:654] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.928347 16371 ts_tablet_manager.cc:1950] T 4f3163f8a4ff49069d55b9acf8a4c19a P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:27.929280 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 4f3163f8a4ff49069d55b9acf8a4c19a (table default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064]) successfully deleted
I20251025 08:02:27.930033 16364 tablet_replica.cc:333] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.930217 16364 raft_consensus.cc:2243] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.930366 16364 raft_consensus.cc:2272] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:27.930753 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 40f70d2139534907ab929dae893c740d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40f70d2139534907ab929dae893c740d already in progress: creating tablet
I20251025 08:02:27.930493 16372 ts_tablet_manager.cc:1929] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:27.930932 16372 log.cc:1199] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/0a187a088f5042c081aa87c79662c8cf
I20251025 08:02:27.931027 14722 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_a01a1e605d7944fc9e89f1b656ccd903 [id=ff44f0c128c44faa9f36925f9477c66a] alter complete (version 2)
I20251025 08:02:27.932343 16371 tablet_replica.cc:333] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:27.932535 16371 raft_consensus.cc:2243] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.933251 16390 tablet_bootstrap.cc:492] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:27.933331 16390 ts_tablet_manager.cc:1403] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.001s
I20251025 08:02:27.933734 16390 raft_consensus.cc:359] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.933820 16390 raft_consensus.cc:385] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.933849 16390 raft_consensus.cc:740] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.933944 16390 consensus_queue.cc:260] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.934257 16390 ts_tablet_manager.cc:1434] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:27.934408 16390 tablet_bootstrap.cc:492] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:27.935243 16390 tablet_bootstrap.cc:654] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.935271 16364 ts_tablet_manager.cc:1916] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.936005 16371 raft_consensus.cc:2272] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.936039 14725 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_541e363972b34e9b9b64f21b771e7ce2" } new_table_name: "default.Table_32f95976a4704d3fbba9e5c01cb8f9d9" modify_external_catalogs: true
I20251025 08:02:27.936381 16371 ts_tablet_manager.cc:1916] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.938268 16372 ts_tablet_manager.cc:1950] T 0a187a088f5042c081aa87c79662c8cf P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:27.938833 14722 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_b67672426aa24686a8955d366f86ff2d [id=2283253a9522485d93d6c484c5eef6e4] alter complete (version 1)
W20251025 08:02:27.941505 14725 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 04d3488a6b814223b742f0d5c946362f consensus state has no leader
I20251025 08:02:27.944687 16372 tablet_replica.cc:333] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:27.945458 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 5564705a3771425da1f33830e7b51e03 (DEFAULT_TABLE table=default.Table_9ab03dea59b04746968d5f6753b931d6 [id=ec9b64d93dfc44a29aae35e6b02e2fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.945668 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5564705a3771425da1f33830e7b51e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.945883 15214 tablet_service.cc:1505] Processing CreateTablet for tablet 143b073e21a4456591fa1f96668118b4 (DEFAULT_TABLE table=default.Table_49bbc2328aab41cda10e05a7fb925cd9 [id=1338885c63014b47bcd512a9ddfaf31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.946067 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 143b073e21a4456591fa1f96668118b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.946656 15217 tablet_service.cc:1505] Processing CreateTablet for tablet 60c49b70f8f44dd3aec433206b897843 (DEFAULT_TABLE table=default.Table_df3848a55c7646b1bd519eb12aa88aa1 [id=5160fad54600448f8b2c5bfc942f60a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.946907 15217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c49b70f8f44dd3aec433206b897843. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.947752 15212 tablet_service.cc:1505] Processing CreateTablet for tablet f65b1ad4764a4ed3a33baccaf278f043 (DEFAULT_TABLE table=default.Table_b074f35366374acd92bf7528094773a0 [id=afe8a5e6aa824ba69530f71c2b2d4617]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.947980 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f65b1ad4764a4ed3a33baccaf278f043. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.948552 16372 raft_consensus.cc:2243] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.951198 16372 raft_consensus.cc:2272] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.952117 16372 ts_tablet_manager.cc:1916] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.952499 15212 tablet_service.cc:1505] Processing CreateTablet for tablet c2415c51234f482ca295cc71a74e7cab (DEFAULT_TABLE table=default.Table_9f2128ef54374befaec2adc1a1295f27 [id=bc094a879104430797416fd06811a2e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.952729 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2415c51234f482ca295cc71a74e7cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.953823 14722 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_8540557c73a34cc2851ad08d71acac22 [id=abe30167767443d0b8e59f9418399d88] alter complete (version 1)
I20251025 08:02:27.956022 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 143b073e21a4456591fa1f96668118b4 (DEFAULT_TABLE table=default.Table_49bbc2328aab41cda10e05a7fb925cd9 [id=1338885c63014b47bcd512a9ddfaf31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.956360 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 5564705a3771425da1f33830e7b51e03 (DEFAULT_TABLE table=default.Table_9ab03dea59b04746968d5f6753b931d6 [id=ec9b64d93dfc44a29aae35e6b02e2fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.956380 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 0a187a088f5042c081aa87c79662c8cf (table default.Table_b42eeab602164c40a7721a43fb071328 [id=4b8789f2c2234483aa891cad1334c474]) successfully deleted
I20251025 08:02:27.956720 15088 tablet_service.cc:1505] Processing CreateTablet for tablet f65b1ad4764a4ed3a33baccaf278f043 (DEFAULT_TABLE table=default.Table_b074f35366374acd92bf7528094773a0 [id=afe8a5e6aa824ba69530f71c2b2d4617]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.957049 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 60c49b70f8f44dd3aec433206b897843 (DEFAULT_TABLE table=default.Table_df3848a55c7646b1bd519eb12aa88aa1 [id=5160fad54600448f8b2c5bfc942f60a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.957371 15087 tablet_service.cc:1505] Processing CreateTablet for tablet c2415c51234f482ca295cc71a74e7cab (DEFAULT_TABLE table=default.Table_9f2128ef54374befaec2adc1a1295f27 [id=bc094a879104430797416fd06811a2e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.957659 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 (DEFAULT_TABLE table=default.Table_4598018e26254b78befa93852241f777 [id=78794c8ceec3479ca3ac3ef55594762f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.961045 14722 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_fb3af07031d2433fa1949ff417c1e03f [id=a788bc4f491d4d7580a83895797f5651] alter complete (version 1)
I20251025 08:02:27.963763 14719 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_4a9fc326b302473f86d8d3f7e7b8040f" } modify_external_catalogs: true
I20251025 08:02:27.963860 14719 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_4a9fc326b302473f86d8d3f7e7b8040f" } modify_external_catalogs: true
I20251025 08:02:27.964010 14722 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_8540557c73a34cc2851ad08d71acac22" } modify_external_catalogs: true
I20251025 08:02:27.964308 14722 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_8540557c73a34cc2851ad08d71acac22" } modify_external_catalogs: true
I20251025 08:02:27.964421 14724 master_service.cc:954] ReplaceTablet: received request to replace tablet 1bd788e8b38b401a89cbc250b3695088 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:27.964497 14726 master_service.cc:954] ReplaceTablet: received request to replace tablet 801d06a391e34bec8e1f74257937f069 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:27.965030 14720 master_service.cc:954] ReplaceTablet: received request to replace tablet 88efe498fb6f4ce1a02b5389ff6f5797 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:27.967365 14723 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_2f4e7934dc164dcdadd6467e1afc563a" } new_table_name: "default.Table_8c35a9c9c9614e8bac181a2aa85e12ba" modify_external_catalogs: true
I20251025 08:02:27.970722 14725 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24] alter complete (version 1)
I20251025 08:02:27.944747 14954 tablet_service.cc:1505] Processing CreateTablet for tablet 143b073e21a4456591fa1f96668118b4 (DEFAULT_TABLE table=default.Table_49bbc2328aab41cda10e05a7fb925cd9 [id=1338885c63014b47bcd512a9ddfaf31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.971151 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 143b073e21a4456591fa1f96668118b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.972283 16371 ts_tablet_manager.cc:1929] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:27.972345 16371 log.cc:1199] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/5e605f701a474fff80688533f3a398e7
I20251025 08:02:27.972600 16371 ts_tablet_manager.cc:1950] T 5e605f701a474fff80688533f3a398e7 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:27.945703 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 5564705a3771425da1f33830e7b51e03 (DEFAULT_TABLE table=default.Table_9ab03dea59b04746968d5f6753b931d6 [id=ec9b64d93dfc44a29aae35e6b02e2fe8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.973114 16371 tablet_replica.cc:333] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:27.973160 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5564705a3771425da1f33830e7b51e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.973253 16371 raft_consensus.cc:2243] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.973345 16371 raft_consensus.cc:2272] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.973639 16371 ts_tablet_manager.cc:1916] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.974556 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 5e605f701a474fff80688533f3a398e7 (table default.Table_e650e0b918954a7f8c97ff7e8e9bcffd [id=dfe9146b50254c54ad1b75080a2ee201]) successfully deleted
I20251025 08:02:27.946578 14957 tablet_service.cc:1505] Processing CreateTablet for tablet f65b1ad4764a4ed3a33baccaf278f043 (DEFAULT_TABLE table=default.Table_b074f35366374acd92bf7528094773a0 [id=afe8a5e6aa824ba69530f71c2b2d4617]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.947157 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 60c49b70f8f44dd3aec433206b897843 (DEFAULT_TABLE table=default.Table_df3848a55c7646b1bd519eb12aa88aa1 [id=5160fad54600448f8b2c5bfc942f60a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.949841 14949 tablet_service.cc:1505] Processing CreateTablet for tablet c2415c51234f482ca295cc71a74e7cab (DEFAULT_TABLE table=default.Table_9f2128ef54374befaec2adc1a1295f27 [id=bc094a879104430797416fd06811a2e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.951349 14951 tablet_service.cc:1505] Processing CreateTablet for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 (DEFAULT_TABLE table=default.Table_4598018e26254b78befa93852241f777 [id=78794c8ceec3479ca3ac3ef55594762f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.975503 14719 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 221f4c5432bc45e18728f5ed1453ad0f
I20251025 08:02:27.965523 16424 tablet.cc:1722] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.976534 14726 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 801d06a391e34bec8e1f74257937f069
I20251025 08:02:27.976753 14726 catalog_manager.cc:6719] ReplaceTablet: tablet 801d06a391e34bec8e1f74257937f069 deleted and replaced by tablet e762c440cb0947deb7e6a4186deebdc1
I20251025 08:02:27.976883 14722 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 4d9cd745bd3e42e98b0ae1d145007bee
W20251025 08:02:27.977294 14723 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0078dd6fb0e34d01a54889326dd6dfd7 consensus state has no leader
I20251025 08:02:27.965982 16415 tablet.cc:1722] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.967207 16370 tablet.cc:1722] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:27.978224 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 221f4c5432bc45e18728f5ed1453ad0f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.978475 14720 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 88efe498fb6f4ce1a02b5389ff6f5797
I20251025 08:02:27.978732 14720 catalog_manager.cc:6719] ReplaceTablet: tablet 88efe498fb6f4ce1a02b5389ff6f5797 deleted and replaced by tablet bd0cb1245acc40ada9a0b0415bc41291
I20251025 08:02:27.978933 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 801d06a391e34bec8e1f74257937f069 with delete_type TABLET_DATA_DELETED (replaced by tablet e762c440cb0947deb7e6a4186deebdc1) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.979385 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 4d9cd745bd3e42e98b0ae1d145007bee with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.979756 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 221f4c5432bc45e18728f5ed1453ad0f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.979959 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet 801d06a391e34bec8e1f74257937f069 with delete_type TABLET_DATA_DELETED (replaced by tablet e762c440cb0947deb7e6a4186deebdc1) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.980163 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 4d9cd745bd3e42e98b0ae1d145007bee with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.980492 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 88efe498fb6f4ce1a02b5389ff6f5797 with delete_type TABLET_DATA_DELETED (replaced by tablet bd0cb1245acc40ada9a0b0415bc41291) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:27.981513 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 88efe498fb6f4ce1a02b5389ff6f5797 with delete_type TABLET_DATA_DELETED (replaced by tablet bd0cb1245acc40ada9a0b0415bc41291) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:27.981662 16364 ts_tablet_manager.cc:1929] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:27.981739 16364 log.cc:1199] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/76a906654cc44bfb96d9e1a936040e57
I20251025 08:02:27.981969 16364 ts_tablet_manager.cc:1950] T 76a906654cc44bfb96d9e1a936040e57 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:27.983767 16392 tablet_bootstrap.cc:492] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:27.983858 16392 ts_tablet_manager.cc:1403] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.358s user 0.002s sys 0.000s
I20251025 08:02:27.984324 16392 raft_consensus.cc:359] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.984438 16392 raft_consensus.cc:385] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.984468 16392 raft_consensus.cc:740] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.984586 16392 consensus_queue.cc:260] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.984846 16392 ts_tablet_manager.cc:1434] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:27.985185 16392 tablet_bootstrap.cc:492] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:27.985282 16391 tablet_bootstrap.cc:492] T e66c7b43490a4391a59e09f1832a53b3 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:27.985360 16391 ts_tablet_manager.cc:1403] T e66c7b43490a4391a59e09f1832a53b3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.224s user 0.001s sys 0.000s
I20251025 08:02:27.985751 16390 tablet_bootstrap.cc:492] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:27.985823 16390 ts_tablet_manager.cc:1403] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.051s user 0.001s sys 0.000s
I20251025 08:02:27.985792 16391 raft_consensus.cc:359] T e66c7b43490a4391a59e09f1832a53b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.985885 16391 raft_consensus.cc:385] T e66c7b43490a4391a59e09f1832a53b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.985919 16391 raft_consensus.cc:740] T e66c7b43490a4391a59e09f1832a53b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.986038 16391 consensus_queue.cc:260] T e66c7b43490a4391a59e09f1832a53b3 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.986140 16392 tablet_bootstrap.cc:654] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.986328 16391 ts_tablet_manager.cc:1434] T e66c7b43490a4391a59e09f1832a53b3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:27.986300 16390 raft_consensus.cc:359] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.986397 16390 raft_consensus.cc:385] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:27.986428 16390 raft_consensus.cc:740] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:27.986500 16391 tablet_bootstrap.cc:492] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:27.986545 16390 consensus_queue.cc:260] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.986796 16390 ts_tablet_manager.cc:1434] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:27.986948 16390 tablet_bootstrap.cc:492] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:27.987425 16391 tablet_bootstrap.cc:654] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.987818 16390 tablet_bootstrap.cc:654] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:27.984678 16364 tablet_replica.cc:333] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:27.990574 14958 tablet_service.cc:1505] Processing CreateTablet for tablet b04e5c106dd7400aa039dbf6666ad3aa (DEFAULT_TABLE table=default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.991153 14959 tablet_service.cc:1505] Processing CreateTablet for tablet b7ff0b4596944f38ae9325a95167c287 (DEFAULT_TABLE table=default.Table_35b83947962a41b7be7d363c364404d4 [id=ea0a64fc70c84a7eb2b7c8e8e4a933fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:27.992471 16364 raft_consensus.cc:2243] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:27.992930 16364 raft_consensus.cc:2272] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:27.995782 15642 raft_consensus.cc:493] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:27.995823 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f65b1ad4764a4ed3a33baccaf278f043. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.995855 15642 raft_consensus.cc:515] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:27.995954 14949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2415c51234f482ca295cc71a74e7cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.996171 15642 leader_election.cc:290] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:27.996542 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c49b70f8f44dd3aec433206b897843. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.997666 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:27.998296 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ebf3a6aca8403fa811202af7e3fe01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:27.998397 15239 raft_consensus.cc:2468] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:27.998667 15049 leader_election.cc:304] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:27.998742 16364 ts_tablet_manager.cc:1916] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:27.998850 15642 raft_consensus.cc:2804] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:27.998906 15642 raft_consensus.cc:493] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:27.998944 15642 raft_consensus.cc:3060] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:27.999100 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ebf3a6aca8403fa811202af7e3fe01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:27.999184 14975 raft_consensus.cc:2468] T 64ebf3a6aca8403fa811202af7e3fe01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:27.999830 15642 raft_consensus.cc:515] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.000159 15642 leader_election.cc:290] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.000922 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ebf3a6aca8403fa811202af7e3fe01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:28.001034 15238 raft_consensus.cc:3060] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.001932 15238 raft_consensus.cc:2468] T 64ebf3a6aca8403fa811202af7e3fe01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:28.002358 15049 leader_election.cc:304] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.002688 15642 raft_consensus.cc:2804] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.002763 15642 raft_consensus.cc:697] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:28.002864 15642 consensus_queue.cc:237] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.003641 16392 tablet_bootstrap.cc:492] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.003708 16392 ts_tablet_manager.cc:1403] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20251025 08:02:28.004107 16392 raft_consensus.cc:359] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.004195 16392 raft_consensus.cc:385] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.004221 16392 raft_consensus.cc:740] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.004349 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 221f4c5432bc45e18728f5ed1453ad0f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.004504 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 76a906654cc44bfb96d9e1a936040e57 (table default.Table_4598018e26254b78befa93852241f777 [id=78794c8ceec3479ca3ac3ef55594762f]) successfully deleted
I20251025 08:02:28.004772 15216 tablet_service.cc:1505] Processing CreateTablet for tablet b04e5c106dd7400aa039dbf6666ad3aa (DEFAULT_TABLE table=default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.004859 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64ebf3a6aca8403fa811202af7e3fe01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:28.004958 14975 raft_consensus.cc:3060] T 64ebf3a6aca8403fa811202af7e3fe01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.005503 15093 tablet_service.cc:1505] Processing CreateTablet for tablet b04e5c106dd7400aa039dbf6666ad3aa (DEFAULT_TABLE table=default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.005574 15082 tablet_service.cc:1505] Processing CreateTablet for tablet b7ff0b4596944f38ae9325a95167c287 (DEFAULT_TABLE table=default.Table_35b83947962a41b7be7d363c364404d4 [id=ea0a64fc70c84a7eb2b7c8e8e4a933fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.005852 14975 raft_consensus.cc:2468] T 64ebf3a6aca8403fa811202af7e3fe01 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:28.006068 16371 ts_tablet_manager.cc:1929] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.006127 16371 log.cc:1199] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/cf90d2e477b9493e9b78aae6a7d2d3e0
I20251025 08:02:28.006392 16371 ts_tablet_manager.cc:1950] T cf90d2e477b9493e9b78aae6a7d2d3e0 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.006930 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet cf90d2e477b9493e9b78aae6a7d2d3e0 (table default.Table_e22e6abaeec0420496616ee334cf07eb [id=b3be7f970bc745f7873e9d54a68e3e50]) successfully deleted
I20251025 08:02:28.007043 16371 tablet_replica.cc:333] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.007149 16371 raft_consensus.cc:2243] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
W20251025 08:02:28.007193 14712 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec because the tablet was not found. No further retry: Not found: Tablet not found: 7ae3f4cdb1b14d1abe884c4a0628a6ec
W20251025 08:02:28.007328 14712 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet e0635cb57c4d4d51bed5897b28cc3dcd because the tablet was not found. No further retry: Not found: Tablet not found: e0635cb57c4d4d51bed5897b28cc3dcd
I20251025 08:02:28.007345 16371 raft_consensus.cc:2272] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.007702 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 143b073e21a4456591fa1f96668118b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.007970 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5564705a3771425da1f33830e7b51e03. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.007954 14726 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_c52dec25e76a4fcea78b5514db2d8dce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.008203 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f65b1ad4764a4ed3a33baccaf278f043. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:28.008328 14726 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c52dec25e76a4fcea78b5514db2d8dce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.008453 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60c49b70f8f44dd3aec433206b897843. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.008713 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2415c51234f482ca295cc71a74e7cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.008994 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.009923 14719 master_service.cc:954] ReplaceTablet: received request to replace tablet 422e2c32a18a4e1ea9a5e371da17dfea from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.004801 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet 801d06a391e34bec8e1f74257937f069 with delete_type TABLET_DATA_DELETED (replaced by tablet e762c440cb0947deb7e6a4186deebdc1) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.011209 15384 raft_consensus.cc:493] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.011281 15384 raft_consensus.cc:515] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.004835 15217 tablet_service.cc:1552] Processing DeleteTablet for tablet 4d9cd745bd3e42e98b0ae1d145007bee with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.004940 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 (DEFAULT_TABLE table=default.Table_4598018e26254b78befa93852241f777 [id=78794c8ceec3479ca3ac3ef55594762f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.011600 15384 leader_election.cc:290] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.004969 15222 tablet_service.cc:1505] Processing CreateTablet for tablet b7ff0b4596944f38ae9325a95167c287 (DEFAULT_TABLE table=default.Table_35b83947962a41b7be7d363c364404d4 [id=ea0a64fc70c84a7eb2b7c8e8e4a933fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.004989 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 88efe498fb6f4ce1a02b5389ff6f5797 with delete_type TABLET_DATA_DELETED (replaced by tablet bd0cb1245acc40ada9a0b0415bc41291) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.005009 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b04e5c106dd7400aa039dbf6666ad3aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.012059 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b04e5c106dd7400aa039dbf6666ad3aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.004776 16390 tablet_bootstrap.cc:492] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.012207 16390 ts_tablet_manager.cc:1403] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20251025 08:02:28.012598 16390 raft_consensus.cc:359] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.012681 16390 raft_consensus.cc:385] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.012706 16390 raft_consensus.cc:740] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.012809 16390 consensus_queue.cc:260] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.013120 16390 ts_tablet_manager.cc:1434] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:28.013339 16390 tablet_bootstrap.cc:492] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.013927 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.013998 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ff0b4596944f38ae9325a95167c287. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.014335 16390 tablet_bootstrap.cc:654] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.015877 14718 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_2d1acf2ab32844f2a253a5d5ab46d842" } modify_external_catalogs: true
I20251025 08:02:28.015969 14718 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_2d1acf2ab32844f2a253a5d5ab46d842" } modify_external_catalogs: true
I20251025 08:02:28.017189 16391 tablet_bootstrap.cc:492] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:28.017213 14721 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_0db7fc431dff4c7f85007159dd715e19" } modify_external_catalogs: true
I20251025 08:02:28.017263 16391 ts_tablet_manager.cc:1403] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.031s user 0.001s sys 0.000s
I20251025 08:02:28.017306 14721 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_0db7fc431dff4c7f85007159dd715e19" } modify_external_catalogs: true
I20251025 08:02:28.017700 16391 raft_consensus.cc:359] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.017784 16391 raft_consensus.cc:385] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.017815 16391 raft_consensus.cc:740] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.017917 16391 consensus_queue.cc:260] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.017972 14727 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_7b738fa61be04903bdb5b03ee75099a0" } new_table_name: "default.Table_200a2632d13848d3b5877ca9f7cb8daa" modify_external_catalogs: true
I20251025 08:02:28.004312 16392 consensus_queue.cc:260] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.018234 16391 ts_tablet_manager.cc:1434] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.018467 16392 ts_tablet_manager.cc:1434] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:28.018648 16392 tablet_bootstrap.cc:492] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.018962 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ff0b4596944f38ae9325a95167c287. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.019562 16392 tablet_bootstrap.cc:654] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.020503 16392 tablet_bootstrap.cc:492] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.020599 16392 ts_tablet_manager.cc:1403] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:28.021255 16199 raft_consensus.cc:493] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.021323 16199 raft_consensus.cc:515] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.021587 16199 leader_election.cc:290] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.021658 16199 raft_consensus.cc:493] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.021713 16199 raft_consensus.cc:515] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.022004 16199 leader_election.cc:290] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.022275 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7711a974f4a84d639f1c3077da9d855f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.023197 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3faddc4af6ef4019be369ceb023cbc9d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.023301 15111 raft_consensus.cc:2468] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:28.023268 16392 raft_consensus.cc:359] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.023406 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3faddc4af6ef4019be369ceb023cbc9d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.023357 16392 raft_consensus.cc:385] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.023499 16392 raft_consensus.cc:740] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.023694 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7711a974f4a84d639f1c3077da9d855f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.023792 14975 raft_consensus.cc:2468] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:28.023681 16392 consensus_queue.cc:260] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:28.023834 15183 leader_election.cc:343] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.023988 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a25116c3ecda411bb480cc47a3ca6bf5" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.024044 15183 leader_election.cc:304] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.024181 16199 raft_consensus.cc:2804] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.024245 16199 raft_consensus.cc:493] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251025 08:02:28.024282 15183 leader_election.cc:343] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.024292 16199 raft_consensus.cc:3060] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:28.024612 15185 leader_election.cc:343] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.024745 16392 ts_tablet_manager.cc:1434] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:28.024796 15185 leader_election.cc:304] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:28.024904 16392 tablet_bootstrap.cc:492] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.025148 15384 raft_consensus.cc:2804] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.025202 15384 raft_consensus.cc:493] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.025249 15384 raft_consensus.cc:3060] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.025379 16199 raft_consensus.cc:515] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.025521 14723 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_0a6ff7ae05a040c3be53115abe29f5ce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.025657 16199 leader_election.cc:290] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
W20251025 08:02:28.025820 14723 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a6ff7ae05a040c3be53115abe29f5ce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.025890 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a25116c3ecda411bb480cc47a3ca6bf5" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.025988 16392 tablet_bootstrap.cc:654] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.026082 15384 raft_consensus.cc:515] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.026427 15384 leader_election.cc:290] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.026536 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7711a974f4a84d639f1c3077da9d855f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:28.026645 14979 raft_consensus.cc:3060] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.026741 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3faddc4af6ef4019be369ceb023cbc9d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:28.026914 16424 tablet.cc:1722] T b3fdc5bd4c7f4506a150f31137e8b091 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:28.027225 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_154bf3fb109a4052a26aed5719b8cd1d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.027431 14979 raft_consensus.cc:2468] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:28.027456 16372 ts_tablet_manager.cc:1929] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.027510 16372 log.cc:1199] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/3bf26408c98e49298ff9c738a1e26cf9
W20251025 08:02:28.027537 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_154bf3fb109a4052a26aed5719b8cd1d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.027750 16372 ts_tablet_manager.cc:1950] T 3bf26408c98e49298ff9c738a1e26cf9 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
W20251025 08:02:28.028090 15185 leader_election.cc:343] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.028164 15185 leader_election.cc:304] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.028281 15384 raft_consensus.cc:2749] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.028133 16372 tablet_replica.cc:333] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.028559 16372 raft_consensus.cc:2243] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.028795 16372 raft_consensus.cc:2272] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:28.029249 15183 leader_election.cc:343] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.029356 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3faddc4af6ef4019be369ceb023cbc9d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:28.029402 15183 leader_election.cc:304] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.029450 15112 raft_consensus.cc:3060] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.029628 15384 raft_consensus.cc:2804] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.029703 15384 raft_consensus.cc:697] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:28.029808 15384 consensus_queue.cc:237] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.030296 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7711a974f4a84d639f1c3077da9d855f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:28.030673 16392 tablet_bootstrap.cc:492] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.030756 16392 ts_tablet_manager.cc:1403] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20251025 08:02:28.030824 14725 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_c3c319cac2594db28f07c7266a5405ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.031139 14725 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c3c319cac2594db28f07c7266a5405ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.031196 16392 raft_consensus.cc:359] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.031291 16392 raft_consensus.cc:385] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.031322 16392 raft_consensus.cc:740] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.031406 16392 consensus_queue.cc:260] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.031448 14726 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_bf30187847774d5891dcdc95939db83b" } new_table_name: "default.Table_c1e77003b0f5470681f7ae92a0e7a320" modify_external_catalogs: true
I20251025 08:02:28.031668 16392 ts_tablet_manager.cc:1434] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:28.031809 16392 tablet_bootstrap.cc:492] T 53f89ab2ef9b4136812cb4a320a645a6 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.032157 14718 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 90bb43eb01c949b09f7a4c703a99dc7e
I20251025 08:02:28.032508 14718 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_4b7b9ad86d85404785a42b98239e38cc" } new_table_name: "default.Table_d4d0cf0460ca4188bf5e9e502111012c" modify_external_catalogs: true
I20251025 08:02:28.032685 16392 tablet_bootstrap.cc:654] T 53f89ab2ef9b4136812cb4a320a645a6 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.030659 15112 raft_consensus.cc:2468] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:28.033675 14719 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 422e2c32a18a4e1ea9a5e371da17dfea
I20251025 08:02:28.033921 14719 catalog_manager.cc:6719] ReplaceTablet: tablet 422e2c32a18a4e1ea9a5e371da17dfea deleted and replaced by tablet bfdc6022cc5747439edcb8aa865b9437
I20251025 08:02:28.034257 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 90bb43eb01c949b09f7a4c703a99dc7e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
W20251025 08:02:28.034521 15185 leader_election.cc:343] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.034684 15185 leader_election.cc:304] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:28.034833 15909 raft_consensus.cc:2804] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.034924 15909 raft_consensus.cc:697] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:28.035046 15909 consensus_queue.cc:237] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.035683 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b04e5c106dd7400aa039dbf6666ad3aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.036036 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7ff0b4596944f38ae9325a95167c287. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.039546 16364 ts_tablet_manager.cc:1929] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.039646 16364 log.cc:1199] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/4f3163f8a4ff49069d55b9acf8a4c19a
I20251025 08:02:28.039705 14719 master_service.cc:954] ReplaceTablet: received request to replace tablet 3faddc4af6ef4019be369ceb023cbc9d from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.035058 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 422e2c32a18a4e1ea9a5e371da17dfea with delete_type TABLET_DATA_DELETED (replaced by tablet bfdc6022cc5747439edcb8aa865b9437) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.039893 16364 ts_tablet_manager.cc:1950] T 4f3163f8a4ff49069d55b9acf8a4c19a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.040467 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 4f3163f8a4ff49069d55b9acf8a4c19a (table default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064]) successfully deleted
I20251025 08:02:28.040582 16364 tablet_replica.cc:333] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.040704 16364 raft_consensus.cc:2243] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
W20251025 08:02:28.040782 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 40f70d2139534907ab929dae893c740d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40f70d2139534907ab929dae893c740d already in progress: creating tablet
I20251025 08:02:28.040863 16364 raft_consensus.cc:2272] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.041198 16364 ts_tablet_manager.cc:1916] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.042724 16371 ts_tablet_manager.cc:1916] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.043710 16391 tablet_bootstrap.cc:492] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:28.044629 16391 tablet_bootstrap.cc:654] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.046087 16391 tablet_bootstrap.cc:492] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:28.044039 16372 ts_tablet_manager.cc:1916] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.046414 16391 ts_tablet_manager.cc:1403] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:28.046842 16391 raft_consensus.cc:359] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.046940 16391 raft_consensus.cc:385] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.046969 16391 raft_consensus.cc:740] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.047106 16391 consensus_queue.cc:260] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.047811 16391 ts_tablet_manager.cc:1434] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.047996 16391 tablet_bootstrap.cc:492] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:28.048156 16372 ts_tablet_manager.cc:1929] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.048681 16390 tablet_bootstrap.cc:492] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.048760 16390 ts_tablet_manager.cc:1403] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.001s
I20251025 08:02:28.049180 16390 raft_consensus.cc:359] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.049248 16391 tablet_bootstrap.cc:654] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.049280 16390 raft_consensus.cc:385] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.049316 16390 raft_consensus.cc:740] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.049420 16390 consensus_queue.cc:260] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.049690 16390 ts_tablet_manager.cc:1434] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:28.049847 16390 tablet_bootstrap.cc:492] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.050786 16390 tablet_bootstrap.cc:654] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.052522 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 3bf26408c98e49298ff9c738a1e26cf9 (table default.Table_fc9c7434bd43470c9134da3d60417d99 [id=3885b65c034f43aea6b6dffaba7c32ae]) successfully deleted
I20251025 08:02:28.053433 16371 ts_tablet_manager.cc:1929] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.056708 15864 raft_consensus.cc:493] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.059104 15864 raft_consensus.cc:515] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.059489 15864 leader_election.cc:290] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:28.056903 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 90bb43eb01c949b09f7a4c703a99dc7e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.059721 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a940a0698d64770bf5826d9290117b4" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.059801 16371 log.cc:1199] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/f89313f3d7344132b2fb0fab8941bb3e
I20251025 08:02:28.059862 15238 raft_consensus.cc:2468] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:28.060056 16371 ts_tablet_manager.cc:1950] T f89313f3d7344132b2fb0fab8941bb3e P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.057632 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 422e2c32a18a4e1ea9a5e371da17dfea with delete_type TABLET_DATA_DELETED (replaced by tablet bfdc6022cc5747439edcb8aa865b9437) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.060156 14914 leader_election.cc:304] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.060343 15864 raft_consensus.cc:2804] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.060389 15864 raft_consensus.cc:493] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.060426 15864 raft_consensus.cc:3060] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.060585 16371 tablet_replica.cc:333] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.060695 16371 raft_consensus.cc:2243] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.060784 16371 raft_consensus.cc:2272] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.060887 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet f89313f3d7344132b2fb0fab8941bb3e (table default.Table_07dd75378eaf438d89036c48a5545591 [id=e9aa7fb3b0d74da781257782a24b37fe]) successfully deleted
I20251025 08:02:28.061092 16371 ts_tablet_manager.cc:1916] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.061275 15864 raft_consensus.cc:515] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.061592 15864 leader_election.cc:290] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:28.062129 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a940a0698d64770bf5826d9290117b4" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:28.062278 15238 raft_consensus.cc:3060] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.062808 14721 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 2a0a2af3ed1f41fea41962db52cfe7d8
I20251025 08:02:28.062927 16371 ts_tablet_manager.cc:1929] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.062990 16371 log.cc:1199] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/cf5008728a6241c096c9a76f8e374ceb
I20251025 08:02:28.063153 14721 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_670e2c0d014c4003af93e44a18490fda" } modify_external_catalogs: true
I20251025 08:02:28.063225 15238 raft_consensus.cc:2468] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:28.063251 16371 ts_tablet_manager.cc:1950] T cf5008728a6241c096c9a76f8e374ceb P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.063243 14721 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_670e2c0d014c4003af93e44a18490fda" } modify_external_catalogs: true
I20251025 08:02:28.063709 16371 tablet_replica.cc:333] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.063814 16371 raft_consensus.cc:2243] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.063906 16371 raft_consensus.cc:2272] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:28.064020 14727 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3f5cff308fc9448db40b0d4df03c69bb has no consensus state
I20251025 08:02:28.064136 16364 ts_tablet_manager.cc:1929] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.064201 16364 log.cc:1199] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/cf90d2e477b9493e9b78aae6a7d2d3e0
I20251025 08:02:28.064220 16371 ts_tablet_manager.cc:1916] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.064440 16364 ts_tablet_manager.cc:1950] T cf90d2e477b9493e9b78aae6a7d2d3e0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.065194 14914 leader_election.cc:304] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.065302 16364 tablet_replica.cc:333] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.065407 16364 raft_consensus.cc:2243] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.065503 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet cf90d2e477b9493e9b78aae6a7d2d3e0 (table default.Table_e22e6abaeec0420496616ee334cf07eb [id=b3be7f970bc745f7873e9d54a68e3e50]) successfully deleted
I20251025 08:02:28.065693 15864 raft_consensus.cc:2804] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.065768 15864 raft_consensus.cc:697] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:28.065878 15864 consensus_queue.cc:237] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.065966 16364 raft_consensus.cc:2272] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.065995 16371 ts_tablet_manager.cc:1929] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.065462 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 2a0a2af3ed1f41fea41962db52cfe7d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.066047 16371 log.cc:1199] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/0310efe286dd409ab857a92daa6ff99f
I20251025 08:02:28.065825 16390 tablet_bootstrap.cc:492] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.066124 16390 ts_tablet_manager.cc:1403] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20251025 08:02:28.052240 15087 tablet_service.cc:1552] Processing DeleteTablet for tablet 90bb43eb01c949b09f7a4c703a99dc7e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.052532 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 422e2c32a18a4e1ea9a5e371da17dfea with delete_type TABLET_DATA_DELETED (replaced by tablet bfdc6022cc5747439edcb8aa865b9437) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.059734 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a940a0698d64770bf5826d9290117b4" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.066373 15112 raft_consensus.cc:2468] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:28.062140 15642 raft_consensus.cc:493] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.066514 16372 log.cc:1199] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/4f3163f8a4ff49069d55b9acf8a4c19a
I20251025 08:02:28.066552 15642 raft_consensus.cc:515] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.066756 16372 ts_tablet_manager.cc:1950] T 4f3163f8a4ff49069d55b9acf8a4c19a P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.066779 16390 raft_consensus.cc:359] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.066869 16390 raft_consensus.cc:385] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.066905 16390 raft_consensus.cc:740] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.066895 15642 leader_election.cc:290] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.063429 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5a940a0698d64770bf5826d9290117b4" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:28.067003 15111 raft_consensus.cc:3060] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.067025 16390 consensus_queue.cc:260] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.067301 16390 ts_tablet_manager.cc:1434] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:28.067600 16390 tablet_bootstrap.cc:492] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
W20251025 08:02:28.067939 14726 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 090117a75882489d84687e41b50616e9 has no consensus state
I20251025 08:02:28.067924 15111 raft_consensus.cc:2468] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:28.068503 16390 tablet_bootstrap.cc:654] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.067600 16364 ts_tablet_manager.cc:1916] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.069902 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e66c7b43490a4391a59e09f1832a53b3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.070029 15238 raft_consensus.cc:2468] T e66c7b43490a4391a59e09f1832a53b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:28.070919 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 2a0a2af3ed1f41fea41962db52cfe7d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.072211 15049 leader_election.cc:304] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.072484 15642 raft_consensus.cc:2804] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.072533 15642 raft_consensus.cc:493] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.072574 15642 raft_consensus.cc:3060] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.073062 16372 tablet_replica.cc:333] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.073204 16372 raft_consensus.cc:2243] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.073302 16372 raft_consensus.cc:2272] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.073454 15642 raft_consensus.cc:515] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.073757 15642 leader_election.cc:290] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.074410 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e66c7b43490a4391a59e09f1832a53b3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:28.074501 15238 raft_consensus.cc:3060] T e66c7b43490a4391a59e09f1832a53b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.075278 15238 raft_consensus.cc:2468] T e66c7b43490a4391a59e09f1832a53b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:28.075682 16463 tablet.cc:1722] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:28.075722 15049 leader_election.cc:304] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.076647 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet cf5008728a6241c096c9a76f8e374ceb (table default.Table_3231d801b62849a8a125cbe1d6fe9482 [id=025400eac2f746d7afc76aa78cd49c0b]) successfully deleted
I20251025 08:02:28.077580 14721 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet bd0cb1245acc40ada9a0b0415bc41291
I20251025 08:02:28.078457 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 4f3163f8a4ff49069d55b9acf8a4c19a (table default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064]) successfully deleted
I20251025 08:02:28.078485 16425 tablet.cc:1722] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:28.078987 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 2a0a2af3ed1f41fea41962db52cfe7d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.079398 16415 tablet.cc:1722] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:28.080641 15642 raft_consensus.cc:2804] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.080719 15642 raft_consensus.cc:697] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:28.080821 15642 consensus_queue.cc:237] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.083994 16372 ts_tablet_manager.cc:1916] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.086551 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e66c7b43490a4391a59e09f1832a53b3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.086670 14975 raft_consensus.cc:2468] T e66c7b43490a4391a59e09f1832a53b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:28.086858 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e66c7b43490a4391a59e09f1832a53b3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:28.086928 14975 raft_consensus.cc:3060] T e66c7b43490a4391a59e09f1832a53b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.087738 14975 raft_consensus.cc:2468] T e66c7b43490a4391a59e09f1832a53b3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:28.088145 14721 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_4e8f86466ebb45b787d179ddb83d55b9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.088516 14721 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4e8f86466ebb45b787d179ddb83d55b9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:28.088295 15048 consensus_peers.cc:597] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf90d2e477b9493e9b78aae6a7d2d3e0. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.091274 16372 ts_tablet_manager.cc:1929] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.091581 16364 ts_tablet_manager.cc:1929] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.091698 16364 log.cc:1199] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/f585455b77df49738b44c31a3d7adb71
I20251025 08:02:28.092005 16364 ts_tablet_manager.cc:1950] T f585455b77df49738b44c31a3d7adb71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.092499 16364 tablet_replica.cc:333] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.092585 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet f585455b77df49738b44c31a3d7adb71 (table default.Table_d9d4e09b4b4f4014847e00428c183725 [id=37373d664cc54e57bed0f09a7c12c8e4]) successfully deleted
I20251025 08:02:28.093336 16371 ts_tablet_manager.cc:1950] T 0310efe286dd409ab857a92daa6ff99f P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.093883 16371 tablet_replica.cc:333] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.094010 16371 raft_consensus.cc:2243] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.094213 16371 raft_consensus.cc:2272] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.094331 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 0310efe286dd409ab857a92daa6ff99f (table default.Table_fc8b1dd5aa12482895416350908e36fd [id=eaba715cb2c74aca915cf7d374ee17a7]) successfully deleted
I20251025 08:02:28.094565 16372 log.cc:1199] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/76a906654cc44bfb96d9e1a936040e57
I20251025 08:02:28.094570 16371 ts_tablet_manager.cc:1916] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.094871 16372 ts_tablet_manager.cc:1950] T 76a906654cc44bfb96d9e1a936040e57 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.095324 16364 raft_consensus.cc:2243] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.095706 16391 tablet_bootstrap.cc:492] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:28.095820 16391 ts_tablet_manager.cc:1403] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.000s
I20251025 08:02:28.096266 16391 raft_consensus.cc:359] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.096400 16391 raft_consensus.cc:385] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.096462 16391 raft_consensus.cc:740] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.096719 16391 consensus_queue.cc:260] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.096858 16413 raft_consensus.cc:493] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.096910 16413 raft_consensus.cc:515] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.097191 16413 leader_election.cc:290] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:28.099781 16391 ts_tablet_manager.cc:1434] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:28.100010 16391 tablet_bootstrap.cc:492] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:28.100013 14721 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_62b5b73c7fc44e9b990b9b71b7e98d0b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.100354 14721 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62b5b73c7fc44e9b990b9b71b7e98d0b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.100376 14726 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_329a467cbe4b499c90505c8fd924ddc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.100701 14726 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_329a467cbe4b499c90505c8fd924ddc8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.101078 14718 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_59553db1e7714c3b8a827e02fa059e1e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.101150 16391 tablet_bootstrap.cc:654] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:28.101343 14718 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59553db1e7714c3b8a827e02fa059e1e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.098213 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4f92b0605754327883b144fb6c96aea" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.102803 15238 raft_consensus.cc:2468] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:28.103135 14914 leader_election.cc:304] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.103309 15864 raft_consensus.cc:2804] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.103366 15864 raft_consensus.cc:493] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.103405 15864 raft_consensus.cc:3060] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.104076 16364 raft_consensus.cc:2272] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.104283 15864 raft_consensus.cc:515] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.104390 16364 ts_tablet_manager.cc:1916] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.104606 15864 leader_election.cc:290] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:28.105018 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4f92b0605754327883b144fb6c96aea" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:28.105098 15238 raft_consensus.cc:3060] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.105858 15238 raft_consensus.cc:2468] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:28.106127 14914 leader_election.cc:304] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.106376 15864 raft_consensus.cc:2804] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.106468 15864 raft_consensus.cc:697] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:28.106570 15864 consensus_queue.cc:237] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.106389 16391 tablet_bootstrap.cc:492] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:28.107733 16391 ts_tablet_manager.cc:1403] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251025 08:02:28.097623 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4f92b0605754327883b144fb6c96aea" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.098030 16392 tablet_bootstrap.cc:492] T 53f89ab2ef9b4136812cb4a320a645a6 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.108059 16392 ts_tablet_manager.cc:1403] T 53f89ab2ef9b4136812cb4a320a645a6 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.076s user 0.000s sys 0.002s
I20251025 08:02:28.108424 16392 raft_consensus.cc:359] T 53f89ab2ef9b4136812cb4a320a645a6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.108506 16392 raft_consensus.cc:385] T 53f89ab2ef9b4136812cb4a320a645a6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.108534 16392 raft_consensus.cc:740] T 53f89ab2ef9b4136812cb4a320a645a6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
W20251025 08:02:28.108105 14915 leader_election.cc:343] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.108631 16392 consensus_queue.cc:260] T 53f89ab2ef9b4136812cb4a320a645a6 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.108860 16392 ts_tablet_manager.cc:1434] T 53f89ab2ef9b4136812cb4a320a645a6 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:28.109019 16392 tablet_bootstrap.cc:492] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.109747 16392 tablet_bootstrap.cc:654] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.104707 15380 raft_consensus.cc:493] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.105780 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e4f92b0605754327883b144fb6c96aea" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:28.110531 15380 raft_consensus.cc:515] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.110863 15380 leader_election.cc:290] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.111243 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93779f31ade9494f9056cc15665efb0d" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:28.111788 15049 leader_election.cc:343] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:28.112196 14915 leader_election.cc:343] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.112660 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93779f31ade9494f9056cc15665efb0d" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:28.113734 15048 leader_election.cc:343] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.113840 15048 leader_election.cc:304] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:28.114161 15642 raft_consensus.cc:2749] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.114292 16199 raft_consensus.cc:493] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.114393 16199 raft_consensus.cc:515] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.114729 16199 leader_election.cc:290] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.114749 16392 tablet_bootstrap.cc:492] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.114812 16392 ts_tablet_manager.cc:1403] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251025 08:02:28.114914 16371 ts_tablet_manager.cc:1929] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.114967 16371 log.cc:1199] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/77365d99094541b2a5f7b8bb3bc18739
I20251025 08:02:28.115182 16371 ts_tablet_manager.cc:1950] T 77365d99094541b2a5f7b8bb3bc18739 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.115212 16392 raft_consensus.cc:359] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.115311 16392 raft_consensus.cc:385] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.115340 16392 raft_consensus.cc:740] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.115454 16392 consensus_queue.cc:260] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.115604 16371 tablet_replica.cc:333] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.115680 16392 ts_tablet_manager.cc:1434] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.115716 16371 raft_consensus.cc:2243] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.115813 16371 raft_consensus.cc:2272] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.115831 16392 tablet_bootstrap.cc:492] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.115921 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1bd788e8b38b401a89cbc250b3695088" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.116137 16371 ts_tablet_manager.cc:1916] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:28.116186 15185 leader_election.cc:343] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.116598 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1bd788e8b38b401a89cbc250b3695088" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.116724 14975 raft_consensus.cc:2468] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:28.116986 15183 leader_election.cc:304] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.117241 16199 raft_consensus.cc:2804] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.117305 16199 raft_consensus.cc:493] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.117350 16199 raft_consensus.cc:3060] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.117842 16371 ts_tablet_manager.cc:1929] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.117884 16392 tablet_bootstrap.cc:654] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.117908 16371 log.cc:1199] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/74d87666abb643899a7b1e576e6cc840
I20251025 08:02:28.118150 16371 ts_tablet_manager.cc:1950] T 74d87666abb643899a7b1e576e6cc840 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.118275 16199 raft_consensus.cc:515] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.118413 16372 tablet_replica.cc:333] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.118520 16372 raft_consensus.cc:2243] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.118619 16372 raft_consensus.cc:2272] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.118618 16199 leader_election.cc:290] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.118950 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1bd788e8b38b401a89cbc250b3695088" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:28.119174 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1bd788e8b38b401a89cbc250b3695088" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:28.119252 14975 raft_consensus.cc:3060] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:28.119333 15185 leader_election.cc:343] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.119961 14975 raft_consensus.cc:2468] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:28.120189 15183 leader_election.cc:304] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.120337 16199 raft_consensus.cc:2804] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.120409 16199 raft_consensus.cc:697] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:28.120507 16199 consensus_queue.cc:237] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.120908 16391 raft_consensus.cc:359] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.120985 16391 raft_consensus.cc:385] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.121011 16391 raft_consensus.cc:740] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.121135 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 76a906654cc44bfb96d9e1a936040e57 (table default.Table_4598018e26254b78befa93852241f777 [id=78794c8ceec3479ca3ac3ef55594762f]) successfully deleted
W20251025 08:02:28.121263 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 40f70d2139534907ab929dae893c740d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 40f70d2139534907ab929dae893c740d already in progress: creating tablet
I20251025 08:02:28.121390 16391 consensus_queue.cc:260] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.121697 16391 ts_tablet_manager.cc:1434] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20251025 08:02:28.123260 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 77365d99094541b2a5f7b8bb3bc18739 (table default.Table_129b50f9cb4f415382a1aa57c3f53670 [id=10953f82daf547f1a012597278f4770c]) successfully deleted
I20251025 08:02:28.124558 16372 ts_tablet_manager.cc:1916] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.129766 16391 tablet_bootstrap.cc:492] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:28.130575 16372 ts_tablet_manager.cc:1929] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.131007 16390 tablet_bootstrap.cc:492] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.131078 16390 ts_tablet_manager.cc:1403] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.000s
I20251025 08:02:28.131110 14726 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_2e26e9814f71438c825c74fa33301a37"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.131374 14718 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_5fe5289f69bd4a458aced0607d8247fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.131471 14726 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2e26e9814f71438c825c74fa33301a37 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.131443 16390 raft_consensus.cc:359] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.131516 16390 raft_consensus.cc:385] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.131541 16390 raft_consensus.cc:740] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
W20251025 08:02:28.131651 14718 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5fe5289f69bd4a458aced0607d8247fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.131641 16390 consensus_queue.cc:260] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.131865 16390 ts_tablet_manager.cc:1434] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.132018 16390 tablet_bootstrap.cc:492] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.132879 16390 tablet_bootstrap.cc:654] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.132923 16391 tablet_bootstrap.cc:654] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.133363 15384 raft_consensus.cc:493] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.133424 15384 raft_consensus.cc:515] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.133700 15384 leader_election.cc:290] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.134207 16371 tablet_replica.cc:333] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.134330 16371 raft_consensus.cc:2243] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.134420 16371 raft_consensus.cc:2272] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.136356 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 74d87666abb643899a7b1e576e6cc840 (table default.Table_521f904aba4a4b309e9864df54df659d [id=a95abf5644c64177afde71baad186bca]) successfully deleted
I20251025 08:02:28.137254 14722 catalog_manager.cc:5649] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:28.137410 14724 catalog_manager.cc:5649] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:28.138585 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d7c262b73904f1f87188718617e38a8" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:28.138844 15183 leader_election.cc:343] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.139824 15222 tablet_service.cc:1505] Processing CreateTablet for tablet 54de7e83e8ea42ef93218b0204c61ec6 (DEFAULT_TABLE table=default.Table_a6bf9c572cb3485f9ecced6d0d55877d [id=26a6f00041d04924b3e8eb2b279b55de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.140066 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54de7e83e8ea42ef93218b0204c61ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.140367 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 090117a75882489d84687e41b50616e9 (DEFAULT_TABLE table=default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.140547 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090117a75882489d84687e41b50616e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.142904 14720 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_4598018e26254b78befa93852241f777" } new_table_name: "default.Table_bb8443c590c54dea9dd2e448f2380697" modify_external_catalogs: true
I20251025 08:02:28.145026 16364 ts_tablet_manager.cc:1929] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.146991 16371 ts_tablet_manager.cc:1916] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.147281 16364 log.cc:1199] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/f89313f3d7344132b2fb0fab8941bb3e
I20251025 08:02:28.147534 16364 ts_tablet_manager.cc:1950] T f89313f3d7344132b2fb0fab8941bb3e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.148005 16364 tablet_replica.cc:333] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.148128 16364 raft_consensus.cc:2243] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.148229 16364 raft_consensus.cc:2272] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.148545 16364 ts_tablet_manager.cc:1916] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.149611 14719 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 3faddc4af6ef4019be369ceb023cbc9d
I20251025 08:02:28.149824 14719 catalog_manager.cc:6719] ReplaceTablet: tablet 3faddc4af6ef4019be369ceb023cbc9d deleted and replaced by tablet 31c9e3906dac487e8585daa13d3fe4b1
I20251025 08:02:28.133999 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d7c262b73904f1f87188718617e38a8" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.144297 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 54de7e83e8ea42ef93218b0204c61ec6 (DEFAULT_TABLE table=default.Table_a6bf9c572cb3485f9ecced6d0d55877d [id=26a6f00041d04924b3e8eb2b279b55de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.150308 15384 raft_consensus.cc:493] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.150383 15384 raft_consensus.cc:515] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.150439 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 3faddc4af6ef4019be369ceb023cbc9d with delete_type TABLET_DATA_DELETED (replaced by tablet 31c9e3906dac487e8585daa13d3fe4b1) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.150502 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54de7e83e8ea42ef93218b0204c61ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.150686 15384 leader_election.cc:290] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
W20251025 08:02:28.151340 15185 leader_election.cc:343] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.151398 15185 leader_election.cc:304] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.151654 15909 raft_consensus.cc:2749] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.144541 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 090117a75882489d84687e41b50616e9 (DEFAULT_TABLE table=default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.152568 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090117a75882489d84687e41b50616e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.153216 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet f89313f3d7344132b2fb0fab8941bb3e (table default.Table_07dd75378eaf438d89036c48a5545591 [id=e9aa7fb3b0d74da781257782a24b37fe]) successfully deleted
I20251025 08:02:28.154016 15218 tablet_service.cc:1505] Processing CreateTablet for tablet b41e092b7f40410a979bcfd5bbc7c225 (DEFAULT_TABLE table=default.Table_e9a56ee98afd4b14bb77f82f256e8379 [id=7769118047914c3eb51e98a441aa5c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.147009 15094 tablet_service.cc:1505] Processing CreateTablet for tablet b41e092b7f40410a979bcfd5bbc7c225 (DEFAULT_TABLE table=default.Table_e9a56ee98afd4b14bb77f82f256e8379 [id=7769118047914c3eb51e98a441aa5c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.154644 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b41e092b7f40410a979bcfd5bbc7c225. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.155197 14726 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 1d7c262b73904f1f87188718617e38a8 (table default.Table_dab6241c02794509a694715ad8cfd171 [id=6739c1319b784c8eb66fc75125f83056]). Expected version 4 got 0
I20251025 08:02:28.155323 14726 catalog_manager.cc:5649] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:28.155620 14726 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 0078dd6fb0e34d01a54889326dd6dfd7 (table default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b]). Expected version 1 got 0
I20251025 08:02:28.156308 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53f89ab2ef9b4136812cb4a320a645a6" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.156416 15112 raft_consensus.cc:2468] T 53f89ab2ef9b4136812cb4a320a645a6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:28.156533 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 3faddc4af6ef4019be369ceb023cbc9d with delete_type TABLET_DATA_DELETED (replaced by tablet 31c9e3906dac487e8585daa13d3fe4b1) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.156571 16372 log.cc:1199] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/f08d0c3446dd4a478f81688a3259bb91
I20251025 08:02:28.156678 15185 leader_election.cc:304] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.156816 15384 raft_consensus.cc:2804] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.156838 16372 ts_tablet_manager.cc:1950] T f08d0c3446dd4a478f81688a3259bb91 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.156868 15384 raft_consensus.cc:493] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.156919 15384 raft_consensus.cc:3060] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.157400 16372 tablet_replica.cc:333] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.157531 16372 raft_consensus.cc:2243] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.157704 16372 raft_consensus.cc:2272] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.157773 15384 raft_consensus.cc:515] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.158043 16372 ts_tablet_manager.cc:1916] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.158056 15384 leader_election.cc:290] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.158599 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53f89ab2ef9b4136812cb4a320a645a6" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:28.158689 15112 raft_consensus.cc:3060] T 53f89ab2ef9b4136812cb4a320a645a6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.152204 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 54de7e83e8ea42ef93218b0204c61ec6 (DEFAULT_TABLE table=default.Table_a6bf9c572cb3485f9ecced6d0d55877d [id=26a6f00041d04924b3e8eb2b279b55de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.159389 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53f89ab2ef9b4136812cb4a320a645a6" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:28.152429 14951 tablet_service.cc:1505] Processing CreateTablet for tablet b41e092b7f40410a979bcfd5bbc7c225 (DEFAULT_TABLE table=default.Table_e9a56ee98afd4b14bb77f82f256e8379 [id=7769118047914c3eb51e98a441aa5c50]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.152541 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 3faddc4af6ef4019be369ceb023cbc9d with delete_type TABLET_DATA_DELETED (replaced by tablet 31c9e3906dac487e8585daa13d3fe4b1) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.159579 15112 raft_consensus.cc:2468] T 53f89ab2ef9b4136812cb4a320a645a6 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:28.154276 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "53f89ab2ef9b4136812cb4a320a645a6" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:28.159672 15183 leader_election.cc:343] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.154424 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 090117a75882489d84687e41b50616e9 (DEFAULT_TABLE table=default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.159955 15185 leader_election.cc:304] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
W20251025 08:02:28.160176 15183 leader_election.cc:343] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.160267 16390 tablet_bootstrap.cc:492] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.160339 16390 ts_tablet_manager.cc:1403] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20251025 08:02:28.160465 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54de7e83e8ea42ef93218b0204c61ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.160789 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b41e092b7f40410a979bcfd5bbc7c225. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.160796 16390 raft_consensus.cc:359] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.160898 16390 raft_consensus.cc:385] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.160929 16390 raft_consensus.cc:740] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.161051 16390 consensus_queue.cc:260] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.161103 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 090117a75882489d84687e41b50616e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.161310 16390 ts_tablet_manager.cc:1434] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.161466 16390 tablet_bootstrap.cc:492] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
W20251025 08:02:28.161559 14720 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 consensus state has no leader
I20251025 08:02:28.162451 15222 tablet_service.cc:1505] Processing CreateTablet for tablet cc676245d2984363b4af1e817b444c3d (DEFAULT_TABLE table=default.Table_d646c0b533324af5a468616714a7a44c [id=a26957427b014b0885f66b058ab6ece8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.162943 15094 tablet_service.cc:1505] Processing CreateTablet for tablet cc676245d2984363b4af1e817b444c3d (DEFAULT_TABLE table=default.Table_d646c0b533324af5a468616714a7a44c [id=a26957427b014b0885f66b058ab6ece8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.163164 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc676245d2984363b4af1e817b444c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.160346 15384 raft_consensus.cc:2804] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.163455 15384 raft_consensus.cc:697] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:28.163556 15384 consensus_queue.cc:237] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.164820 16390 tablet_bootstrap.cc:654] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.164893 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet f08d0c3446dd4a478f81688a3259bb91 (table default.Table_84b80cef0bc442cfb9f5301562ff1cce [id=ab926bc9b7424c45a5415c4763db2b4e]) successfully deleted
I20251025 08:02:28.166448 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc676245d2984363b4af1e817b444c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.166798 16364 ts_tablet_manager.cc:1929] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.169549 16364 log.cc:1199] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/74d87666abb643899a7b1e576e6cc840
I20251025 08:02:28.169767 16392 tablet_bootstrap.cc:492] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.169860 16364 ts_tablet_manager.cc:1950] T 74d87666abb643899a7b1e576e6cc840 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:28.169839 15049 consensus_peers.cc:597] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e605f701a474fff80688533f3a398e7. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.167375 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b41e092b7f40410a979bcfd5bbc7c225. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.169847 16392 ts_tablet_manager.cc:1403] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.054s user 0.000s sys 0.002s
I20251025 08:02:28.171432 16392 raft_consensus.cc:359] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.171514 16392 raft_consensus.cc:385] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.171543 16392 raft_consensus.cc:740] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.171640 16392 consensus_queue.cc:260] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.171933 16392 ts_tablet_manager.cc:1434] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:28.172135 14722 master_service.cc:954] ReplaceTablet: received request to replace tablet 1aa4677de4604abaa2dc6e5413c616a3 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.172003 16372 ts_tablet_manager.cc:1929] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.173311 16372 log.cc:1199] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/f585455b77df49738b44c31a3d7adb71
I20251025 08:02:28.173559 16372 ts_tablet_manager.cc:1950] T f585455b77df49738b44c31a3d7adb71 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.174047 16364 tablet_replica.cc:333] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.174155 16364 raft_consensus.cc:2243] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.174274 16364 raft_consensus.cc:2272] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.172089 16392 tablet_bootstrap.cc:492] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.174587 16364 ts_tablet_manager.cc:1916] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.175179 16392 tablet_bootstrap.cc:654] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.176363 16372 tablet_replica.cc:333] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.176441 16364 ts_tablet_manager.cc:1929] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.176503 16364 log.cc:1199] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/77365d99094541b2a5f7b8bb3bc18739
I20251025 08:02:28.176627 16372 raft_consensus.cc:2243] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.176743 16364 ts_tablet_manager.cc:1950] T 77365d99094541b2a5f7b8bb3bc18739 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.176885 16372 raft_consensus.cc:2272] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.177198 16364 tablet_replica.cc:333] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.177314 16364 raft_consensus.cc:2243] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.177327 16372 ts_tablet_manager.cc:1916] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.177475 16364 raft_consensus.cc:2272] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.177790 16364 ts_tablet_manager.cc:1916] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.178934 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet f585455b77df49738b44c31a3d7adb71 (table default.Table_d9d4e09b4b4f4014847e00428c183725 [id=37373d664cc54e57bed0f09a7c12c8e4]) successfully deleted
W20251025 08:02:28.179152 14714 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet bcb5f7e52507450c8a6f5a99a9927974 because the tablet was not found. No further retry: Not found: Tablet not found: bcb5f7e52507450c8a6f5a99a9927974
W20251025 08:02:28.179306 14714 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet eed2815efb7e46dd8b41f5ffe60daee8 because the tablet was not found. No further retry: Not found: Tablet not found: eed2815efb7e46dd8b41f5ffe60daee8
I20251025 08:02:28.179375 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 74d87666abb643899a7b1e576e6cc840 (table default.Table_521f904aba4a4b309e9864df54df659d [id=a95abf5644c64177afde71baad186bca]) successfully deleted
I20251025 08:02:28.179489 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 77365d99094541b2a5f7b8bb3bc18739 (table default.Table_129b50f9cb4f415382a1aa57c3f53670 [id=10953f82daf547f1a012597278f4770c]) successfully deleted
I20251025 08:02:28.179510 16372 ts_tablet_manager.cc:1929] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.179765 14951 tablet_service.cc:1505] Processing CreateTablet for tablet cc676245d2984363b4af1e817b444c3d (DEFAULT_TABLE table=default.Table_d646c0b533324af5a468616714a7a44c [id=a26957427b014b0885f66b058ab6ece8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.179809 15909 raft_consensus.cc:493] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.179872 16372 log.cc:1199] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/cf90d2e477b9493e9b78aae6a7d2d3e0
I20251025 08:02:28.179880 15909 raft_consensus.cc:515] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:28.179982 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc676245d2984363b4af1e817b444c3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.180114 16372 ts_tablet_manager.cc:1950] T cf90d2e477b9493e9b78aae6a7d2d3e0 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.180241 15909 leader_election.cc:290] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:28.180644 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet cf90d2e477b9493e9b78aae6a7d2d3e0 (table default.Table_e22e6abaeec0420496616ee334cf07eb [id=b3be7f970bc745f7873e9d54a68e3e50]) successfully deleted
W20251025 08:02:28.181030 14714 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet d2697ee09dc74d35abffc3158410aa5e because the tablet was not found. No further retry: Not found: Tablet not found: d2697ee09dc74d35abffc3158410aa5e
I20251025 08:02:28.181216 16372 tablet_replica.cc:333] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.181322 16372 raft_consensus.cc:2243] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.181473 16372 raft_consensus.cc:2272] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.181775 16372 ts_tablet_manager.cc:1916] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.183106 14720 catalog_manager.cc:5649] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
W20251025 08:02:28.183490 15185 leader_election.cc:343] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 4dd72f76c950485c968409fe868266a2
I20251025 08:02:28.183429 14720 catalog_manager.cc:5649] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
W20251025 08:02:28.183604 15183 leader_election.cc:343] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 4dd72f76c950485c968409fe868266a2
I20251025 08:02:28.183647 15183 leader_election.cc:304] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.184146 15909 raft_consensus.cc:2749] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.184477 16364 ts_tablet_manager.cc:1929] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.184547 16364 log.cc:1199] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/0310efe286dd409ab857a92daa6ff99f
I20251025 08:02:28.184779 16364 ts_tablet_manager.cc:1950] T 0310efe286dd409ab857a92daa6ff99f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.185210 16372 ts_tablet_manager.cc:1929] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.185309 16364 tablet_replica.cc:333] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.185330 16372 log.cc:1199] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/cf5008728a6241c096c9a76f8e374ceb
I20251025 08:02:28.185442 16364 raft_consensus.cc:2243] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.185563 16364 raft_consensus.cc:2272] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.185745 16372 ts_tablet_manager.cc:1950] T cf5008728a6241c096c9a76f8e374ceb P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.185916 16364 ts_tablet_manager.cc:1916] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.186280 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 0310efe286dd409ab857a92daa6ff99f (table default.Table_fc8b1dd5aa12482895416350908e36fd [id=eaba715cb2c74aca915cf7d374ee17a7]) successfully deleted
I20251025 08:02:28.186458 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet cf5008728a6241c096c9a76f8e374ceb (table default.Table_3231d801b62849a8a125cbe1d6fe9482 [id=025400eac2f746d7afc76aa78cd49c0b]) successfully deleted
I20251025 08:02:28.186882 16372 tablet_replica.cc:333] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.187062 16372 raft_consensus.cc:2243] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.187213 16372 raft_consensus.cc:2272] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.187566 16372 ts_tablet_manager.cc:1916] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.187613 14722 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 1aa4677de4604abaa2dc6e5413c616a3
I20251025 08:02:28.187709 16364 ts_tablet_manager.cc:1929] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.187763 16364 log.cc:1199] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/01d9f6636b364e3b9192ae546422de5b
I20251025 08:02:28.187839 14722 catalog_manager.cc:6719] ReplaceTablet: tablet 1aa4677de4604abaa2dc6e5413c616a3 deleted and replaced by tablet 4edf680e8d4a4b898fd6e64f8ec6f75d
I20251025 08:02:28.188032 16364 ts_tablet_manager.cc:1950] T 01d9f6636b364e3b9192ae546422de5b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:28.188208 14714 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec because the tablet was not found. No further retry: Not found: Tablet not found: 7ae3f4cdb1b14d1abe884c4a0628a6ec
I20251025 08:02:28.188462 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 1aa4677de4604abaa2dc6e5413c616a3 with delete_type TABLET_DATA_DELETED (replaced by tablet 4edf680e8d4a4b898fd6e64f8ec6f75d) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.188514 16364 tablet_replica.cc:333] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.188623 16364 raft_consensus.cc:2243] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.188722 16364 raft_consensus.cc:2272] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.189153 16364 ts_tablet_manager.cc:1916] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.189334 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 01d9f6636b364e3b9192ae546422de5b (table default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]) successfully deleted
I20251025 08:02:28.189532 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 1aa4677de4604abaa2dc6e5413c616a3 with delete_type TABLET_DATA_DELETED (replaced by tablet 4edf680e8d4a4b898fd6e64f8ec6f75d) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.189859 16372 ts_tablet_manager.cc:1929] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.190004 16372 log.cc:1199] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/77365d99094541b2a5f7b8bb3bc18739
I20251025 08:02:28.190337 16372 ts_tablet_manager.cc:1950] T 77365d99094541b2a5f7b8bb3bc18739 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.190973 16364 ts_tablet_manager.cc:1929] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.191048 16364 log.cc:1199] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/dfb4a050022d462699005fedc4323fdb
I20251025 08:02:28.191252 16364 ts_tablet_manager.cc:1950] T dfb4a050022d462699005fedc4323fdb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.191262 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 77365d99094541b2a5f7b8bb3bc18739 (table default.Table_129b50f9cb4f415382a1aa57c3f53670 [id=10953f82daf547f1a012597278f4770c]) successfully deleted
I20251025 08:02:28.191706 16364 tablet_replica.cc:333] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.191741 16372 tablet_replica.cc:333] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.191841 16364 raft_consensus.cc:2243] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.191965 16372 raft_consensus.cc:2243] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.192035 16364 raft_consensus.cc:2272] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.192135 16372 raft_consensus.cc:2272] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.192263 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet dfb4a050022d462699005fedc4323fdb (table default.Table_0d8dd510c9054bf68417584232937996 [id=304729d065a2432590594fc28cf98a19]) successfully deleted
I20251025 08:02:28.192404 16364 ts_tablet_manager.cc:1916] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.192804 16372 ts_tablet_manager.cc:1916] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.194244 16364 ts_tablet_manager.cc:1929] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.194316 16364 log.cc:1199] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/ff82c6ab12c844339dd387569fb85526
I20251025 08:02:28.194563 16364 ts_tablet_manager.cc:1950] T ff82c6ab12c844339dd387569fb85526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.194679 14726 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_d4d0cf0460ca4188bf5e9e502111012c [id=7505f67ea24847a6aa9c90955f1596fa] alter complete (version 1)
I20251025 08:02:28.194826 16372 ts_tablet_manager.cc:1929] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.194952 16372 log.cc:1199] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/b7e8a698e8ba408a833bbc3905b2ad04
I20251025 08:02:28.195096 16364 tablet_replica.cc:333] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.195252 16364 raft_consensus.cc:2243] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.195346 16372 ts_tablet_manager.cc:1950] T b7e8a698e8ba408a833bbc3905b2ad04 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.195361 16364 raft_consensus.cc:2272] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.195448 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet 1aa4677de4604abaa2dc6e5413c616a3 with delete_type TABLET_DATA_DELETED (replaced by tablet 4edf680e8d4a4b898fd6e64f8ec6f75d) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.195641 16364 ts_tablet_manager.cc:1916] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.196369 16372 tablet_replica.cc:333] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.196524 16372 raft_consensus.cc:2243] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.196743 16372 raft_consensus.cc:2272] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.197126 16372 ts_tablet_manager.cc:1916] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.197357 16364 ts_tablet_manager.cc:1929] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.197432 16364 log.cc:1199] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/cf5008728a6241c096c9a76f8e374ceb
I20251025 08:02:28.197556 16371 ts_tablet_manager.cc:1929] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.197676 16364 ts_tablet_manager.cc:1950] T cf5008728a6241c096c9a76f8e374ceb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.198211 16364 tablet_replica.cc:333] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.198343 16364 raft_consensus.cc:2243] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.198395 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet cf5008728a6241c096c9a76f8e374ceb (table default.Table_3231d801b62849a8a125cbe1d6fe9482 [id=025400eac2f746d7afc76aa78cd49c0b]) successfully deleted
I20251025 08:02:28.198442 16364 raft_consensus.cc:2272] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.196229 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet b7e8a698e8ba408a833bbc3905b2ad04 (table default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]) successfully deleted
I20251025 08:02:28.198738 16364 ts_tablet_manager.cc:1916] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.197824 14720 catalog_manager.cc:5649] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:28.198856 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet ff82c6ab12c844339dd387569fb85526 with delete_type TABLET_DATA_DELETED (replaced by tablet 8737df10a3c8482c995ac6aadc240c42) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.199613 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 2f64072c416f4a77b1c81855d7db8f01 (DEFAULT_TABLE table=default.Table_335f460fbdde453797ee3c1260214c09 [id=431195fe6a3847caa5b39d62cb399ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.199724 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 2f64072c416f4a77b1c81855d7db8f01 (DEFAULT_TABLE table=default.Table_335f460fbdde453797ee3c1260214c09 [id=431195fe6a3847caa5b39d62cb399ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.199946 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f64072c416f4a77b1c81855d7db8f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.200429 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f64072c416f4a77b1c81855d7db8f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.202119 16364 ts_tablet_manager.cc:1929] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.202234 16364 log.cc:1199] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/88052f79558a42eeb1c8acf44e6b48e1
I20251025 08:02:28.202454 16364 ts_tablet_manager.cc:1950] T 88052f79558a42eeb1c8acf44e6b48e1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.202939 16364 tablet_replica.cc:333] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.203019 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 88052f79558a42eeb1c8acf44e6b48e1 (table default.Table_b67672426aa24686a8955d366f86ff2d [id=2283253a9522485d93d6c484c5eef6e4]) successfully deleted
I20251025 08:02:28.203065 16364 raft_consensus.cc:2243] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.203146 16364 raft_consensus.cc:2272] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.203305 16372 ts_tablet_manager.cc:1929] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.203408 16372 log.cc:1199] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/74d87666abb643899a7b1e576e6cc840
I20251025 08:02:28.203472 16364 ts_tablet_manager.cc:1916] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.203725 16372 ts_tablet_manager.cc:1950] T 74d87666abb643899a7b1e576e6cc840 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.204326 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 74d87666abb643899a7b1e576e6cc840 (table default.Table_521f904aba4a4b309e9864df54df659d [id=a95abf5644c64177afde71baad186bca]) successfully deleted
I20251025 08:02:28.204560 16372 tablet_replica.cc:333] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.204694 16372 raft_consensus.cc:2243] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.204814 16372 raft_consensus.cc:2272] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.205169 16372 ts_tablet_manager.cc:1916] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.205245 16364 ts_tablet_manager.cc:1929] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.205309 16364 log.cc:1199] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/4dd72f76c950485c968409fe868266a2
I20251025 08:02:28.205497 16364 ts_tablet_manager.cc:1950] T 4dd72f76c950485c968409fe868266a2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.205981 16364 tablet_replica.cc:333] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.206040 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 4dd72f76c950485c968409fe868266a2 (table default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064]) successfully deleted
I20251025 08:02:28.206101 16364 raft_consensus.cc:2243] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.206261 16364 raft_consensus.cc:2272] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.206777 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 3f5cff308fc9448db40b0d4df03c69bb (DEFAULT_TABLE table=default.Table_200a2632d13848d3b5877ca9f7cb8daa [id=723109f028ee44b2aafcce03c05b61d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.206981 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5cff308fc9448db40b0d4df03c69bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.206990 16364 ts_tablet_manager.cc:1916] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.207479 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 3f5cff308fc9448db40b0d4df03c69bb (DEFAULT_TABLE table=default.Table_200a2632d13848d3b5877ca9f7cb8daa [id=723109f028ee44b2aafcce03c05b61d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.207682 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5cff308fc9448db40b0d4df03c69bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.208644 16364 ts_tablet_manager.cc:1929] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:28.208710 16364 log.cc:1199] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/071220f7bd334f5aad733209193244d4
I20251025 08:02:28.209379 14720 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_fb3af07031d2433fa1949ff417c1e03f" } modify_external_catalogs: true
I20251025 08:02:28.209518 14720 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_fb3af07031d2433fa1949ff417c1e03f" } modify_external_catalogs: true
I20251025 08:02:28.210016 14724 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_b2214744ef8c4a4cb1c28ab1689ddbdb" } new_table_name: "default.Table_790e5db826364329bab9f939b28fc2a0" modify_external_catalogs: true
I20251025 08:02:28.210073 14722 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_62b5b73c7fc44e9b990b9b71b7e98d0b" } modify_external_catalogs: true
I20251025 08:02:28.210171 14722 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_62b5b73c7fc44e9b990b9b71b7e98d0b" } modify_external_catalogs: true
I20251025 08:02:28.211889 16364 ts_tablet_manager.cc:1950] T 071220f7bd334f5aad733209193244d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.212694 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 071220f7bd334f5aad733209193244d4 (table default.Table_52aa8e04fcc241078c3c06f3157a5e4b [id=c571a9bdb4d14249a27b401b9c02f644]) successfully deleted
I20251025 08:02:28.212814 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b (DEFAULT_TABLE table=default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.213011 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:28.213095 14713 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet e0635cb57c4d4d51bed5897b28cc3dcd because the tablet was not found. No further retry: Not found: Tablet not found: e0635cb57c4d4d51bed5897b28cc3dcd
W20251025 08:02:28.213685 14713 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 7ae3f4cdb1b14d1abe884c4a0628a6ec because the tablet was not found. No further retry: Not found: Tablet not found: 7ae3f4cdb1b14d1abe884c4a0628a6ec
I20251025 08:02:28.213881 16364 tablet_replica.cc:333] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.213997 16364 raft_consensus.cc:2243] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.214233 16364 pending_rounds.cc:70] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 1 pending ops.
I20251025 08:02:28.214263 16364 pending_rounds.cc:77] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609809902456832 op_type: NO_OP noop_request { }
I20251025 08:02:28.214305 16364 raft_consensus.cc:2889] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:28.214349 16364 raft_consensus.cc:2272] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:28.214614 14724 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bfdc6022cc5747439edcb8aa865b9437 has no consensus state
I20251025 08:02:28.215332 15642 raft_consensus.cc:493] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.215427 15642 raft_consensus.cc:515] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.215768 15642 leader_election.cc:290] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.216027 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c301e7a80c64d8e8751ecfa681ab202" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.216158 15239 raft_consensus.cc:2393] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:28.216742 15218 tablet_service.cc:1505] Processing CreateTablet for tablet e48ddcfccc1340d39d21ce94bec4bf27 (DEFAULT_TABLE table=default.Table_52aa8e04fcc241078c3c06f3157a5e4b [id=c571a9bdb4d14249a27b401b9c02f644]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.216966 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48ddcfccc1340d39d21ce94bec4bf27. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.217952 14726 catalog_manager.cc:5649] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:28.218389 15094 tablet_service.cc:1505] Processing CreateTablet for tablet e48ddcfccc1340d39d21ce94bec4bf27 (DEFAULT_TABLE table=default.Table_52aa8e04fcc241078c3c06f3157a5e4b [id=c571a9bdb4d14249a27b401b9c02f644]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.218593 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48ddcfccc1340d39d21ce94bec4bf27. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.218727 14722 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet cf6c8a398589420ea8f1b52617fd038f
I20251025 08:02:28.200295 14951 tablet_service.cc:1505] Processing CreateTablet for tablet 2f64072c416f4a77b1c81855d7db8f01 (DEFAULT_TABLE table=default.Table_335f460fbdde453797ee3c1260214c09 [id=431195fe6a3847caa5b39d62cb399ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.220125 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f64072c416f4a77b1c81855d7db8f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.210391 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 3f5cff308fc9448db40b0d4df03c69bb (DEFAULT_TABLE table=default.Table_200a2632d13848d3b5877ca9f7cb8daa [id=723109f028ee44b2aafcce03c05b61d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.222970 16372 ts_tablet_manager.cc:1929] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.223027 16372 log.cc:1199] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/0310efe286dd409ab857a92daa6ff99f
I20251025 08:02:28.223022 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f5cff308fc9448db40b0d4df03c69bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.223275 16372 ts_tablet_manager.cc:1950] T 0310efe286dd409ab857a92daa6ff99f P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.223731 16372 tablet_replica.cc:333] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.223858 16372 raft_consensus.cc:2243] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.224026 16372 raft_consensus.cc:2272] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.224128 14722 master_service.cc:954] ReplaceTablet: received request to replace tablet 1ee00271d2354ae38dcb5a3289cea72f from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.224361 16372 ts_tablet_manager.cc:1916] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.212994 14958 tablet_service.cc:1505] Processing CreateTablet for tablet e48ddcfccc1340d39d21ce94bec4bf27 (DEFAULT_TABLE table=default.Table_52aa8e04fcc241078c3c06f3157a5e4b [id=c571a9bdb4d14249a27b401b9c02f644]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.225046 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e48ddcfccc1340d39d21ce94bec4bf27. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.226071 16372 ts_tablet_manager.cc:1929] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.226130 16372 log.cc:1199] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/5e605f701a474fff80688533f3a398e7
I20251025 08:02:28.213423 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b (DEFAULT_TABLE table=default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.226387 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.226538 16364 ts_tablet_manager.cc:1916] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.226886 14720 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 5a70808199034508833e4d2e5550b29b
I20251025 08:02:28.216348 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4c301e7a80c64d8e8751ecfa681ab202" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:28.217976 14914 consensus_peers.cc:597] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01d9f6636b364e3b9192ae546422de5b. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.228415 16364 ts_tablet_manager.cc:1929] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.228494 16364 log.cc:1199] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/1bd788e8b38b401a89cbc250b3695088
I20251025 08:02:28.228617 14719 master_service.cc:954] ReplaceTablet: received request to replace tablet 90bb43eb01c949b09f7a4c703a99dc7e from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.228734 16364 ts_tablet_manager.cc:1950] T 1bd788e8b38b401a89cbc250b3695088 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.229251 16364 tablet_replica.cc:333] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.229346 15048 leader_election.cc:304] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:28.229391 16364 raft_consensus.cc:2243] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.229475 16364 raft_consensus.cc:2272] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.229542 15642 raft_consensus.cc:3060] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.229727 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 1bd788e8b38b401a89cbc250b3695088 (table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]) successfully deleted
I20251025 08:02:28.229795 16364 ts_tablet_manager.cc:1916] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.230022 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 5a70808199034508833e4d2e5550b29b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.230427 15642 raft_consensus.cc:2749] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.230506 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 5a70808199034508833e4d2e5550b29b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.230837 14722 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 1ee00271d2354ae38dcb5a3289cea72f
I20251025 08:02:28.230867 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 0310efe286dd409ab857a92daa6ff99f (table default.Table_fc8b1dd5aa12482895416350908e36fd [id=eaba715cb2c74aca915cf7d374ee17a7]) successfully deleted
I20251025 08:02:28.231042 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 5a70808199034508833e4d2e5550b29b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.231096 14722 catalog_manager.cc:6719] ReplaceTablet: tablet 1ee00271d2354ae38dcb5a3289cea72f deleted and replaced by tablet cb3569ec2cdd4736b264b00abf1fa36a
I20251025 08:02:28.231171 16371 log.cc:1199] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/f585455b77df49738b44c31a3d7adb71
I20251025 08:02:28.231226 16372 ts_tablet_manager.cc:1950] T 5e605f701a474fff80688533f3a398e7 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.231455 16371 ts_tablet_manager.cc:1950] T f585455b77df49738b44c31a3d7adb71 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.231779 16372 tablet_replica.cc:333] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.231799 16364 ts_tablet_manager.cc:1929] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.231858 16364 log.cc:1199] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/2091a81ad64a4574b04c081bdeceda1f
I20251025 08:02:28.232028 16372 raft_consensus.cc:2243] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.232218 16364 ts_tablet_manager.cc:1950] T 2091a81ad64a4574b04c081bdeceda1f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.232403 16371 tablet_replica.cc:333] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.232087 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 1ee00271d2354ae38dcb5a3289cea72f with delete_type TABLET_DATA_DELETED (replaced by tablet cb3569ec2cdd4736b264b00abf1fa36a) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.232534 16372 raft_consensus.cc:2272] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.232586 16371 raft_consensus.cc:2243] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.232754 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 2091a81ad64a4574b04c081bdeceda1f (table default.Table_2931abc275064dfd818fc151a0267713 [id=87037802262e424ebe9c070b5ef7ba62]) successfully deleted
I20251025 08:02:28.232883 16371 raft_consensus.cc:2272] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.233165 16372 ts_tablet_manager.cc:1916] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.233304 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 5e605f701a474fff80688533f3a398e7 (table default.Table_e650e0b918954a7f8c97ff7e8e9bcffd [id=dfe9146b50254c54ad1b75080a2ee201]) successfully deleted
I20251025 08:02:28.233341 16371 ts_tablet_manager.cc:1916] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.233670 16364 tablet_replica.cc:333] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.233785 16364 raft_consensus.cc:2243] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.233876 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 1ee00271d2354ae38dcb5a3289cea72f with delete_type TABLET_DATA_DELETED (replaced by tablet cb3569ec2cdd4736b264b00abf1fa36a) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.233958 16364 raft_consensus.cc:2272] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.234426 16364 ts_tablet_manager.cc:1916] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.235728 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 1ee00271d2354ae38dcb5a3289cea72f with delete_type TABLET_DATA_DELETED (replaced by tablet cb3569ec2cdd4736b264b00abf1fa36a) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.236027 14719 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_32f95976a4704d3fbba9e5c01cb8f9d9" } modify_external_catalogs: true
I20251025 08:02:28.236090 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_9ad25f68a3a040818a9cd919b194b424"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.236132 14719 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_32f95976a4704d3fbba9e5c01cb8f9d9" } modify_external_catalogs: true
W20251025 08:02:28.236428 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ad25f68a3a040818a9cd919b194b424 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.237298 16372 ts_tablet_manager.cc:1929] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:28.237542 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b (DEFAULT_TABLE table=default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.237877 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.238054 16372 log.cc:1199] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/071220f7bd334f5aad733209193244d4
I20251025 08:02:28.238266 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet f585455b77df49738b44c31a3d7adb71 (table default.Table_d9d4e09b4b4f4014847e00428c183725 [id=37373d664cc54e57bed0f09a7c12c8e4]) successfully deleted
W20251025 08:02:28.238404 14712 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet a608dd2b2d1d42178bb00b3355bd6470 because the tablet was not found. No further retry: Not found: Tablet not found: a608dd2b2d1d42178bb00b3355bd6470
W20251025 08:02:28.238548 14712 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet bcb5f7e52507450c8a6f5a99a9927974 because the tablet was not found. No further retry: Not found: Tablet not found: bcb5f7e52507450c8a6f5a99a9927974
I20251025 08:02:28.238435 16364 ts_tablet_manager.cc:1929] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.238880 16372 ts_tablet_manager.cc:1950] T 071220f7bd334f5aad733209193244d4 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.238976 16364 log.cc:1199] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/8737df10a3c8482c995ac6aadc240c42
I20251025 08:02:28.239423 16372 tablet_replica.cc:333] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.239717 16364 ts_tablet_manager.cc:1950] T 8737df10a3c8482c995ac6aadc240c42 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.240351 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 8737df10a3c8482c995ac6aadc240c42 (table default.Table_475579a80dad4c89bfd895cd2fdaafaf [id=c8b69f7419b842c18f324e0c08ba840a]) successfully deleted
I20251025 08:02:28.240377 16364 tablet_replica.cc:333] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.240556 16372 raft_consensus.cc:2243] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
W20251025 08:02:28.240584 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 221f4c5432bc45e18728f5ed1453ad0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 221f4c5432bc45e18728f5ed1453ad0f already in progress: creating tablet
I20251025 08:02:28.240736 16372 raft_consensus.cc:2272] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.241106 16372 ts_tablet_manager.cc:1916] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.241284 16364 raft_consensus.cc:2243] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.241735 16364 raft_consensus.cc:2272] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.243088 16364 ts_tablet_manager.cc:1916] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.243111 15864 raft_consensus.cc:493] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.243196 15864 raft_consensus.cc:515] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.243548 15864 leader_election.cc:290] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:28.243731 14726 master_service.cc:954] ReplaceTablet: received request to replace tablet 72ff369b973b4c5981ea0810e37e8562 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.244151 15094 tablet_service.cc:1505] Processing CreateTablet for tablet e106f20977444dd4a49b6e4ae0f45380 (DEFAULT_TABLE table=default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.244230 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "049cc6add40d44fc9d67c89eca89ce59" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.244354 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e106f20977444dd4a49b6e4ae0f45380. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.244359 14959 tablet_service.cc:1505] Processing CreateTablet for tablet e106f20977444dd4a49b6e4ae0f45380 (DEFAULT_TABLE table=default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.244568 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e106f20977444dd4a49b6e4ae0f45380. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.245126 16372 ts_tablet_manager.cc:1929] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.245187 16372 log.cc:1199] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/2091a81ad64a4574b04c081bdeceda1f
I20251025 08:02:28.245429 16372 ts_tablet_manager.cc:1950] T 2091a81ad64a4574b04c081bdeceda1f P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.246366 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "049cc6add40d44fc9d67c89eca89ce59" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.246474 15238 raft_consensus.cc:2468] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
W20251025 08:02:28.246510 14915 leader_election.cc:343] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.246730 14914 leader_election.cc:304] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.246755 16364 ts_tablet_manager.cc:1929] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.246815 16364 log.cc:1199] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/801d06a391e34bec8e1f74257937f069
I20251025 08:02:28.246937 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 071220f7bd334f5aad733209193244d4 (table default.Table_52aa8e04fcc241078c3c06f3157a5e4b [id=c571a9bdb4d14249a27b401b9c02f644]) successfully deleted
I20251025 08:02:28.247009 15864 raft_consensus.cc:2804] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.247059 15864 raft_consensus.cc:493] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.247092 15864 raft_consensus.cc:3060] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:28.247092 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 1bd788e8b38b401a89cbc250b3695088 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bd788e8b38b401a89cbc250b3695088 already in progress: creating tablet
I20251025 08:02:28.247192 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 2091a81ad64a4574b04c081bdeceda1f (table default.Table_2931abc275064dfd818fc151a0267713 [id=87037802262e424ebe9c070b5ef7ba62]) successfully deleted
I20251025 08:02:28.247210 16364 ts_tablet_manager.cc:1950] T 801d06a391e34bec8e1f74257937f069 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.247514 15094 tablet_service.cc:1505] Processing CreateTablet for tablet ae3c8e134d164edd8781f27e7bdc3b92 (DEFAULT_TABLE table=default.Table_67e95c34b6c44449abf8828cc3b6e9c2 [id=b0f029b25327468c94a2c78b37c6d203]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.247720 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3c8e134d164edd8781f27e7bdc3b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.247761 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 801d06a391e34bec8e1f74257937f069 (table default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]) successfully deleted
I20251025 08:02:28.247871 15864 raft_consensus.cc:515] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.247982 16372 tablet_replica.cc:333] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.248085 16372 raft_consensus.cc:2243] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.248170 16372 raft_consensus.cc:2272] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.248212 15864 leader_election.cc:290] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:28.248697 16372 ts_tablet_manager.cc:1916] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.248853 16364 tablet_replica.cc:333] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.248961 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "049cc6add40d44fc9d67c89eca89ce59" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
W20251025 08:02:28.249492 14915 leader_election.cc:343] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.249697 16364 raft_consensus.cc:2243] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.249833 16364 raft_consensus.cc:2272] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.251480 16372 ts_tablet_manager.cc:1929] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.248925 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "049cc6add40d44fc9d67c89eca89ce59" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:28.251657 15238 raft_consensus.cc:3060] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.251890 14959 tablet_service.cc:1505] Processing CreateTablet for tablet ae3c8e134d164edd8781f27e7bdc3b92 (DEFAULT_TABLE table=default.Table_67e95c34b6c44449abf8828cc3b6e9c2 [id=b0f029b25327468c94a2c78b37c6d203]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.252079 16364 ts_tablet_manager.cc:1916] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.252110 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3c8e134d164edd8781f27e7bdc3b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.252516 15238 raft_consensus.cc:2468] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:28.252897 14914 leader_election.cc:304] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.253111 15374 raft_consensus.cc:2804] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.253196 15374 raft_consensus.cc:697] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:28.253319 15374 consensus_queue.cc:237] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.253912 16364 ts_tablet_manager.cc:1929] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.253970 16364 log.cc:1199] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/4d9cd745bd3e42e98b0ae1d145007bee
I20251025 08:02:28.254307 16372 log.cc:1199] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/8737df10a3c8482c995ac6aadc240c42
I20251025 08:02:28.254532 16372 ts_tablet_manager.cc:1950] T 8737df10a3c8482c995ac6aadc240c42 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.255043 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 8737df10a3c8482c995ac6aadc240c42 (table default.Table_475579a80dad4c89bfd895cd2fdaafaf [id=c8b69f7419b842c18f324e0c08ba840a]) successfully deleted
W20251025 08:02:28.255702 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 221f4c5432bc45e18728f5ed1453ad0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 221f4c5432bc45e18728f5ed1453ad0f already in progress: creating tablet
I20251025 08:02:28.255863 16372 tablet_replica.cc:333] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.255965 16372 raft_consensus.cc:2243] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.256067 16372 raft_consensus.cc:2272] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.256176 16364 ts_tablet_manager.cc:1950] T 4d9cd745bd3e42e98b0ae1d145007bee P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.256680 16364 tablet_replica.cc:333] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.256781 16364 raft_consensus.cc:2243] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.256870 16364 raft_consensus.cc:2272] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.257186 16364 ts_tablet_manager.cc:1916] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.257781 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 4d9cd745bd3e42e98b0ae1d145007bee (table default.Table_8540557c73a34cc2851ad08d71acac22 [id=abe30167767443d0b8e59f9418399d88]) successfully deleted
I20251025 08:02:28.257890 16392 tablet_bootstrap.cc:492] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.257973 16392 ts_tablet_manager.cc:1403] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.086s user 0.000s sys 0.002s
I20251025 08:02:28.258492 16392 raft_consensus.cc:359] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.258606 16392 raft_consensus.cc:385] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.258638 16392 raft_consensus.cc:740] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.258661 16372 ts_tablet_manager.cc:1916] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.258754 16392 consensus_queue.cc:260] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.259048 16392 ts_tablet_manager.cc:1434] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.259250 16392 tablet_bootstrap.cc:492] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.259256 14720 catalog_manager.cc:5649] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:28.260247 16392 tablet_bootstrap.cc:654] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.260485 16372 ts_tablet_manager.cc:1929] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.260545 16372 log.cc:1199] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/801d06a391e34bec8e1f74257937f069
I20251025 08:02:28.260797 16372 ts_tablet_manager.cc:1950] T 801d06a391e34bec8e1f74257937f069 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.261359 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 801d06a391e34bec8e1f74257937f069 (table default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]) successfully deleted
I20251025 08:02:28.262286 16364 ts_tablet_manager.cc:1929] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.262697 14719 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 04d3488a6b814223b742f0d5c946362f
I20251025 08:02:28.262888 16364 log.cc:1199] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/88efe498fb6f4ce1a02b5389ff6f5797
I20251025 08:02:28.263152 16364 ts_tablet_manager.cc:1950] T 88efe498fb6f4ce1a02b5389ff6f5797 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.263586 16372 tablet_replica.cc:333] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.263696 16372 raft_consensus.cc:2243] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.263718 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 04d3488a6b814223b742f0d5c946362f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.263760 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 04d3488a6b814223b742f0d5c946362f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.263849 16372 raft_consensus.cc:2272] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.264770 16372 ts_tablet_manager.cc:1916] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.264935 16364 tablet_replica.cc:333] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.265753 14724 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_a368af9d0b8d46d78f9158b8f9949b01" } modify_external_catalogs: true
I20251025 08:02:28.265852 14724 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_a368af9d0b8d46d78f9158b8f9949b01" } modify_external_catalogs: true
I20251025 08:02:28.266377 16364 raft_consensus.cc:2243] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.266487 16364 raft_consensus.cc:2272] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.266582 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_97dcb2270cdf4d21824166c30b3a62a9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.266788 16364 ts_tablet_manager.cc:1916] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.266889 14718 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_9d2b453ce59a456d9a0988f2bc484b6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.266925 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_97dcb2270cdf4d21824166c30b3a62a9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:28.267205 14718 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9d2b453ce59a456d9a0988f2bc484b6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.268353 14721 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_035b154aa0234ef38415962cb9359b93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.268591 16364 ts_tablet_manager.cc:1929] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.268649 16364 log.cc:1199] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/90bb43eb01c949b09f7a4c703a99dc7e
W20251025 08:02:28.268685 14721 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_035b154aa0234ef38415962cb9359b93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:28.269551 14915 consensus_peers.cc:597] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2091a81ad64a4574b04c081bdeceda1f. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.269570 16372 ts_tablet_manager.cc:1929] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.269631 16372 log.cc:1199] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/4d9cd745bd3e42e98b0ae1d145007bee
I20251025 08:02:28.269871 16372 ts_tablet_manager.cc:1950] T 4d9cd745bd3e42e98b0ae1d145007bee P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.270288 14723 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_335f460fbdde453797ee3c1260214c09" } new_table_name: "default.Table_b9669fd414104dcca80167117a5b0ed7" modify_external_catalogs: true
I20251025 08:02:28.270488 16372 tablet_replica.cc:333] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.270560 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 4d9cd745bd3e42e98b0ae1d145007bee (table default.Table_8540557c73a34cc2851ad08d71acac22 [id=abe30167767443d0b8e59f9418399d88]) successfully deleted
I20251025 08:02:28.270601 16372 raft_consensus.cc:2243] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.270686 16372 raft_consensus.cc:2272] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.270993 16372 ts_tablet_manager.cc:1916] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.270992 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 04d3488a6b814223b742f0d5c946362f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
W20251025 08:02:28.271251 14914 consensus_peers.cc:597] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88efe498fb6f4ce1a02b5389ff6f5797. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.272433 14727 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 0078dd6fb0e34d01a54889326dd6dfd7 (table default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b]). Expected version 1 got 0
I20251025 08:02:28.272661 16372 ts_tablet_manager.cc:1929] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.272706 16372 log.cc:1199] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/88efe498fb6f4ce1a02b5389ff6f5797
I20251025 08:02:28.272889 16372 ts_tablet_manager.cc:1950] T 88efe498fb6f4ce1a02b5389ff6f5797 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.272922 14725 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_d646c0b533324af5a468616714a7a44c" } new_table_name: "default.Table_c9a43b4d33d14d7dbea3c1994be81413" modify_external_catalogs: true
I20251025 08:02:28.273319 16372 tablet_replica.cc:333] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.273411 16372 raft_consensus.cc:2243] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.273561 16372 raft_consensus.cc:2272] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.273856 16372 ts_tablet_manager.cc:1916] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.274048 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 0769fe05ef364f8e80786bded1ec44cf (DEFAULT_TABLE table=default.Table_165ff894c5ab455e8daf5d1cf318b785 [id=325e0a7553e840c58179c04253e874dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.274271 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0769fe05ef364f8e80786bded1ec44cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.274288 14719 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_dab6241c02794509a694715ad8cfd171" } new_table_name: "default.Table_7c63861b2d594b5d8ca6e055870d36ca" modify_external_catalogs: true
I20251025 08:02:28.275350 15222 tablet_service.cc:1505] Processing CreateTablet for tablet ae3c8e134d164edd8781f27e7bdc3b92 (DEFAULT_TABLE table=default.Table_67e95c34b6c44449abf8828cc3b6e9c2 [id=b0f029b25327468c94a2c78b37c6d203]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.275447 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 0769fe05ef364f8e80786bded1ec44cf (DEFAULT_TABLE table=default.Table_165ff894c5ab455e8daf5d1cf318b785 [id=325e0a7553e840c58179c04253e874dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.275573 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae3c8e134d164edd8781f27e7bdc3b92. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.275729 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0769fe05ef364f8e80786bded1ec44cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.277865 16364 ts_tablet_manager.cc:1950] T 90bb43eb01c949b09f7a4c703a99dc7e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.278383 16364 tablet_replica.cc:333] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.278503 16364 raft_consensus.cc:2243] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.278595 16364 raft_consensus.cc:2272] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.278687 14726 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 72ff369b973b4c5981ea0810e37e8562
I20251025 08:02:28.278959 14726 catalog_manager.cc:6719] ReplaceTablet: tablet 72ff369b973b4c5981ea0810e37e8562 deleted and replaced by tablet 2562325ea1c9436a85e1d675574c0a6c
I20251025 08:02:28.279117 16364 ts_tablet_manager.cc:1916] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.279619 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 90bb43eb01c949b09f7a4c703a99dc7e (table default.Table_2d1acf2ab32844f2a253a5d5ab46d842 [id=3abdeeb0fca0413d8af86b1c0ad383b4]) successfully deleted
I20251025 08:02:28.279676 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet 72ff369b973b4c5981ea0810e37e8562 with delete_type TABLET_DATA_DELETED (replaced by tablet 2562325ea1c9436a85e1d675574c0a6c) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.280531 14727 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_52aa8e04fcc241078c3c06f3157a5e4b" } modify_external_catalogs: true
I20251025 08:02:28.280625 14727 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_52aa8e04fcc241078c3c06f3157a5e4b" } modify_external_catalogs: true
I20251025 08:02:28.281009 15087 tablet_service.cc:1552] Processing DeleteTablet for tablet 72ff369b973b4c5981ea0810e37e8562 with delete_type TABLET_DATA_DELETED (replaced by tablet 2562325ea1c9436a85e1d675574c0a6c) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.281216 16364 ts_tablet_manager.cc:1929] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.281276 16364 log.cc:1199] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/422e2c32a18a4e1ea9a5e371da17dfea
I20251025 08:02:28.281509 16364 ts_tablet_manager.cc:1950] T 422e2c32a18a4e1ea9a5e371da17dfea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:28.281903 14914 consensus_peers.cc:597] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.282300 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 422e2c32a18a4e1ea9a5e371da17dfea (table default.Table_790e5db826364329bab9f939b28fc2a0 [id=e62c2aba4e5546e2bd881c5f2ae3abd4]) successfully deleted
I20251025 08:02:28.282522 16364 tablet_replica.cc:333] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.282640 16364 raft_consensus.cc:2243] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.282730 16364 raft_consensus.cc:2272] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.283025 16364 ts_tablet_manager.cc:1916] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.283535 15218 tablet_service.cc:1505] Processing CreateTablet for tablet e106f20977444dd4a49b6e4ae0f45380 (DEFAULT_TABLE table=default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.283825 15094 tablet_service.cc:1505] Processing CreateTablet for tablet fbae08a3a1c34dfda60b1985346e7761 (DEFAULT_TABLE table=default.Table_075d43596a3d4f1e889c2cd50b615157 [id=fb192136f9d9453a8d0aad2c1103118d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.284193 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbae08a3a1c34dfda60b1985346e7761. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.284520 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e106f20977444dd4a49b6e4ae0f45380. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.284883 16372 ts_tablet_manager.cc:1929] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.284996 16372 log.cc:1199] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/90bb43eb01c949b09f7a4c703a99dc7e
I20251025 08:02:28.285543 16372 ts_tablet_manager.cc:1950] T 90bb43eb01c949b09f7a4c703a99dc7e P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.286103 16372 tablet_replica.cc:333] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.286172 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 90bb43eb01c949b09f7a4c703a99dc7e (table default.Table_2d1acf2ab32844f2a253a5d5ab46d842 [id=3abdeeb0fca0413d8af86b1c0ad383b4]) successfully deleted
I20251025 08:02:28.286777 16372 raft_consensus.cc:2243] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.286921 16372 raft_consensus.cc:2272] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.287288 16372 ts_tablet_manager.cc:1916] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.287391 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 72ff369b973b4c5981ea0810e37e8562 with delete_type TABLET_DATA_DELETED (replaced by tablet 2562325ea1c9436a85e1d675574c0a6c) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.287863 14958 tablet_service.cc:1505] Processing CreateTablet for tablet e762c440cb0947deb7e6a4186deebdc1 (DEFAULT_TABLE table=default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.288131 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e762c440cb0947deb7e6a4186deebdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.289058 16372 ts_tablet_manager.cc:1929] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.289116 16372 log.cc:1199] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/422e2c32a18a4e1ea9a5e371da17dfea
I20251025 08:02:28.289362 16372 ts_tablet_manager.cc:1950] T 422e2c32a18a4e1ea9a5e371da17dfea P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.289820 16372 tablet_replica.cc:333] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.289901 14724 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet e3cd7b63fa174ee192ff909f149e8b17
I20251025 08:02:28.289960 16372 raft_consensus.cc:2243] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.290053 16372 raft_consensus.cc:2272] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.290606 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 0769fe05ef364f8e80786bded1ec44cf (DEFAULT_TABLE table=default.Table_165ff894c5ab455e8daf5d1cf318b785 [id=325e0a7553e840c58179c04253e874dc]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:28.290858 14723 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2f64072c416f4a77b1c81855d7db8f01 consensus state has no leader
I20251025 08:02:28.291069 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0769fe05ef364f8e80786bded1ec44cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.291483 16392 tablet_bootstrap.cc:492] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.291558 16392 ts_tablet_manager.cc:1403] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20251025 08:02:28.291695 16372 ts_tablet_manager.cc:1916] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.291970 16392 raft_consensus.cc:359] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.292049 16392 raft_consensus.cc:385] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.292075 16392 raft_consensus.cc:740] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.292156 16392 consensus_queue.cc:260] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:28.292516 14725 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cc676245d2984363b4af1e817b444c3d consensus state has no leader
W20251025 08:02:28.292778 14719 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1d7c262b73904f1f87188718617e38a8 consensus state has no leader
I20251025 08:02:28.293195 16392 ts_tablet_manager.cc:1434] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:28.293485 16372 ts_tablet_manager.cc:1929] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.293613 16372 log.cc:1199] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/2a0a2af3ed1f41fea41962db52cfe7d8
I20251025 08:02:28.293830 16392 tablet_bootstrap.cc:492] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.294275 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 422e2c32a18a4e1ea9a5e371da17dfea (table default.Table_790e5db826364329bab9f939b28fc2a0 [id=e62c2aba4e5546e2bd881c5f2ae3abd4]) successfully deleted
I20251025 08:02:28.295883 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_a901c364849c4301910d7c32f0ec25fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.296224 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a901c364849c4301910d7c32f0ec25fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.296804 16392 tablet_bootstrap.cc:654] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.290860 14951 tablet_service.cc:1505] Processing CreateTablet for tablet fbae08a3a1c34dfda60b1985346e7761 (DEFAULT_TABLE table=default.Table_075d43596a3d4f1e889c2cd50b615157 [id=fb192136f9d9453a8d0aad2c1103118d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.293900 16372 ts_tablet_manager.cc:1950] T 2a0a2af3ed1f41fea41962db52cfe7d8 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.294162 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet e3cd7b63fa174ee192ff909f149e8b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.297477 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbae08a3a1c34dfda60b1985346e7761. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.297909 16392 tablet_bootstrap.cc:492] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.297979 16392 ts_tablet_manager.cc:1403] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:28.298400 16392 raft_consensus.cc:359] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.298482 16392 raft_consensus.cc:385] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.298511 16392 raft_consensus.cc:740] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.298614 16392 consensus_queue.cc:260] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.299971 16372 tablet_replica.cc:333] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.300083 16372 raft_consensus.cc:2243] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.300168 16372 raft_consensus.cc:2272] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.300405 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 2a0a2af3ed1f41fea41962db52cfe7d8 (table default.Table_0db7fc431dff4c7f85007159dd715e19 [id=1e1120fd790b44569595d67fea5165c2]) successfully deleted
I20251025 08:02:28.285521 15222 tablet_service.cc:1505] Processing CreateTablet for tablet fbae08a3a1c34dfda60b1985346e7761 (DEFAULT_TABLE table=default.Table_075d43596a3d4f1e889c2cd50b615157 [id=fb192136f9d9453a8d0aad2c1103118d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.286633 16364 ts_tablet_manager.cc:1929] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.301472 16364 log.cc:1199] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/2a0a2af3ed1f41fea41962db52cfe7d8
I20251025 08:02:28.301565 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbae08a3a1c34dfda60b1985346e7761. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.295614 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet e3cd7b63fa174ee192ff909f149e8b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.301715 16364 ts_tablet_manager.cc:1950] T 2a0a2af3ed1f41fea41962db52cfe7d8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.290426 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet e3cd7b63fa174ee192ff909f149e8b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.302317 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 2a0a2af3ed1f41fea41962db52cfe7d8 (table default.Table_0db7fc431dff4c7f85007159dd715e19 [id=1e1120fd790b44569595d67fea5165c2]) successfully deleted
I20251025 08:02:28.302529 16364 tablet_replica.cc:333] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.302647 16364 raft_consensus.cc:2243] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.302868 16364 pending_rounds.cc:70] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 1 pending ops.
I20251025 08:02:28.302906 16364 pending_rounds.cc:77] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609809552879616 op_type: NO_OP noop_request { }
I20251025 08:02:28.302966 16364 raft_consensus.cc:2889] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:28.303030 16364 raft_consensus.cc:2272] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.303859 16364 ts_tablet_manager.cc:1916] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.304929 16392 ts_tablet_manager.cc:1434] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20251025 08:02:28.306130 16364 ts_tablet_manager.cc:1929] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.306296 16364 log.cc:1199] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/3faddc4af6ef4019be369ceb023cbc9d
I20251025 08:02:28.306592 16364 ts_tablet_manager.cc:1950] T 3faddc4af6ef4019be369ceb023cbc9d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.306720 14727 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet e48ddcfccc1340d39d21ce94bec4bf27
I20251025 08:02:28.306953 16392 tablet_bootstrap.cc:492] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.307557 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet e48ddcfccc1340d39d21ce94bec4bf27 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.308048 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 3faddc4af6ef4019be369ceb023cbc9d (table default.Table_035df9ac9f6541dd9b042857523d0659 [id=2c373de1732c4d18ad45968e90a65608]) successfully deleted
I20251025 08:02:28.308249 16364 tablet_replica.cc:333] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.308341 16392 tablet_bootstrap.cc:654] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.308367 16364 raft_consensus.cc:2243] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.308463 16364 raft_consensus.cc:2272] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.308670 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_2c042f0ac6454365ae570c2cd26b31ca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.308784 16364 ts_tablet_manager.cc:1916] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:28.309013 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c042f0ac6454365ae570c2cd26b31ca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.309100 16372 ts_tablet_manager.cc:1916] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.310050 15642 raft_consensus.cc:493] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.310127 15642 raft_consensus.cc:515] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.310578 15642 leader_election.cc:290] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.310837 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet e48ddcfccc1340d39d21ce94bec4bf27 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.310850 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7711a974f4a84d639f1c3077da9d855f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.310985 14975 raft_consensus.cc:2393] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:28.311426 16372 ts_tablet_manager.cc:1929] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.311558 16372 log.cc:1199] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/3faddc4af6ef4019be369ceb023cbc9d
W20251025 08:02:28.311681 14915 consensus_peers.cc:597] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 76a906654cc44bfb96d9e1a936040e57. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.312165 16372 ts_tablet_manager.cc:1950] T 3faddc4af6ef4019be369ceb023cbc9d P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.312691 16372 tablet_replica.cc:333] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.312837 16372 raft_consensus.cc:2243] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.313047 16372 raft_consensus.cc:2272] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.313174 14719 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 1d7c262b73904f1f87188718617e38a8 (table default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056]). Expected version 5 got 0
I20251025 08:02:28.313403 16372 ts_tablet_manager.cc:1916] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.313585 16391 tablet_bootstrap.cc:492] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:28.313669 16391 ts_tablet_manager.cc:1403] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.184s user 0.002s sys 0.000s
I20251025 08:02:28.314299 16391 raft_consensus.cc:359] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.314407 16391 raft_consensus.cc:385] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.314443 16391 raft_consensus.cc:740] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.314555 16391 consensus_queue.cc:260] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.314787 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 3faddc4af6ef4019be369ceb023cbc9d (table default.Table_035df9ac9f6541dd9b042857523d0659 [id=2c373de1732c4d18ad45968e90a65608]) successfully deleted
I20251025 08:02:28.314837 16391 ts_tablet_manager.cc:1434] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.315016 16391 tablet_bootstrap.cc:492] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:28.315128 14719 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_1ccbe630ac5a41ecb7b00087172bec38"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.315331 16372 ts_tablet_manager.cc:1929] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.315388 16372 log.cc:1199] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/1aa4677de4604abaa2dc6e5413c616a3
W20251025 08:02:28.315418 14719 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ccbe630ac5a41ecb7b00087172bec38 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.315611 16372 ts_tablet_manager.cc:1950] T 1aa4677de4604abaa2dc6e5413c616a3 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.315976 16391 tablet_bootstrap.cc:654] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.316063 16372 tablet_replica.cc:333] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.316138 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7711a974f4a84d639f1c3077da9d855f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.316181 16372 raft_consensus.cc:2243] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.316345 16372 raft_consensus.cc:2272] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.316525 15049 leader_election.cc:304] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:28.316686 15642 raft_consensus.cc:3060] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.316970 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 1aa4677de4604abaa2dc6e5413c616a3 (table default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]) successfully deleted
I20251025 08:02:28.317288 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_bf6fb7de8ef24d3b823156be182558f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.317516 15642 raft_consensus.cc:2749] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:28.317564 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf6fb7de8ef24d3b823156be182558f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.317839 16372 ts_tablet_manager.cc:1916] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.319695 16372 ts_tablet_manager.cc:1929] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.319751 16372 log.cc:1199] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/5a70808199034508833e4d2e5550b29b
I20251025 08:02:28.319959 16372 ts_tablet_manager.cc:1950] T 5a70808199034508833e4d2e5550b29b P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.320442 16372 tablet_replica.cc:333] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.320541 16372 raft_consensus.cc:2243] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.320690 16372 raft_consensus.cc:2272] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.321018 16372 ts_tablet_manager.cc:1916] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.322628 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 5a70808199034508833e4d2e5550b29b (table default.Table_fb3af07031d2433fa1949ff417c1e03f [id=a788bc4f491d4d7580a83895797f5651]) successfully deleted
I20251025 08:02:28.323086 16372 ts_tablet_manager.cc:1929] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.323191 16372 log.cc:1199] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/1ee00271d2354ae38dcb5a3289cea72f
I20251025 08:02:28.323443 14722 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 1d7c262b73904f1f87188718617e38a8 (table default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056]). Expected version 5 got 0
I20251025 08:02:28.323486 16372 ts_tablet_manager.cc:1950] T 1ee00271d2354ae38dcb5a3289cea72f P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.323873 15864 consensus_queue.cc:1048] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.324056 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 1ee00271d2354ae38dcb5a3289cea72f (table default.Table_8fd6304d02a6478fa31556344ab157ae [id=1ee33ee129d749d0bd7f26dc49fca0fe]) successfully deleted
W20251025 08:02:28.324632 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 04d3488a6b814223b742f0d5c946362f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04d3488a6b814223b742f0d5c946362f already in progress: creating tablet
I20251025 08:02:28.324846 16372 tablet_replica.cc:333] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.324944 16372 raft_consensus.cc:2243] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.325320 16372 raft_consensus.cc:2272] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.325627 15094 tablet_service.cc:1505] Processing CreateTablet for tablet e762c440cb0947deb7e6a4186deebdc1 (DEFAULT_TABLE table=default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.325899 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e762c440cb0947deb7e6a4186deebdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.326639 15222 tablet_service.cc:1505] Processing CreateTablet for tablet e762c440cb0947deb7e6a4186deebdc1 (DEFAULT_TABLE table=default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.326864 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e762c440cb0947deb7e6a4186deebdc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.330073 16372 ts_tablet_manager.cc:1916] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.330821 16371 ts_tablet_manager.cc:1929] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.330943 16371 log.cc:1199] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/01d9f6636b364e3b9192ae546422de5b
I20251025 08:02:28.331266 16371 ts_tablet_manager.cc:1950] T 01d9f6636b364e3b9192ae546422de5b P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.331921 16371 tablet_replica.cc:333] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.332096 16371 raft_consensus.cc:2243] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.332262 16371 raft_consensus.cc:2272] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.332629 16371 ts_tablet_manager.cc:1916] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.331830 16372 ts_tablet_manager.cc:1929] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.332716 16372 log.cc:1199] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/72ff369b973b4c5981ea0810e37e8562
I20251025 08:02:28.333009 16372 ts_tablet_manager.cc:1950] T 72ff369b973b4c5981ea0810e37e8562 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.335014 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 01d9f6636b364e3b9192ae546422de5b (table default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]) successfully deleted
I20251025 08:02:28.335734 14722 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 1d7c262b73904f1f87188718617e38a8 (table default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056]). Expected version 5 got 0
I20251025 08:02:28.335644 16364 ts_tablet_manager.cc:1929] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.335870 16364 log.cc:1199] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/1aa4677de4604abaa2dc6e5413c616a3
I20251025 08:02:28.336011 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet e48ddcfccc1340d39d21ce94bec4bf27 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.336130 16364 ts_tablet_manager.cc:1950] T 1aa4677de4604abaa2dc6e5413c616a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.336226 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 72ff369b973b4c5981ea0810e37e8562 (table default.Table_4ed89f5fc452467d920d19caa6fb931a [id=8a0e4fe9e4544c539cb23b0279c1deaf]) successfully deleted
I20251025 08:02:28.336423 16372 tablet_replica.cc:333] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.336570 16372 raft_consensus.cc:2243] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.336719 16372 raft_consensus.cc:2272] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.337065 16372 ts_tablet_manager.cc:1916] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.337159 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 1aa4677de4604abaa2dc6e5413c616a3 (table default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]) successfully deleted
W20251025 08:02:28.337857 14713 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet ff82c6ab12c844339dd387569fb85526 because the tablet was not found. No further retry: Not found: Tablet not found: ff82c6ab12c844339dd387569fb85526
I20251025 08:02:28.338943 16372 ts_tablet_manager.cc:1929] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.339049 16372 log.cc:1199] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/e3cd7b63fa174ee192ff909f149e8b17
I20251025 08:02:28.339329 16372 ts_tablet_manager.cc:1950] T e3cd7b63fa174ee192ff909f149e8b17 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.339838 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet e3cd7b63fa174ee192ff909f149e8b17 (table default.Table_a368af9d0b8d46d78f9158b8f9949b01 [id=425e69ea7f8a407e8d22b735ee62c709]) successfully deleted
W20251025 08:02:28.340227 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet e48ddcfccc1340d39d21ce94bec4bf27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e48ddcfccc1340d39d21ce94bec4bf27 already in progress: creating tablet
I20251025 08:02:28.342329 16390 tablet_bootstrap.cc:492] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.342397 16390 ts_tablet_manager.cc:1403] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.181s user 0.002s sys 0.000s
I20251025 08:02:28.342820 16390 raft_consensus.cc:359] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.342911 16390 raft_consensus.cc:385] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.342970 16390 raft_consensus.cc:740] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.343101 16364 tablet_replica.cc:333] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.343228 16364 raft_consensus.cc:2243] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.343317 16364 raft_consensus.cc:2272] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.343421 16392 tablet_bootstrap.cc:492] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.343533 16392 ts_tablet_manager.cc:1403] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.000s
I20251025 08:02:28.343114 16390 consensus_queue.cc:260] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.343987 16392 raft_consensus.cc:359] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.344065 16392 raft_consensus.cc:385] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.344092 16392 raft_consensus.cc:740] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.344214 16392 consensus_queue.cc:260] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.344283 16390 ts_tablet_manager.cc:1434] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:28.344453 16390 tablet_bootstrap.cc:492] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.344446 16392 ts_tablet_manager.cc:1434] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.344595 16392 tablet_bootstrap.cc:492] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.345433 16390 tablet_bootstrap.cc:654] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.345479 16392 tablet_bootstrap.cc:654] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.347201 16364 ts_tablet_manager.cc:1916] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.349681 16392 tablet_bootstrap.cc:492] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.349762 16392 ts_tablet_manager.cc:1403] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:28.350389 16392 raft_consensus.cc:359] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.350483 16392 raft_consensus.cc:385] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.350517 16392 raft_consensus.cc:740] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.350611 16392 consensus_queue.cc:260] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.350853 16392 ts_tablet_manager.cc:1434] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.351015 16392 tablet_bootstrap.cc:492] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.351887 16392 tablet_bootstrap.cc:654] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.352922 16420 consensus_queue.cc:1048] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.353881 14725 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_ea3622c669ee4aa5a2b88a9e87aeadaf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.354210 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 40f70d2139534907ab929dae893c740d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
W20251025 08:02:28.354682 14725 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea3622c669ee4aa5a2b88a9e87aeadaf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.357123 16391 tablet_bootstrap.cc:492] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:28.357206 16391 ts_tablet_manager.cc:1403] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.042s user 0.002s sys 0.000s
I20251025 08:02:28.357587 16391 raft_consensus.cc:359] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.357663 16391 raft_consensus.cc:385] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.357688 16391 raft_consensus.cc:740] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.357785 16391 consensus_queue.cc:260] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.358022 16391 ts_tablet_manager.cc:1434] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.358150 16391 tablet_bootstrap.cc:492] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:28.358959 16391 tablet_bootstrap.cc:654] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.360826 16390 tablet_bootstrap.cc:492] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.360956 16390 ts_tablet_manager.cc:1403] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20251025 08:02:28.363480 16390 raft_consensus.cc:359] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.363623 16390 raft_consensus.cc:385] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.363689 16390 raft_consensus.cc:740] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.363842 16390 consensus_queue.cc:260] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.364378 14724 master_service.cc:954] ReplaceTablet: received request to replace tablet 049cc6add40d44fc9d67c89eca89ce59 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.364583 14723 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_4afe1c6e03a941df9d5f7df4a42cbc61" } new_table_name: "default.Table_9ce35c7e568f47d5923e7671f892194b" modify_external_catalogs: true
I20251025 08:02:28.364979 16364 ts_tablet_manager.cc:1929] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.365041 16364 log.cc:1199] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/5a70808199034508833e4d2e5550b29b
I20251025 08:02:28.365289 16364 ts_tablet_manager.cc:1950] T 5a70808199034508833e4d2e5550b29b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.365356 16390 ts_tablet_manager.cc:1434] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:28.365515 16390 tablet_bootstrap.cc:492] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.365828 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 5a70808199034508833e4d2e5550b29b (table default.Table_fb3af07031d2433fa1949ff417c1e03f [id=a788bc4f491d4d7580a83895797f5651]) successfully deleted
I20251025 08:02:28.366472 16390 tablet_bootstrap.cc:654] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.369520 16371 ts_tablet_manager.cc:1929] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.369598 16371 log.cc:1199] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/ff82c6ab12c844339dd387569fb85526
I20251025 08:02:28.369836 16371 ts_tablet_manager.cc:1950] T ff82c6ab12c844339dd387569fb85526 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.370910 16364 tablet_replica.cc:333] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.371033 16364 raft_consensus.cc:2243] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.371623 16391 tablet_bootstrap.cc:492] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:28.371701 16391 ts_tablet_manager.cc:1403] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20251025 08:02:28.372119 16391 raft_consensus.cc:359] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.372246 16391 raft_consensus.cc:385] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.372279 16391 raft_consensus.cc:740] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.372391 16391 consensus_queue.cc:260] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.372617 16391 ts_tablet_manager.cc:1434] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.372771 16391 tablet_bootstrap.cc:492] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:28.372802 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_a05736b7077d457181534fd09c3a1946"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.373126 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a05736b7077d457181534fd09c3a1946 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.373679 16391 tablet_bootstrap.cc:654] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.376905 16392 tablet_bootstrap.cc:492] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.376983 16392 ts_tablet_manager.cc:1403] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20251025 08:02:28.377435 16392 raft_consensus.cc:359] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.377530 16392 raft_consensus.cc:385] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.377563 16392 raft_consensus.cc:740] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.377672 16392 consensus_queue.cc:260] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.377915 16392 ts_tablet_manager.cc:1434] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.378070 16392 tablet_bootstrap.cc:492] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.377406 15909 raft_consensus.cc:493] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.378626 15909 raft_consensus.cc:515] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.378927 16392 tablet_bootstrap.cc:654] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.378950 15909 leader_election.cc:290] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.379475 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0078dd6fb0e34d01a54889326dd6dfd7" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.379604 15112 raft_consensus.cc:2468] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:28.380023 15185 leader_election.cc:304] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.380386 15384 raft_consensus.cc:2804] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.380436 15384 raft_consensus.cc:493] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.380481 15384 raft_consensus.cc:3060] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.371127 16364 raft_consensus.cc:2272] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.380923 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0078dd6fb0e34d01a54889326dd6dfd7" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.381019 14975 raft_consensus.cc:2468] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:28.381428 15384 raft_consensus.cc:515] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.381618 16364 ts_tablet_manager.cc:1916] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.381747 15384 leader_election.cc:290] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.382619 16463 tablet.cc:1722] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:28.382751 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0078dd6fb0e34d01a54889326dd6dfd7" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:28.382855 15112 raft_consensus.cc:3060] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.382860 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0078dd6fb0e34d01a54889326dd6dfd7" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:28.382951 14975 raft_consensus.cc:3060] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.383526 16425 tablet.cc:1722] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:28.383814 14975 raft_consensus.cc:2468] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:28.383817 15112 raft_consensus.cc:2468] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:28.384267 15183 leader_election.cc:304] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.385313 15909 raft_consensus.cc:2804] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.385396 15909 raft_consensus.cc:697] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:28.385514 15909 consensus_queue.cc:237] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.387594 16415 tablet.cc:1722] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:28.389243 16371 tablet_replica.cc:333] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.390219 16199 raft_consensus.cc:493] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.390291 16199 raft_consensus.cc:515] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.390578 16199 leader_election.cc:290] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
W20251025 08:02:28.392480 14712 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet eed2815efb7e46dd8b41f5ffe60daee8 because the tablet was not found. No further retry: Not found: Tablet not found: eed2815efb7e46dd8b41f5ffe60daee8
I20251025 08:02:28.393797 16392 tablet_bootstrap.cc:492] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.393877 16392 ts_tablet_manager.cc:1403] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20251025 08:02:28.394346 16392 raft_consensus.cc:359] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.394440 16392 raft_consensus.cc:385] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.394469 16390 tablet_bootstrap.cc:492] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.394469 16392 raft_consensus.cc:740] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.394536 16390 ts_tablet_manager.cc:1403] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20251025 08:02:28.394573 16392 consensus_queue.cc:260] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.394806 16392 ts_tablet_manager.cc:1434] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.394958 16392 tablet_bootstrap.cc:492] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.394923 16390 raft_consensus.cc:359] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.395012 16390 raft_consensus.cc:385] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.395040 16390 raft_consensus.cc:740] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.395134 16390 consensus_queue.cc:260] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.395377 16390 ts_tablet_manager.cc:1434] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.395527 16390 tablet_bootstrap.cc:492] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.395586 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40f70d2139534907ab929dae893c740d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.395808 16392 tablet_bootstrap.cc:654] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.395938 16371 raft_consensus.cc:2243] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.396098 16371 raft_consensus.cc:2272] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.396358 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "40f70d2139534907ab929dae893c740d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.396466 16390 tablet_bootstrap.cc:654] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:28.396669 15183 leader_election.cc:343] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.397125 16371 ts_tablet_manager.cc:1916] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:28.399060 15185 leader_election.cc:343] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.399122 15185 leader_election.cc:304] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.399360 15909 raft_consensus.cc:2749] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.400951 16391 tablet_bootstrap.cc:492] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:28.401026 16391 ts_tablet_manager.cc:1403] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20251025 08:02:28.401409 16391 raft_consensus.cc:359] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.401484 16391 raft_consensus.cc:385] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.401508 16391 raft_consensus.cc:740] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.401605 16391 consensus_queue.cc:260] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.401949 14727 master_service.cc:954] ReplaceTablet: received request to replace tablet 1d7c262b73904f1f87188718617e38a8 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.406155 16391 ts_tablet_manager.cc:1434] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:28.406481 16391 tablet_bootstrap.cc:492] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:28.407291 16391 tablet_bootstrap.cc:654] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.409658 16391 tablet_bootstrap.cc:492] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:28.409792 16391 ts_tablet_manager.cc:1403] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251025 08:02:28.410351 16391 raft_consensus.cc:359] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.410497 16391 raft_consensus.cc:385] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.410571 16391 raft_consensus.cc:740] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.410763 16391 consensus_queue.cc:260] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.410835 16390 tablet_bootstrap.cc:492] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.410918 16390 ts_tablet_manager.cc:1403] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251025 08:02:28.411273 16390 raft_consensus.cc:359] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.411342 16390 raft_consensus.cc:385] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.411361 16390 raft_consensus.cc:740] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.411458 16390 consensus_queue.cc:260] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.411705 16390 ts_tablet_manager.cc:1434] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:28.411976 16390 tablet_bootstrap.cc:492] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.412163 16392 tablet_bootstrap.cc:492] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.412238 16392 ts_tablet_manager.cc:1403] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20251025 08:02:28.412626 16392 raft_consensus.cc:359] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.412714 16392 raft_consensus.cc:385] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.412750 16392 raft_consensus.cc:740] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.412798 16390 tablet_bootstrap.cc:654] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.412863 16392 consensus_queue.cc:260] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.413153 16392 ts_tablet_manager.cc:1434] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.413332 16392 tablet_bootstrap.cc:492] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.414397 16392 tablet_bootstrap.cc:654] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.415923 16391 ts_tablet_manager.cc:1434] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20251025 08:02:28.416371 14725 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_790e5db826364329bab9f939b28fc2a0" } new_table_name: "default.Table_5bc70f62257c438bb0c52926674f2bdf" modify_external_catalogs: true
I20251025 08:02:28.418613 16391 tablet_bootstrap.cc:492] T 53f89ab2ef9b4136812cb4a320a645a6 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:28.419713 16391 tablet_bootstrap.cc:654] T 53f89ab2ef9b4136812cb4a320a645a6 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.422032 15374 raft_consensus.cc:493] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.422005 14721 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_ad3dee0a2af74757a17bc9fd115a69cb" } modify_external_catalogs: true
I20251025 08:02:28.422103 15374 raft_consensus.cc:515] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.422125 14721 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_ad3dee0a2af74757a17bc9fd115a69cb" } modify_external_catalogs: true
I20251025 08:02:28.422489 15374 leader_election.cc:290] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:28.423215 14914 leader_election.cc:343] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: 3faddc4af6ef4019be369ceb023cbc9d
W20251025 08:02:28.423846 14915 leader_election.cc:343] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 3faddc4af6ef4019be369ceb023cbc9d
I20251025 08:02:28.423918 14915 leader_election.cc:304] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:28.424146 15374 raft_consensus.cc:2749] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.426898 14721 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 8e0cc372400447b48e5fecfc009a11c2
W20251025 08:02:28.427091 14725 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bfdc6022cc5747439edcb8aa865b9437 has no consensus state
I20251025 08:02:28.427651 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 8e0cc372400447b48e5fecfc009a11c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.427800 16372 tablet_replica.cc:333] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.427902 16372 raft_consensus.cc:2243] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.428113 16372 raft_consensus.cc:2272] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.428239 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 8e0cc372400447b48e5fecfc009a11c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.428176 14721 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_200a2632d13848d3b5877ca9f7cb8daa" } modify_external_catalogs: true
I20251025 08:02:28.428393 14721 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_200a2632d13848d3b5877ca9f7cb8daa" } modify_external_catalogs: true
I20251025 08:02:28.428491 16372 ts_tablet_manager.cc:1916] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.429495 16371 ts_tablet_manager.cc:1929] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:28.429556 16371 log.cc:1199] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/071220f7bd334f5aad733209193244d4
I20251025 08:02:28.429790 16371 ts_tablet_manager.cc:1950] T 071220f7bd334f5aad733209193244d4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.430334 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet 8e0cc372400447b48e5fecfc009a11c2 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.430967 16364 ts_tablet_manager.cc:1929] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.431030 16364 log.cc:1199] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/1ee00271d2354ae38dcb5a3289cea72f
I20251025 08:02:28.431262 16364 ts_tablet_manager.cc:1950] T 1ee00271d2354ae38dcb5a3289cea72f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.431813 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 1ee00271d2354ae38dcb5a3289cea72f (table default.Table_8fd6304d02a6478fa31556344ab157ae [id=1ee33ee129d749d0bd7f26dc49fca0fe]) successfully deleted
I20251025 08:02:28.433151 16372 ts_tablet_manager.cc:1929] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.433279 16372 log.cc:1199] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/8e0cc372400447b48e5fecfc009a11c2
I20251025 08:02:28.433593 16372 ts_tablet_manager.cc:1950] T 8e0cc372400447b48e5fecfc009a11c2 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.434015 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 8e0cc372400447b48e5fecfc009a11c2 (table default.Table_ad3dee0a2af74757a17bc9fd115a69cb [id=e9162dd5a2524394b1cb11594293de96]) successfully deleted
W20251025 08:02:28.434567 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 04d3488a6b814223b742f0d5c946362f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04d3488a6b814223b742f0d5c946362f already in progress: creating tablet
I20251025 08:02:28.434785 16364 tablet_replica.cc:333] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.434944 16364 raft_consensus.cc:2243] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.435262 16364 raft_consensus.cc:2272] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.436720 16391 tablet_bootstrap.cc:492] T 53f89ab2ef9b4136812cb4a320a645a6 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:28.436846 16391 ts_tablet_manager.cc:1403] T 53f89ab2ef9b4136812cb4a320a645a6 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251025 08:02:28.437265 14725 master_service.cc:954] ReplaceTablet: received request to replace tablet 821de6815eb244058f1d8a7a06bf48a6 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.437307 16391 raft_consensus.cc:359] T 53f89ab2ef9b4136812cb4a320a645a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.437383 16391 raft_consensus.cc:385] T 53f89ab2ef9b4136812cb4a320a645a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.437419 16391 raft_consensus.cc:740] T 53f89ab2ef9b4136812cb4a320a645a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.437528 16391 consensus_queue.cc:260] T 53f89ab2ef9b4136812cb4a320a645a6 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.437505 15642 consensus_queue.cc:1048] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.438235 16390 tablet_bootstrap.cc:492] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.438306 16390 ts_tablet_manager.cc:1403] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20251025 08:02:28.438717 16390 raft_consensus.cc:359] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.438803 16390 raft_consensus.cc:385] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.438833 16390 raft_consensus.cc:740] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.438961 16390 consensus_queue.cc:260] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.439232 16390 ts_tablet_manager.cc:1434] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.439371 16390 tablet_bootstrap.cc:492] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.440353 16390 tablet_bootstrap.cc:654] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.442742 14718 master_service.cc:954] ReplaceTablet: received request to replace tablet 0f55c551037a4619808e18e461940d6d from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.443717 16391 ts_tablet_manager.cc:1434] T 53f89ab2ef9b4136812cb4a320a645a6 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20251025 08:02:28.446079 16392 tablet_bootstrap.cc:492] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.446162 16392 ts_tablet_manager.cc:1403] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20251025 08:02:28.446636 16392 raft_consensus.cc:359] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:28.446691 14914 consensus_peers.cc:597] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2091a81ad64a4574b04c081bdeceda1f. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.446729 16392 raft_consensus.cc:385] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.446764 16392 raft_consensus.cc:740] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.446872 16392 consensus_queue.cc:260] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.447136 16392 ts_tablet_manager.cc:1434] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.447316 16392 tablet_bootstrap.cc:492] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.448061 15380 raft_consensus.cc:493] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.448130 15380 raft_consensus.cc:515] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.448225 16392 tablet_bootstrap.cc:654] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.448418 15380 leader_election.cc:290] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.449611 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "221f4c5432bc45e18728f5ed1453ad0f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:28.450019 15048 leader_election.cc:343] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.450448 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "221f4c5432bc45e18728f5ed1453ad0f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.450961 16364 ts_tablet_manager.cc:1916] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:28.451610 15049 leader_election.cc:343] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.451668 15049 leader_election.cc:304] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:28.451810 15642 raft_consensus.cc:2749] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.449612 16391 tablet_bootstrap.cc:492] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:28.452488 14914 consensus_peers.cc:597] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 76a906654cc44bfb96d9e1a936040e57. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.453287 16391 tablet_bootstrap.cc:654] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.455466 16390 tablet_bootstrap.cc:492] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.455547 16390 ts_tablet_manager.cc:1403] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20251025 08:02:28.455999 16390 raft_consensus.cc:359] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.456089 16390 raft_consensus.cc:385] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.456121 16390 raft_consensus.cc:740] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.456223 16390 consensus_queue.cc:260] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.456497 16390 ts_tablet_manager.cc:1434] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.456676 16390 tablet_bootstrap.cc:492] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.461511 16390 tablet_bootstrap.cc:654] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.462865 15497 consensus_queue.cc:1048] T 64ebf3a6aca8403fa811202af7e3fe01 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.464048 14720 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_521f904aba4a4b309e9864df54df659d" } modify_external_catalogs: true
I20251025 08:02:28.464155 14720 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_521f904aba4a4b309e9864df54df659d" } modify_external_catalogs: true
I20251025 08:02:28.465147 14726 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_28c1103af6dc4e96a63ed0c2a0c2cbde"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.465488 14726 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_28c1103af6dc4e96a63ed0c2a0c2cbde in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.466295 15497 raft_consensus.cc:493] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.466375 15497 raft_consensus.cc:515] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.466671 15497 leader_election.cc:290] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.466969 14725 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 821de6815eb244058f1d8a7a06bf48a6
I20251025 08:02:28.467125 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a25116c3ecda411bb480cc47a3ca6bf5" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.467212 14725 catalog_manager.cc:6719] ReplaceTablet: tablet 821de6815eb244058f1d8a7a06bf48a6 deleted and replaced by tablet a2b8efa8ed634583b7bf7cc91bfc61a3
I20251025 08:02:28.467231 15238 raft_consensus.cc:2468] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:28.467888 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 821de6815eb244058f1d8a7a06bf48a6 with delete_type TABLET_DATA_DELETED (replaced by tablet a2b8efa8ed634583b7bf7cc91bfc61a3) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.468032 16372 tablet_replica.cc:333] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.468132 16372 raft_consensus.cc:2243] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.468222 16372 raft_consensus.cc:2272] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.468542 16372 ts_tablet_manager.cc:1916] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.469271 16390 tablet_bootstrap.cc:492] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.469342 16390 ts_tablet_manager.cc:1403] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20251025 08:02:28.469810 16390 raft_consensus.cc:359] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.469900 16390 raft_consensus.cc:385] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.469971 16390 raft_consensus.cc:740] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.470079 16390 consensus_queue.cc:260] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.470366 16390 ts_tablet_manager.cc:1434] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20251025 08:02:28.470465 14915 consensus_peers.cc:597] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88efe498fb6f4ce1a02b5389ff6f5797. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.470533 16390 tablet_bootstrap.cc:492] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.470774 15049 leader_election.cc:304] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.470909 15380 consensus_queue.cc:1048] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.471110 15380 raft_consensus.cc:2804] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.471151 15380 raft_consensus.cc:493] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.471186 15380 raft_consensus.cc:3060] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.471448 16390 tablet_bootstrap.cc:654] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.471973 15380 raft_consensus.cc:515] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.472252 15380 leader_election.cc:290] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.472558 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 821de6815eb244058f1d8a7a06bf48a6 with delete_type TABLET_DATA_DELETED (replaced by tablet a2b8efa8ed634583b7bf7cc91bfc61a3) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.472844 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet 821de6815eb244058f1d8a7a06bf48a6 with delete_type TABLET_DATA_DELETED (replaced by tablet a2b8efa8ed634583b7bf7cc91bfc61a3) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.473002 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a25116c3ecda411bb480cc47a3ca6bf5" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:28.473091 15239 raft_consensus.cc:3060] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.473325 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a25116c3ecda411bb480cc47a3ca6bf5" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.473388 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a25116c3ecda411bb480cc47a3ca6bf5" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:28.473431 14975 raft_consensus.cc:2468] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:28.473742 15384 raft_consensus.cc:493] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.473809 15384 raft_consensus.cc:515] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.474119 15239 raft_consensus.cc:2468] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:28.474139 15384 leader_election.cc:290] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.474783 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e0ce41dddc54e8d90a7f84d924d200b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.474947 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e0ce41dddc54e8d90a7f84d924d200b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.475036 14720 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 7b8d94fc010046c7b37804f168471904
I20251025 08:02:28.475046 15112 raft_consensus.cc:2468] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:28.475315 15185 leader_election.cc:304] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.475536 15384 raft_consensus.cc:2804] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.475589 15384 raft_consensus.cc:493] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.475626 15384 raft_consensus.cc:3060] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.476159 15049 leader_election.cc:304] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.476328 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 7b8d94fc010046c7b37804f168471904 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.476454 15497 raft_consensus.cc:2804] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.476526 15497 raft_consensus.cc:697] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:28.476526 15384 raft_consensus.cc:515] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.476634 15497 consensus_queue.cc:237] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.476823 15384 leader_election.cc:290] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.477360 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e0ce41dddc54e8d90a7f84d924d200b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:28.477445 15112 raft_consensus.cc:3060] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.478315 15112 raft_consensus.cc:2468] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:28.478580 15185 leader_election.cc:304] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.478724 15384 raft_consensus.cc:2804] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.478806 15384 raft_consensus.cc:697] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:28.478914 15384 consensus_queue.cc:237] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.479261 16199 raft_consensus.cc:493] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.479326 16199 raft_consensus.cc:515] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.479642 16199 leader_election.cc:290] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.482311 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcc08d74df2d46c58ca27f5d467e060f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
W20251025 08:02:28.482627 15185 leader_election.cc:343] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.485316 14726 master_service.cc:954] ReplaceTablet: received request to replace tablet e4f92b0605754327883b144fb6c96aea from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.486689 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet 7b8d94fc010046c7b37804f168471904 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.487288 16372 ts_tablet_manager.cc:1929] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.487362 16372 log.cc:1199] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/821de6815eb244058f1d8a7a06bf48a6
I20251025 08:02:28.487600 16372 ts_tablet_manager.cc:1950] T 821de6815eb244058f1d8a7a06bf48a6 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.488121 16372 tablet_replica.cc:333] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.488265 16372 raft_consensus.cc:2243] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
W20251025 08:02:28.488411 15183 leader_election.cc:343] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.488448 16372 raft_consensus.cc:2272] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.488821 14726 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet e4f92b0605754327883b144fb6c96aea
I20251025 08:02:28.488821 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6e0ce41dddc54e8d90a7f84d924d200b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:28.488883 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcc08d74df2d46c58ca27f5d467e060f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.489066 14726 catalog_manager.cc:6719] ReplaceTablet: tablet e4f92b0605754327883b144fb6c96aea deleted and replaced by tablet d162f3ee21bd40ce9a9c74b7863a3878
I20251025 08:02:28.489346 16372 ts_tablet_manager.cc:1916] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.489545 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 821de6815eb244058f1d8a7a06bf48a6 (table default.Table_c485105a684f427295b74968c29fd30c [id=3abb3c7d3dd74d408db083bf0499f679]) successfully deleted
I20251025 08:02:28.489704 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 7b8d94fc010046c7b37804f168471904 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.491255 16372 ts_tablet_manager.cc:1929] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.491345 16372 log.cc:1199] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/7b8d94fc010046c7b37804f168471904
I20251025 08:02:28.491582 16372 ts_tablet_manager.cc:1950] T 7b8d94fc010046c7b37804f168471904 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.491943 14725 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_782772638c3646fea7dfa5ecc8e01959" } new_table_name: "default.Table_6ee3473814d74349aedfe729d2e692e0" modify_external_catalogs: true
I20251025 08:02:28.492271 14720 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_0762822d85ed47bc93809bd77c712935"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.492600 14720 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0762822d85ed47bc93809bd77c712935 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.492959 14726 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_cce271e6706043dabfbd2c4b55bf198b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.493297 14726 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cce271e6706043dabfbd2c4b55bf198b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:28.493726 14915 consensus_peers.cc:597] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3cd7b63fa174ee192ff909f149e8b17. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.493921 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet e4f92b0605754327883b144fb6c96aea with delete_type TABLET_DATA_DELETED (replaced by tablet d162f3ee21bd40ce9a9c74b7863a3878) from {username='slave'} at 127.0.0.1:41754
W20251025 08:02:28.494307 14914 consensus_peers.cc:597] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a0a2af3ed1f41fea41962db52cfe7d8. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.494292 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet e4f92b0605754327883b144fb6c96aea with delete_type TABLET_DATA_DELETED (replaced by tablet d162f3ee21bd40ce9a9c74b7863a3878) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.495345 15374 consensus_queue.cc:1048] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.496031 15497 consensus_queue.cc:1048] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:28.496580 15183 leader_election.cc:343] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:28.496730 15183 leader_election.cc:343] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.496773 15183 leader_election.cc:304] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.496919 15909 raft_consensus.cc:2749] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.497408 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet e4f92b0605754327883b144fb6c96aea with delete_type TABLET_DATA_DELETED (replaced by tablet d162f3ee21bd40ce9a9c74b7863a3878) from {username='slave'} at 127.0.0.1:42694
W20251025 08:02:28.503126 14915 consensus_peers.cc:597] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 821de6815eb244058f1d8a7a06bf48a6. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.503278 15380 raft_consensus.cc:493] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.503347 15380 raft_consensus.cc:515] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.503631 15380 leader_election.cc:290] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.504125 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1bd788e8b38b401a89cbc250b3695088" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.504273 14979 raft_consensus.cc:2393] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:28.504395 14725 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_bb8443c590c54dea9dd2e448f2380697" } modify_external_catalogs: true
I20251025 08:02:28.504488 14725 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_bb8443c590c54dea9dd2e448f2380697" } modify_external_catalogs: true
W20251025 08:02:28.504480 15049 leader_election.cc:343] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: 1bd788e8b38b401a89cbc250b3695088
I20251025 08:02:28.504690 15048 leader_election.cc:304] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:28.504873 15380 raft_consensus.cc:3060] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.505671 14720 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_6ae5d8954fba433fa72fd9cbaa925f2a" } new_table_name: "default.Table_889a72b0cc55456889c7b37190901b20" modify_external_catalogs: true
I20251025 08:02:28.505714 15380 raft_consensus.cc:2749] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.507294 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 7b8d94fc010046c7b37804f168471904 (table default.Table_521f904aba4a4b309e9864df54df659d [id=a95abf5644c64177afde71baad186bca]) successfully deleted
I20251025 08:02:28.508001 15112 raft_consensus.cc:1275] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer ab02c9d78a9d42f193755d436c8d44b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:28.508479 15374 consensus_queue.cc:1048] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.508788 14726 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_35b83947962a41b7be7d363c364404d4" } new_table_name: "default.Table_f2e0f883fa4646a0aa3e785a7de7f152" modify_external_catalogs: true
I20251025 08:02:28.513157 16372 tablet_replica.cc:333] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.513409 14720 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_b3ddde442f824bc6986a5d2e95a6b069"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.513687 14720 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b3ddde442f824bc6986a5d2e95a6b069 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.515791 16372 raft_consensus.cc:2243] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.515945 16372 raft_consensus.cc:2272] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.516397 16372 ts_tablet_manager.cc:1916] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.518393 16372 ts_tablet_manager.cc:1929] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.518504 16372 log.cc:1199] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/e4f92b0605754327883b144fb6c96aea
I20251025 08:02:28.518849 16372 ts_tablet_manager.cc:1950] T e4f92b0605754327883b144fb6c96aea P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.519611 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet e4f92b0605754327883b144fb6c96aea (table default.Table_eaf82018b440497e86dbf2cfdd3785e5 [id=2ef2d72066f446619f9045da34df7814]) successfully deleted
I20251025 08:02:28.520828 16415 tablet.cc:1722] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:28.521206 14726 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b7ff0b4596944f38ae9325a95167c287 consensus state has no leader
I20251025 08:02:28.521448 14726 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_035b154aa0234ef38415962cb9359b93" } modify_external_catalogs: true
I20251025 08:02:28.521595 14726 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_035b154aa0234ef38415962cb9359b93" } modify_external_catalogs: true
I20251025 08:02:28.521955 16425 tablet.cc:1722] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:28.525719 14720 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_9f939300bcf646508b4f05ea510f6679"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.525843 16199 raft_consensus.cc:493] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.525929 16199 raft_consensus.cc:515] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:28.526237 14720 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9f939300bcf646508b4f05ea510f6679 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.526368 16199 leader_election.cc:290] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.527233 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f55c551037a4619808e18e461940d6d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.527323 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f55c551037a4619808e18e461940d6d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
W20251025 08:02:28.527612 15185 leader_election.cc:343] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:28.527848 15183 leader_election.cc:343] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.527909 15183 leader_election.cc:304] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.528199 15909 raft_consensus.cc:2749] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.535444 14720 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_f84103a22819458c976f0d1ca4716b47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.535795 14720 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f84103a22819458c976f0d1ca4716b47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.538043 16199 raft_consensus.cc:493] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.538132 16199 raft_consensus.cc:515] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.538511 16199 leader_election.cc:290] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.538933 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c59083b54df24c21a3114c34a73dd638" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
W20251025 08:02:28.539471 15185 leader_election.cc:343] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.539776 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c59083b54df24c21a3114c34a73dd638" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:28.540122 15183 leader_election.cc:343] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.540181 15183 leader_election.cc:304] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.540560 16199 raft_consensus.cc:2749] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.541680 16425 tablet.cc:1722] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:28.542032 16415 tablet.cc:1722] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:28.543970 14720 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_fa7f3472406144b795d1ec3e8669bf04"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.544337 14720 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa7f3472406144b795d1ec3e8669bf04 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:28.547932 14915 consensus_peers.cc:597] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4f92b0605754327883b144fb6c96aea. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.547932 15909 consensus_queue.cc:1048] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.556411 14720 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_a4db03b0afac4934abd7b889be3d9f30"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.556833 14720 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4db03b0afac4934abd7b889be3d9f30 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.564301 14722 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 1d7c262b73904f1f87188718617e38a8 (table default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056]). Expected version 5 got 0
I20251025 08:02:28.564317 14719 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 0078dd6fb0e34d01a54889326dd6dfd7 (table default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b]). Expected version 1 got 0
I20251025 08:02:28.567065 14719 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_78daee932a6e4b46b0271ad11e4715c8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.567363 14719 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78daee932a6e4b46b0271ad11e4715c8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.569648 15384 consensus_queue.cc:1048] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:28.574368 14711 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet b7ff0b4596944f38ae9325a95167c287 (table default.Table_f2e0f883fa4646a0aa3e785a7de7f152 [id=ea0a64fc70c84a7eb2b7c8e8e4a933fe], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b7ff0b4596944f38ae9325a95167c287 consensus state has no leader
I20251025 08:02:28.575759 14718 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 0f55c551037a4619808e18e461940d6d
I20251025 08:02:28.576013 14718 catalog_manager.cc:6719] ReplaceTablet: tablet 0f55c551037a4619808e18e461940d6d deleted and replaced by tablet bea55cdfbf454d76920806886c3d2c4e
I20251025 08:02:28.577057 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 0f55c551037a4619808e18e461940d6d with delete_type TABLET_DATA_DELETED (replaced by tablet bea55cdfbf454d76920806886c3d2c4e) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.577253 14725 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4
I20251025 08:02:28.577842 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.577977 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet 0f55c551037a4619808e18e461940d6d with delete_type TABLET_DATA_DELETED (replaced by tablet bea55cdfbf454d76920806886c3d2c4e) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.578101 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.579059 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 0f55c551037a4619808e18e461940d6d with delete_type TABLET_DATA_DELETED (replaced by tablet bea55cdfbf454d76920806886c3d2c4e) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.579181 15087 tablet_service.cc:1552] Processing DeleteTablet for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.580922 16199 raft_consensus.cc:493] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.581017 16199 raft_consensus.cc:515] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.581346 16199 leader_election.cc:290] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.581740 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93779f31ade9494f9056cc15665efb0d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.581866 15111 raft_consensus.cc:2468] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:28.583781 15185 leader_election.cc:304] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.584082 15909 raft_consensus.cc:2804] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.584134 15909 raft_consensus.cc:493] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.584172 15909 raft_consensus.cc:3060] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.585204 15909 raft_consensus.cc:515] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.585531 15909 leader_election.cc:290] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.587656 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93779f31ade9494f9056cc15665efb0d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.587738 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93779f31ade9494f9056cc15665efb0d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:28.587785 14975 raft_consensus.cc:2468] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:28.587822 15112 raft_consensus.cc:3060] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.588362 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93779f31ade9494f9056cc15665efb0d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:28.588459 14974 raft_consensus.cc:3060] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.588701 15112 raft_consensus.cc:2468] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:28.589018 15185 leader_election.cc:304] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.589159 16199 raft_consensus.cc:2804] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.589237 16199 raft_consensus.cc:697] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:28.589355 16199 consensus_queue.cc:237] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.589500 14974 raft_consensus.cc:2468] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:28.585079 14721 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 3f5cff308fc9448db40b0d4df03c69bb
I20251025 08:02:28.590503 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 3f5cff308fc9448db40b0d4df03c69bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.591215 14724 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 049cc6add40d44fc9d67c89eca89ce59
I20251025 08:02:28.591434 14724 catalog_manager.cc:6719] ReplaceTablet: tablet 049cc6add40d44fc9d67c89eca89ce59 deleted and replaced by tablet 6dd0f695a2904df5b750b45782a21ce2
I20251025 08:02:28.591915 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 3f5cff308fc9448db40b0d4df03c69bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.592473 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 049cc6add40d44fc9d67c89eca89ce59 with delete_type TABLET_DATA_DELETED (replaced by tablet 6dd0f695a2904df5b750b45782a21ce2) from {username='slave'} at 127.0.0.1:41754
W20251025 08:02:28.579720 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 0f55c551037a4619808e18e461940d6d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0f55c551037a4619808e18e461940d6d already in progress: creating tablet
W20251025 08:02:28.593220 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 already in progress: creating tablet
I20251025 08:02:28.593555 15087 tablet_service.cc:1552] Processing DeleteTablet for tablet 3f5cff308fc9448db40b0d4df03c69bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.594020 14724 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_017a3857ee554314b8b3da6ceb795262"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.594085 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 049cc6add40d44fc9d67c89eca89ce59 with delete_type TABLET_DATA_DELETED (replaced by tablet 6dd0f695a2904df5b750b45782a21ce2) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.594283 16372 tablet_replica.cc:333] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
W20251025 08:02:28.594394 14724 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_017a3857ee554314b8b3da6ceb795262 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.594432 16372 raft_consensus.cc:2243] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.594532 16372 raft_consensus.cc:2272] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.595045 16372 ts_tablet_manager.cc:1916] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:28.595209 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 3f5cff308fc9448db40b0d4df03c69bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f5cff308fc9448db40b0d4df03c69bb already in progress: creating tablet
I20251025 08:02:28.595669 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 049cc6add40d44fc9d67c89eca89ce59 with delete_type TABLET_DATA_DELETED (replaced by tablet 6dd0f695a2904df5b750b45782a21ce2) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.597136 14727 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 1d7c262b73904f1f87188718617e38a8
I20251025 08:02:28.597455 14727 catalog_manager.cc:6719] ReplaceTablet: tablet 1d7c262b73904f1f87188718617e38a8 deleted and replaced by tablet 09fccf0770604812940dd63106f7d993
I20251025 08:02:28.597589 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 1d7c262b73904f1f87188718617e38a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 09fccf0770604812940dd63106f7d993) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.598232 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 1d7c262b73904f1f87188718617e38a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 09fccf0770604812940dd63106f7d993) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.598701 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 1d7c262b73904f1f87188718617e38a8 with delete_type TABLET_DATA_DELETED (replaced by tablet 09fccf0770604812940dd63106f7d993) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.600373 16372 ts_tablet_manager.cc:1929] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.600464 16372 log.cc:1199] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/049cc6add40d44fc9d67c89eca89ce59
I20251025 08:02:28.600692 16372 ts_tablet_manager.cc:1950] T 049cc6add40d44fc9d67c89eca89ce59 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.600729 14720 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_9ce35c7e568f47d5923e7671f892194b" } new_table_name: "default.Table_90a6f70e509d406597d257083a3d3a6a" modify_external_catalogs: true
I20251025 08:02:28.601433 16372 tablet_replica.cc:333] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.601558 16372 raft_consensus.cc:2243] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.601653 16372 raft_consensus.cc:2272] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.601712 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 049cc6add40d44fc9d67c89eca89ce59 (table default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]) successfully deleted
I20251025 08:02:28.600381 16371 tablet_replica.cc:333] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.602136 16372 ts_tablet_manager.cc:1916] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.602290 16371 raft_consensus.cc:2243] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.604038 16372 ts_tablet_manager.cc:1929] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.604174 16372 log.cc:1199] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/1d7c262b73904f1f87188718617e38a8
I20251025 08:02:28.604308 14718 catalog_manager.cc:5649] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:28.604456 16372 ts_tablet_manager.cc:1950] T 1d7c262b73904f1f87188718617e38a8 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.605036 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 1d7c262b73904f1f87188718617e38a8 (table default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056]) successfully deleted
I20251025 08:02:28.605589 15094 tablet_service.cc:1505] Processing CreateTablet for tablet d993e2350f37492bb712d145d03e8afb (DEFAULT_TABLE table=default.Table_1ccbe630ac5a41ecb7b00087172bec38 [id=1e716be545914b22887b2f7e069c41c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.605820 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d993e2350f37492bb712d145d03e8afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.606565 15218 tablet_service.cc:1505] Processing CreateTablet for tablet d993e2350f37492bb712d145d03e8afb (DEFAULT_TABLE table=default.Table_1ccbe630ac5a41ecb7b00087172bec38 [id=1e716be545914b22887b2f7e069c41c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.606809 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d993e2350f37492bb712d145d03e8afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.607916 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 399d6b0459864b1586aa99948c56baea (DEFAULT_TABLE table=default.Table_2c042f0ac6454365ae570c2cd26b31ca [id=d656394d725244dbbe22b0cfb8e4c89f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.607971 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 2562325ea1c9436a85e1d675574c0a6c (DEFAULT_TABLE table=default.Table_4ed89f5fc452467d920d19caa6fb931a [id=8a0e4fe9e4544c539cb23b0279c1deaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.608129 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399d6b0459864b1586aa99948c56baea. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.608273 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2562325ea1c9436a85e1d675574c0a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.609896 16364 ts_tablet_manager.cc:1929] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.609982 16364 log.cc:1199] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/72ff369b973b4c5981ea0810e37e8562
I20251025 08:02:28.610246 16364 ts_tablet_manager.cc:1950] T 72ff369b973b4c5981ea0810e37e8562 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.610688 15222 tablet_service.cc:1505] Processing CreateTablet for tablet 399d6b0459864b1586aa99948c56baea (DEFAULT_TABLE table=default.Table_2c042f0ac6454365ae570c2cd26b31ca [id=d656394d725244dbbe22b0cfb8e4c89f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.610738 16364 tablet_replica.cc:333] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.610738 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 2562325ea1c9436a85e1d675574c0a6c (DEFAULT_TABLE table=default.Table_4ed89f5fc452467d920d19caa6fb931a [id=8a0e4fe9e4544c539cb23b0279c1deaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.610865 16364 raft_consensus.cc:2243] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.610898 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399d6b0459864b1586aa99948c56baea. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.610965 16364 raft_consensus.cc:2272] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.611050 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2562325ea1c9436a85e1d675574c0a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.611326 16364 ts_tablet_manager.cc:1916] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.612850 16364 ts_tablet_manager.cc:1929] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.612905 16364 log.cc:1199] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/e3cd7b63fa174ee192ff909f149e8b17
I20251025 08:02:28.613143 16364 ts_tablet_manager.cc:1950] T e3cd7b63fa174ee192ff909f149e8b17 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.613164 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 72ff369b973b4c5981ea0810e37e8562 (table default.Table_4ed89f5fc452467d920d19caa6fb931a [id=8a0e4fe9e4544c539cb23b0279c1deaf]) successfully deleted
I20251025 08:02:28.613694 16364 tablet_replica.cc:333] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.613814 16364 raft_consensus.cc:2243] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.613899 16364 raft_consensus.cc:2272] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.615154 16392 tablet_bootstrap.cc:492] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.615180 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet e3cd7b63fa174ee192ff909f149e8b17 (table default.Table_a368af9d0b8d46d78f9158b8f9949b01 [id=425e69ea7f8a407e8d22b735ee62c709]) successfully deleted
I20251025 08:02:28.615250 16392 ts_tablet_manager.cc:1403] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.168s user 0.002s sys 0.000s
W20251025 08:02:28.615298 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet e48ddcfccc1340d39d21ce94bec4bf27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e48ddcfccc1340d39d21ce94bec4bf27 already in progress: creating tablet
I20251025 08:02:28.615458 16390 tablet_bootstrap.cc:492] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.615522 16390 ts_tablet_manager.cc:1403] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.145s user 0.001s sys 0.000s
I20251025 08:02:28.615676 16392 raft_consensus.cc:359] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.615785 16392 raft_consensus.cc:385] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.615818 16392 raft_consensus.cc:740] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.615902 16390 raft_consensus.cc:359] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.615938 16392 consensus_queue.cc:260] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.615988 16390 raft_consensus.cc:385] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.616019 16390 raft_consensus.cc:740] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.616112 16390 consensus_queue.cc:260] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.616219 16392 ts_tablet_manager.cc:1434] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.616333 16390 ts_tablet_manager.cc:1434] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.616391 16392 tablet_bootstrap.cc:492] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.616477 16390 tablet_bootstrap.cc:492] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.617308 16390 tablet_bootstrap.cc:654] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.617313 16392 tablet_bootstrap.cc:654] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.622686 14722 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_889a72b0cc55456889c7b37190901b20 [id=6b4ebc3c554648b48d6ea2f5916e1bad] alter complete (version 1)
I20251025 08:02:28.623684 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 4bb463fc8b104a87b5503bfc2467a23e (DEFAULT_TABLE table=default.Table_5fe5289f69bd4a458aced0607d8247fa [id=cfa501bfaffb4d95893a0cd10caedcb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.623916 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb463fc8b104a87b5503bfc2467a23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.623874 14723 catalog_manager.cc:5649] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:28.624078 14723 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 0078dd6fb0e34d01a54889326dd6dfd7 (table default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b]). Expected version 1 got 0
I20251025 08:02:28.624207 14723 catalog_manager.cc:5649] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:28.624400 14723 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]). Expected version 1 got 0
I20251025 08:02:28.624550 14723 catalog_manager.cc:5649] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:28.624783 14723 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 5a940a0698d64770bf5826d9290117b4 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]). Expected version 1 got 0
I20251025 08:02:28.625326 15091 tablet_service.cc:1505] Processing CreateTablet for tablet af5a5d2903ff4142b1f1e70dd2a7d173 (DEFAULT_TABLE table=default.Table_97dcb2270cdf4d21824166c30b3a62a9 [id=d53447a316c5438e86cdac872682b3a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.625530 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5a5d2903ff4142b1f1e70dd2a7d173. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.625563 15222 tablet_service.cc:1505] Processing CreateTablet for tablet af5a5d2903ff4142b1f1e70dd2a7d173 (DEFAULT_TABLE table=default.Table_97dcb2270cdf4d21824166c30b3a62a9 [id=d53447a316c5438e86cdac872682b3a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.625802 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5a5d2903ff4142b1f1e70dd2a7d173. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.625813 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 1dd5a31508964130828ee0367a3317ed (DEFAULT_TABLE table=default.Table_2e26e9814f71438c825c74fa33301a37 [id=cbc9424490e64b5dad8de10af69959f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.625995 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd5a31508964130828ee0367a3317ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.627543 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 4bb463fc8b104a87b5503bfc2467a23e (DEFAULT_TABLE table=default.Table_5fe5289f69bd4a458aced0607d8247fa [id=cfa501bfaffb4d95893a0cd10caedcb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.627759 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb463fc8b104a87b5503bfc2467a23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.628577 14719 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_bf6fb7de8ef24d3b823156be182558f6" } new_table_name: "default.Table_05fb668587d14b6c8f3a12bb75fa1423" modify_external_catalogs: true
I20251025 08:02:28.629204 16392 tablet_bootstrap.cc:492] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.629328 16392 ts_tablet_manager.cc:1403] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20251025 08:02:28.629769 16392 raft_consensus.cc:359] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.629848 16392 raft_consensus.cc:385] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.629873 16392 raft_consensus.cc:740] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.630014 16392 consensus_queue.cc:260] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.630527 14724 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_c52dec25e76a4fcea78b5514db2d8dce" } modify_external_catalogs: true
I20251025 08:02:28.630612 14724 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_c52dec25e76a4fcea78b5514db2d8dce" } modify_external_catalogs: true
I20251025 08:02:28.631315 15087 tablet_service.cc:1505] Processing CreateTablet for tablet cfe9add2f8bf450bb6f49ad57be2caae (DEFAULT_TABLE table=default.Table_035b154aa0234ef38415962cb9359b93 [id=184e7b89a0ad431f87984b6d6619058e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.631578 15218 tablet_service.cc:1505] Processing CreateTablet for tablet cfe9add2f8bf450bb6f49ad57be2caae (DEFAULT_TABLE table=default.Table_035b154aa0234ef38415962cb9359b93 [id=184e7b89a0ad431f87984b6d6619058e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.631768 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe9add2f8bf450bb6f49ad57be2caae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.631780 15222 tablet_service.cc:1505] Processing CreateTablet for tablet 1dd5a31508964130828ee0367a3317ed (DEFAULT_TABLE table=default.Table_2e26e9814f71438c825c74fa33301a37 [id=cbc9424490e64b5dad8de10af69959f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.631980 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd5a31508964130828ee0367a3317ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.633317 16392 ts_tablet_manager.cc:1434] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:28.633659 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe9add2f8bf450bb6f49ad57be2caae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.634971 16392 tablet_bootstrap.cc:492] T c59083b54df24c21a3114c34a73dd638 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.636260 16392 tablet_bootstrap.cc:654] T c59083b54df24c21a3114c34a73dd638 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.605819 14958 tablet_service.cc:1505] Processing CreateTablet for tablet d993e2350f37492bb712d145d03e8afb (DEFAULT_TABLE table=default.Table_1ccbe630ac5a41ecb7b00087172bec38 [id=1e716be545914b22887b2f7e069c41c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.638103 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d993e2350f37492bb712d145d03e8afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.606820 14951 tablet_service.cc:1505] Processing CreateTablet for tablet 399d6b0459864b1586aa99948c56baea (DEFAULT_TABLE table=default.Table_2c042f0ac6454365ae570c2cd26b31ca [id=d656394d725244dbbe22b0cfb8e4c89f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.640376 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399d6b0459864b1586aa99948c56baea. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.641160 16415 tablet.cc:1722] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:28.641511 16425 tablet.cc:1722] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:28.607546 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 2562325ea1c9436a85e1d675574c0a6c (DEFAULT_TABLE table=default.Table_4ed89f5fc452467d920d19caa6fb931a [id=8a0e4fe9e4544c539cb23b0279c1deaf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.642668 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2562325ea1c9436a85e1d675574c0a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.642851 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 7e90c358ef454760b8317d78724ee377 (DEFAULT_TABLE table=default.Table_bf6fb7de8ef24d3b823156be182558f6 [id=2bee387e0d87487a8652689103a57438]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.643067 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e90c358ef454760b8317d78724ee377. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.632568 14955 tablet_service.cc:1505] Processing CreateTablet for tablet cfe9add2f8bf450bb6f49ad57be2caae (DEFAULT_TABLE table=default.Table_035b154aa0234ef38415962cb9359b93 [id=184e7b89a0ad431f87984b6d6619058e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.645716 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe9add2f8bf450bb6f49ad57be2caae. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.646749 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 7e90c358ef454760b8317d78724ee377 (DEFAULT_TABLE table=default.Table_bf6fb7de8ef24d3b823156be182558f6 [id=2bee387e0d87487a8652689103a57438]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.646972 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e90c358ef454760b8317d78724ee377. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.632844 14949 tablet_service.cc:1505] Processing CreateTablet for tablet 4bb463fc8b104a87b5503bfc2467a23e (DEFAULT_TABLE table=default.Table_5fe5289f69bd4a458aced0607d8247fa [id=cfa501bfaffb4d95893a0cd10caedcb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.647691 14949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bb463fc8b104a87b5503bfc2467a23e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.647817 15087 tablet_service.cc:1505] Processing CreateTablet for tablet d709ecb9ac9a4525985c7d2bf10719f5 (DEFAULT_TABLE table=default.Table_9d2b453ce59a456d9a0988f2bc484b6d [id=9d1a6ae0121b45cda008d5dda6ea7e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.648010 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d709ecb9ac9a4525985c7d2bf10719f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.646550 16371 raft_consensus.cc:2272] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.649150 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 7e90c358ef454760b8317d78724ee377 (DEFAULT_TABLE table=default.Table_bf6fb7de8ef24d3b823156be182558f6 [id=2bee387e0d87487a8652689103a57438]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.633038 14954 tablet_service.cc:1505] Processing CreateTablet for tablet 1dd5a31508964130828ee0367a3317ed (DEFAULT_TABLE table=default.Table_2e26e9814f71438c825c74fa33301a37 [id=cbc9424490e64b5dad8de10af69959f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.649379 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e90c358ef454760b8317d78724ee377. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.649402 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dd5a31508964130828ee0367a3317ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.633092 14957 tablet_service.cc:1505] Processing CreateTablet for tablet af5a5d2903ff4142b1f1e70dd2a7d173 (DEFAULT_TABLE table=default.Table_97dcb2270cdf4d21824166c30b3a62a9 [id=d53447a316c5438e86cdac872682b3a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.651260 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af5a5d2903ff4142b1f1e70dd2a7d173. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.651976 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 077ed236d1064a4d9a855bafabe0cdd7 (DEFAULT_TABLE table=default.Table_59553db1e7714c3b8a827e02fa059e1e [id=c2a7a02e46184b638b19f9a95da2eda8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.652181 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 077ed236d1064a4d9a855bafabe0cdd7. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:28.653563 14915 consensus_peers.cc:597] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 422e2c32a18a4e1ea9a5e371da17dfea. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.653656 16371 ts_tablet_manager.cc:1916] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.654323 16463 tablet.cc:1722] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:28.655391 15497 raft_consensus.cc:493] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.655467 15497 raft_consensus.cc:515] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.655611 16371 ts_tablet_manager.cc:1929] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.655673 16371 log.cc:1199] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/76a906654cc44bfb96d9e1a936040e57
I20251025 08:02:28.655823 15497 leader_election.cc:290] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.655921 16371 ts_tablet_manager.cc:1950] T 76a906654cc44bfb96d9e1a936040e57 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.656224 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "04d3488a6b814223b742f0d5c946362f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.656440 16371 tablet_replica.cc:333] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.656605 16371 raft_consensus.cc:2243] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
W20251025 08:02:28.656960 15049 leader_election.cc:343] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.660912 16463 tablet.cc:1722] T d14e12c45323420b84de06d828238caa P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:28.661470 15222 tablet_service.cc:1505] Processing CreateTablet for tablet d709ecb9ac9a4525985c7d2bf10719f5 (DEFAULT_TABLE table=default.Table_9d2b453ce59a456d9a0988f2bc484b6d [id=9d1a6ae0121b45cda008d5dda6ea7e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.661679 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d709ecb9ac9a4525985c7d2bf10719f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.662470 14726 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet cfe9add2f8bf450bb6f49ad57be2caae
I20251025 08:02:28.663514 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet cfe9add2f8bf450bb6f49ad57be2caae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.663549 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 62b2769c6ffc48f980ce7ed2bfa1dd75 (DEFAULT_TABLE table=default.Table_0a6ff7ae05a040c3be53115abe29f5ce [id=fb111be93abf42e9b40d60ddcf64190f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.663776 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62b2769c6ffc48f980ce7ed2bfa1dd75. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.665401 16392 tablet_bootstrap.cc:492] T c59083b54df24c21a3114c34a73dd638 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.665431 15217 tablet_service.cc:1505] Processing CreateTablet for tablet 42e8a5ee7d6a42aaaf95c33617abff3f (DEFAULT_TABLE table=default.Table_4e8f86466ebb45b787d179ddb83d55b9 [id=1f6784494d0b4b98b46077a0af6c2ea8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.665489 16392 ts_tablet_manager.cc:1403] T c59083b54df24c21a3114c34a73dd638 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20251025 08:02:28.665627 15217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e8a5ee7d6a42aaaf95c33617abff3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.665750 15216 tablet_service.cc:1505] Processing CreateTablet for tablet cb3569ec2cdd4736b264b00abf1fa36a (DEFAULT_TABLE table=default.Table_8fd6304d02a6478fa31556344ab157ae [id=1ee33ee129d749d0bd7f26dc49fca0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.665952 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3569ec2cdd4736b264b00abf1fa36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.665973 16392 raft_consensus.cc:359] T c59083b54df24c21a3114c34a73dd638 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.666056 16392 raft_consensus.cc:385] T c59083b54df24c21a3114c34a73dd638 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.666085 16392 raft_consensus.cc:740] T c59083b54df24c21a3114c34a73dd638 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.666355 15222 tablet_service.cc:1505] Processing CreateTablet for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d (DEFAULT_TABLE table=default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.666536 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.667016 16392 consensus_queue.cc:260] T c59083b54df24c21a3114c34a73dd638 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.667348 16392 ts_tablet_manager.cc:1434] T c59083b54df24c21a3114c34a73dd638 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:28.667511 16392 tablet_bootstrap.cc:492] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.668434 16392 tablet_bootstrap.cc:654] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.668627 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 42e8a5ee7d6a42aaaf95c33617abff3f (DEFAULT_TABLE table=default.Table_4e8f86466ebb45b787d179ddb83d55b9 [id=1f6784494d0b4b98b46077a0af6c2ea8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.668655 15094 tablet_service.cc:1505] Processing CreateTablet for tablet cb3569ec2cdd4736b264b00abf1fa36a (DEFAULT_TABLE table=default.Table_8fd6304d02a6478fa31556344ab157ae [id=1ee33ee129d749d0bd7f26dc49fca0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.668849 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e8a5ee7d6a42aaaf95c33617abff3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.670377 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d (DEFAULT_TABLE table=default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.670589 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.670715 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet cfe9add2f8bf450bb6f49ad57be2caae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.672433 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3569ec2cdd4736b264b00abf1fa36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.675642 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 62b2769c6ffc48f980ce7ed2bfa1dd75 (DEFAULT_TABLE table=default.Table_0a6ff7ae05a040c3be53115abe29f5ce [id=fb111be93abf42e9b40d60ddcf64190f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.675851 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62b2769c6ffc48f980ce7ed2bfa1dd75. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:28.676080 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet cfe9add2f8bf450bb6f49ad57be2caae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cfe9add2f8bf450bb6f49ad57be2caae already in progress: creating tablet
I20251025 08:02:28.676620 14726 master_service.cc:954] ReplaceTablet: received request to replace tablet 5a940a0698d64770bf5826d9290117b4 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.677011 14720 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_035df9ac9f6541dd9b042857523d0659" } modify_external_catalogs: true
I20251025 08:02:28.677340 16390 tablet_bootstrap.cc:492] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.677407 16390 ts_tablet_manager.cc:1403] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.061s user 0.001s sys 0.000s
I20251025 08:02:28.677748 16390 raft_consensus.cc:359] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.677824 16390 raft_consensus.cc:385] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.677847 16390 raft_consensus.cc:740] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.678653 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_d9fe75661236465ca4c58953ed0023c4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.678746 16390 consensus_queue.cc:260] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:28.679052 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9fe75661236465ca4c58953ed0023c4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.677122 14720 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_035df9ac9f6541dd9b042857523d0659" } modify_external_catalogs: true
I20251025 08:02:28.680842 15216 tablet_service.cc:1505] Processing CreateTablet for tablet ed5ed91e953d42afa9ebf9ab8b89d0e6 (DEFAULT_TABLE table=default.Table_a901c364849c4301910d7c32f0ec25fc [id=cadc2427db7c404cbbf9d3542145cccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.681077 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5ed91e953d42afa9ebf9ab8b89d0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.682704 16390 ts_tablet_manager.cc:1434] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:28.682672 15222 tablet_service.cc:1505] Processing CreateTablet for tablet 3c119ac81d35496cad2630c19f15ea21 (DEFAULT_TABLE table=default.Table_154bf3fb109a4052a26aed5719b8cd1d [id=73dc21342ffe4d88bcee8530555b260d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.682700 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 3c119ac81d35496cad2630c19f15ea21 (DEFAULT_TABLE table=default.Table_154bf3fb109a4052a26aed5719b8cd1d [id=73dc21342ffe4d88bcee8530555b260d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.682875 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c119ac81d35496cad2630c19f15ea21. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.682931 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c119ac81d35496cad2630c19f15ea21. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.685312 15087 tablet_service.cc:1505] Processing CreateTablet for tablet ed5ed91e953d42afa9ebf9ab8b89d0e6 (DEFAULT_TABLE table=default.Table_a901c364849c4301910d7c32f0ec25fc [id=cadc2427db7c404cbbf9d3542145cccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.685562 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5ed91e953d42afa9ebf9ab8b89d0e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:28.686370 14719 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7e90c358ef454760b8317d78724ee377 consensus state has no leader
I20251025 08:02:28.686622 14724 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet d5cd481a98514f16bed3fb0bf5003526
I20251025 08:02:28.687907 14722 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155] alter complete (version 1)
I20251025 08:02:28.688999 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet d5cd481a98514f16bed3fb0bf5003526 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.689846 15091 tablet_service.cc:1505] Processing CreateTablet for tablet bfdc6022cc5747439edcb8aa865b9437 (DEFAULT_TABLE table=default.Table_5bc70f62257c438bb0c52926674f2bdf [id=e62c2aba4e5546e2bd881c5f2ae3abd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.690094 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdc6022cc5747439edcb8aa865b9437. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:28.690534 14714 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet d5cd481a98514f16bed3fb0bf5003526 because the tablet was not found. No further retry: Not found: Tablet not found: d5cd481a98514f16bed3fb0bf5003526
I20251025 08:02:28.691062 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 31c9e3906dac487e8585daa13d3fe4b1 (DEFAULT_TABLE table=default.Table_035df9ac9f6541dd9b042857523d0659 [id=2c373de1732c4d18ad45968e90a65608]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.691087 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 31c9e3906dac487e8585daa13d3fe4b1 (DEFAULT_TABLE table=default.Table_035df9ac9f6541dd9b042857523d0659 [id=2c373de1732c4d18ad45968e90a65608]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.691273 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c9e3906dac487e8585daa13d3fe4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.691284 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c9e3906dac487e8585daa13d3fe4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.692242 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 221f4c5432bc45e18728f5ed1453ad0f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.693166 16372 tablet_replica.cc:333] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.693324 16372 raft_consensus.cc:2243] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.693358 15217 tablet_service.cc:1552] Processing DeleteTablet for tablet 221f4c5432bc45e18728f5ed1453ad0f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.693439 16372 raft_consensus.cc:2272] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.693475 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet d5cd481a98514f16bed3fb0bf5003526 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.693740 16199 consensus_queue.cc:1048] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.693924 16372 ts_tablet_manager.cc:1916] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.696062 16372 ts_tablet_manager.cc:1929] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.696135 16372 log.cc:1199] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/221f4c5432bc45e18728f5ed1453ad0f
I20251025 08:02:28.696372 16372 ts_tablet_manager.cc:1950] T 221f4c5432bc45e18728f5ed1453ad0f P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.698087 15216 tablet_service.cc:1505] Processing CreateTablet for tablet bfdc6022cc5747439edcb8aa865b9437 (DEFAULT_TABLE table=default.Table_5bc70f62257c438bb0c52926674f2bdf [id=e62c2aba4e5546e2bd881c5f2ae3abd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.698385 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdc6022cc5747439edcb8aa865b9437. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.699144 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 221f4c5432bc45e18728f5ed1453ad0f (table default.Table_4a9fc326b302473f86d8d3f7e7b8040f [id=15a38bbafe4045e9991cb846ec9e452c]) successfully deleted
I20251025 08:02:28.699204 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 1bd788e8b38b401a89cbc250b3695088 with delete_type TABLET_DATA_DELETED (replaced by tablet e106f20977444dd4a49b6e4ae0f45380) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.699344 16372 tablet_replica.cc:333] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.699465 16372 raft_consensus.cc:2243] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.699563 16372 raft_consensus.cc:2272] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.700150 16372 ts_tablet_manager.cc:1916] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.700981 16392 tablet_bootstrap.cc:492] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.701052 16392 ts_tablet_manager.cc:1403] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
I20251025 08:02:28.701110 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 077ed236d1064a4d9a855bafabe0cdd7 (DEFAULT_TABLE table=default.Table_59553db1e7714c3b8a827e02fa059e1e [id=c2a7a02e46184b638b19f9a95da2eda8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.701313 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 077ed236d1064a4d9a855bafabe0cdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.701521 16392 raft_consensus.cc:359] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.701611 16392 raft_consensus.cc:385] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.701639 16392 raft_consensus.cc:740] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.701740 16392 consensus_queue.cc:260] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.701926 16372 ts_tablet_manager.cc:1929] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.701973 16392 ts_tablet_manager.cc:1434] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.701996 16372 log.cc:1199] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/1bd788e8b38b401a89cbc250b3695088
I20251025 08:02:28.703693 16392 tablet_bootstrap.cc:492] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.704726 16392 tablet_bootstrap.cc:654] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.706248 16372 ts_tablet_manager.cc:1950] T 1bd788e8b38b401a89cbc250b3695088 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.708108 14722 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_8fd6304d02a6478fa31556344ab157ae" } new_table_name: "default.Table_987c3335f4514378a8db45a9f45e3c4d" modify_external_catalogs: true
I20251025 08:02:28.708174 14724 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_8c890e1813a149b88e2168cf6a19b056"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.708505 14724 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c890e1813a149b88e2168cf6a19b056 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.709570 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 1bd788e8b38b401a89cbc250b3695088 (table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]) successfully deleted
I20251025 08:02:28.710444 14719 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_0ac9d6fdd08b48f0b70da65d5f7a722a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.710472 15094 tablet_service.cc:1505] Processing CreateTablet for tablet d5cd481a98514f16bed3fb0bf5003526 (DEFAULT_TABLE table=default.Table_c52dec25e76a4fcea78b5514db2d8dce [id=a38b6f883f524f3cb829ce9a92bd7ef3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.710672 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5cd481a98514f16bed3fb0bf5003526. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:28.710712 14719 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0ac9d6fdd08b48f0b70da65d5f7a722a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.711700 16390 tablet_bootstrap.cc:492] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.712436 16390 tablet_bootstrap.cc:654] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.713929 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 0488062b11994f03a1af2e52db492977 (DEFAULT_TABLE table=default.Table_329a467cbe4b499c90505c8fd924ddc8 [id=194a3dd184f4450da0604a85ace48fe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.714228 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0488062b11994f03a1af2e52db492977. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.715406 14721 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_4ed89f5fc452467d920d19caa6fb931a" } new_table_name: "default.Table_beff096618394ac1b31db74a94a9f991" modify_external_catalogs: true
I20251025 08:02:28.718150 14725 master_service.cc:954] ReplaceTablet: received request to replace tablet e762c440cb0947deb7e6a4186deebdc1 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.718421 15497 raft_consensus.cc:493] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.718488 15497 raft_consensus.cc:515] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.718782 15497 leader_election.cc:290] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.719499 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9a7f96be1e2427bb0c4e109c6bac400" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.719658 15094 tablet_service.cc:1505] Processing CreateTablet for tablet a941ba28528d41699390e9db80f25594 (DEFAULT_TABLE table=default.Table_c3c319cac2594db28f07c7266a5405ed [id=b58927a3527c45cb946d1fcc0681d6bf]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:28.719971 15049 leader_election.cc:343] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.720351 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a941ba28528d41699390e9db80f25594. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.722378 16390 tablet_bootstrap.cc:492] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.722520 16390 ts_tablet_manager.cc:1403] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251025 08:02:28.722918 16390 raft_consensus.cc:359] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.723122 16390 raft_consensus.cc:385] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.723158 16390 raft_consensus.cc:740] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.723342 16390 consensus_queue.cc:260] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.724558 15222 tablet_service.cc:1505] Processing CreateTablet for tablet a941ba28528d41699390e9db80f25594 (DEFAULT_TABLE table=default.Table_c3c319cac2594db28f07c7266a5405ed [id=b58927a3527c45cb946d1fcc0681d6bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.724756 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a941ba28528d41699390e9db80f25594. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.726675 15094 tablet_service.cc:1505] Processing CreateTablet for tablet fb4faadd4fc146a5af032ce815bd6cc4 (DEFAULT_TABLE table=default.Table_9ad25f68a3a040818a9cd919b194b424 [id=5c3e59374e02472bb347c7891cb16537]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.726886 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4faadd4fc146a5af032ce815bd6cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.727087 14727 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_7257511e2df84f9cafdd1fe1ec4a180b" } new_table_name: "default.Table_c13a8bad402148f19fcdc19766286842" modify_external_catalogs: true
I20251025 08:02:28.728256 14718 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_90a6f70e509d406597d257083a3d3a6a [id=ef3a1760f2c44935bbb79e518510905f] alter complete (version 3)
I20251025 08:02:28.728819 14718 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_d03eda3087a54490a502678eeeeeabc8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.729034 16390 ts_tablet_manager.cc:1434] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
W20251025 08:02:28.729178 14718 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d03eda3087a54490a502678eeeeeabc8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.730471 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 04d3488a6b814223b742f0d5c946362f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.731102 14726 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 5a940a0698d64770bf5826d9290117b4
I20251025 08:02:28.731364 14726 catalog_manager.cc:6719] ReplaceTablet: tablet 5a940a0698d64770bf5826d9290117b4 deleted and replaced by tablet 6cedb44483cf4f62acf52b90b6708dfb
I20251025 08:02:28.732092 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 5a940a0698d64770bf5826d9290117b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6cedb44483cf4f62acf52b90b6708dfb) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.732201 14720 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 31c9e3906dac487e8585daa13d3fe4b1
I20251025 08:02:28.732244 16372 tablet_replica.cc:333] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.732360 16372 raft_consensus.cc:2243] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.732450 16372 raft_consensus.cc:2272] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.732729 15217 tablet_service.cc:1552] Processing DeleteTablet for tablet 31c9e3906dac487e8585daa13d3fe4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.732933 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 5a940a0698d64770bf5826d9290117b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6cedb44483cf4f62acf52b90b6708dfb) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.732961 16372 ts_tablet_manager.cc:1916] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.733750 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 31c9e3906dac487e8585daa13d3fe4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.734364 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 40f70d2139534907ab929dae893c740d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.734969 16372 ts_tablet_manager.cc:1929] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.735044 16372 log.cc:1199] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/5a940a0698d64770bf5826d9290117b4
I20251025 08:02:28.735137 15216 tablet_service.cc:1505] Processing CreateTablet for tablet d5cd481a98514f16bed3fb0bf5003526 (DEFAULT_TABLE table=default.Table_c52dec25e76a4fcea78b5514db2d8dce [id=a38b6f883f524f3cb829ce9a92bd7ef3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.735287 16372 ts_tablet_manager.cc:1950] T 5a940a0698d64770bf5826d9290117b4 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.735354 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5cd481a98514f16bed3fb0bf5003526. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.735867 16372 tablet_replica.cc:333] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.735998 16372 raft_consensus.cc:2243] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.736079 16372 raft_consensus.cc:2272] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.736074 14720 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_1068ad8fb18a4d21954bb70b20fd5760"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.736219 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 5a940a0698d64770bf5826d9290117b4 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]) successfully deleted
W20251025 08:02:28.736410 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 31c9e3906dac487e8585daa13d3fe4b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31c9e3906dac487e8585daa13d3fe4b1 already in progress: creating tablet
W20251025 08:02:28.736435 14720 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1068ad8fb18a4d21954bb70b20fd5760 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.736565 16372 ts_tablet_manager.cc:1916] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.736703 16390 tablet_bootstrap.cc:492] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.737638 16390 tablet_bootstrap.cc:654] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.738654 16390 tablet_bootstrap.cc:492] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.738720 16390 ts_tablet_manager.cc:1403] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:28.738837 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 04d3488a6b814223b742f0d5c946362f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.739156 16390 raft_consensus.cc:359] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.739262 16390 raft_consensus.cc:385] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.739290 16390 raft_consensus.cc:740] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.739398 16390 consensus_queue.cc:260] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.739665 16390 ts_tablet_manager.cc:1434] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.739847 16390 tablet_bootstrap.cc:492] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.740633 16372 ts_tablet_manager.cc:1929] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.740697 16372 log.cc:1199] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/40f70d2139534907ab929dae893c740d
I20251025 08:02:28.740732 16390 tablet_bootstrap.cc:654] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.740891 16372 ts_tablet_manager.cc:1950] T 40f70d2139534907ab929dae893c740d P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.741451 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 40f70d2139534907ab929dae893c740d (table default.Table_6a66d07dc986487694277236df040244 [id=d720a49cc25f487fbfecb3771c5e5f73]) successfully deleted
I20251025 08:02:28.741626 16372 tablet_replica.cc:333] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.741721 16372 raft_consensus.cc:2243] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.741796 16372 raft_consensus.cc:2272] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.742479 15222 tablet_service.cc:1505] Processing CreateTablet for tablet fb4faadd4fc146a5af032ce815bd6cc4 (DEFAULT_TABLE table=default.Table_9ad25f68a3a040818a9cd919b194b424 [id=5c3e59374e02472bb347c7891cb16537]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.742663 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4faadd4fc146a5af032ce815bd6cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.743511 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 0488062b11994f03a1af2e52db492977 (DEFAULT_TABLE table=default.Table_329a467cbe4b499c90505c8fd924ddc8 [id=194a3dd184f4450da0604a85ace48fe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.743716 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0488062b11994f03a1af2e52db492977. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.745203 14726 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_c8ac7973eef94a68bf4ebe1459c2e6e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.745522 14726 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c8ac7973eef94a68bf4ebe1459c2e6e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.747560 16199 raft_consensus.cc:493] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.747637 16199 raft_consensus.cc:515] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.747958 16199 leader_election.cc:290] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.748209 16372 ts_tablet_manager.cc:1916] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.748347 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff20cd7d33a440bab24bd4a61fff1f30" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.656812 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "04d3488a6b814223b742f0d5c946362f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.658129 16420 consensus_queue.cc:1048] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.658381 14949 tablet_service.cc:1505] Processing CreateTablet for tablet d709ecb9ac9a4525985c7d2bf10719f5 (DEFAULT_TABLE table=default.Table_9d2b453ce59a456d9a0988f2bc484b6d [id=9d1a6ae0121b45cda008d5dda6ea7e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.749532 16463 tablet.cc:1722] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:28.749747 14949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d709ecb9ac9a4525985c7d2bf10719f5. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:28.749897 15048 leader_election.cc:343] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.749974 15048 leader_election.cc:304] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:28.750020 16390 tablet_bootstrap.cc:492] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
W20251025 08:02:28.750054 15048 raft_consensus.cc:2686] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251025 08:02:28.750092 16390 ts_tablet_manager.cc:1403] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:28.750089 16372 ts_tablet_manager.cc:1929] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.750145 16372 log.cc:1199] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/04d3488a6b814223b742f0d5c946362f
I20251025 08:02:28.750368 16372 ts_tablet_manager.cc:1950] T 04d3488a6b814223b742f0d5c946362f P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.750607 16390 raft_consensus.cc:359] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.750702 16390 raft_consensus.cc:385] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.750733 16390 raft_consensus.cc:740] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.750839 16390 consensus_queue.cc:260] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.751070 16390 ts_tablet_manager.cc:1434] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.751677 16390 tablet_bootstrap.cc:492] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.665227 14951 tablet_service.cc:1505] Processing CreateTablet for tablet cb3569ec2cdd4736b264b00abf1fa36a (DEFAULT_TABLE table=default.Table_8fd6304d02a6478fa31556344ab157ae [id=1ee33ee129d749d0bd7f26dc49fca0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.752010 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb3569ec2cdd4736b264b00abf1fa36a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.752592 16390 tablet_bootstrap.cc:654] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.665369 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet cfe9add2f8bf450bb6f49ad57be2caae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.668790 15374 consensus_queue.cc:1048] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.669235 16391 tablet_bootstrap.cc:492] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:28.669595 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 077ed236d1064a4d9a855bafabe0cdd7 (DEFAULT_TABLE table=default.Table_59553db1e7714c3b8a827e02fa059e1e [id=c2a7a02e46184b638b19f9a95da2eda8]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:28.754776 15185 leader_election.cc:343] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.754837 16391 ts_tablet_manager.cc:1403] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.305s user 0.002s sys 0.000s
I20251025 08:02:28.754956 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 077ed236d1064a4d9a855bafabe0cdd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.755332 16391 raft_consensus.cc:359] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.755414 16391 raft_consensus.cc:385] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.755441 16391 raft_consensus.cc:740] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.755538 16391 consensus_queue.cc:260] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.755798 16391 ts_tablet_manager.cc:1434] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.755971 16391 tablet_bootstrap.cc:492] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:28.756501 14914 consensus_peers.cc:597] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3cd7b63fa174ee192ff909f149e8b17. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.676637 14954 tablet_service.cc:1505] Processing CreateTablet for tablet 62b2769c6ffc48f980ce7ed2bfa1dd75 (DEFAULT_TABLE table=default.Table_0a6ff7ae05a040c3be53115abe29f5ce [id=fb111be93abf42e9b40d60ddcf64190f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.756889 16391 tablet_bootstrap.cc:654] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.756949 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62b2769c6ffc48f980ce7ed2bfa1dd75. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.758141 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 04d3488a6b814223b742f0d5c946362f (table default.Table_32f95976a4704d3fbba9e5c01cb8f9d9 [id=bdcc7cd59c78409fad7b5f687ae81310]) successfully deleted
I20251025 08:02:28.676887 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 42e8a5ee7d6a42aaaf95c33617abff3f (DEFAULT_TABLE table=default.Table_4e8f86466ebb45b787d179ddb83d55b9 [id=1f6784494d0b4b98b46077a0af6c2ea8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.759236 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42e8a5ee7d6a42aaaf95c33617abff3f. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:28.679023 14915 consensus_peers.cc:597] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72ff369b973b4c5981ea0810e37e8562. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.759354 16391 tablet_bootstrap.cc:492] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:28.759418 16391 ts_tablet_manager.cc:1403] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
W20251025 08:02:28.759387 14915 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.70.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 80378.6us
I20251025 08:02:28.683706 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d (DEFAULT_TABLE table=default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.759796 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.759814 16391 raft_consensus.cc:359] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.759894 16391 raft_consensus.cc:385] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.759922 16391 raft_consensus.cc:740] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.760054 16391 consensus_queue.cc:260] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.760311 16391 ts_tablet_manager.cc:1434] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.760463 16391 tablet_bootstrap.cc:492] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:28.761284 14979 raft_consensus.cc:3060] T 53f89ab2ef9b4136812cb4a320a645a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.684682 14950 tablet_service.cc:1505] Processing CreateTablet for tablet ed5ed91e953d42afa9ebf9ab8b89d0e6 (DEFAULT_TABLE table=default.Table_a901c364849c4301910d7c32f0ec25fc [id=cadc2427db7c404cbbf9d3542145cccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.761338 16391 tablet_bootstrap.cc:654] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.761487 14950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed5ed91e953d42afa9ebf9ab8b89d0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.762416 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff20cd7d33a440bab24bd4a61fff1f30" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.697957 14956 tablet_service.cc:1505] Processing CreateTablet for tablet bfdc6022cc5747439edcb8aa865b9437 (DEFAULT_TABLE table=default.Table_5bc70f62257c438bb0c52926674f2bdf [id=e62c2aba4e5546e2bd881c5f2ae3abd4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.763696 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdc6022cc5747439edcb8aa865b9437. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:28.764950 15183 leader_election.cc:343] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.765013 15183 leader_election.cc:304] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.765600 16199 raft_consensus.cc:2749] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.765717 16371 raft_consensus.cc:2272] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.766074 16371 ts_tablet_manager.cc:1916] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.698078 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet d5cd481a98514f16bed3fb0bf5003526 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.698312 14947 tablet_service.cc:1505] Processing CreateTablet for tablet 31c9e3906dac487e8585daa13d3fe4b1 (DEFAULT_TABLE table=default.Table_035df9ac9f6541dd9b042857523d0659 [id=2c373de1732c4d18ad45968e90a65608]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.698338 14948 tablet_service.cc:1505] Processing CreateTablet for tablet 3c119ac81d35496cad2630c19f15ea21 (DEFAULT_TABLE table=default.Table_154bf3fb109a4052a26aed5719b8cd1d [id=73dc21342ffe4d88bcee8530555b260d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.719146 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9a7f96be1e2427bb0c4e109c6bac400" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.766834 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31c9e3906dac487e8585daa13d3fe4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.721037 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 0488062b11994f03a1af2e52db492977 (DEFAULT_TABLE table=default.Table_329a467cbe4b499c90505c8fd924ddc8 [id=194a3dd184f4450da0604a85ace48fe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.767099 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0488062b11994f03a1af2e52db492977. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:28.767825 15048 leader_election.cc:343] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.767889 15048 leader_election.cc:304] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:28.768086 15497 raft_consensus.cc:2749] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.721100 14946 tablet_service.cc:1505] Processing CreateTablet for tablet d5cd481a98514f16bed3fb0bf5003526 (DEFAULT_TABLE table=default.Table_c52dec25e76a4fcea78b5514db2d8dce [id=a38b6f883f524f3cb829ce9a92bd7ef3]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:28.768747 14915 consensus_peers.cc:597] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 049cc6add40d44fc9d67c89eca89ce59. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.768784 14946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5cd481a98514f16bed3fb0bf5003526. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.769584 15909 consensus_queue.cc:1048] T 53f89ab2ef9b4136812cb4a320a645a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.770172 14948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c119ac81d35496cad2630c19f15ea21. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.723486 14945 tablet_service.cc:1505] Processing CreateTablet for tablet a941ba28528d41699390e9db80f25594 (DEFAULT_TABLE table=default.Table_c3c319cac2594db28f07c7266a5405ed [id=b58927a3527c45cb946d1fcc0681d6bf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.732622 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 5a940a0698d64770bf5826d9290117b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6cedb44483cf4f62acf52b90b6708dfb) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.734882 14943 tablet_service.cc:1552] Processing DeleteTablet for tablet 31c9e3906dac487e8585daa13d3fe4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.746169 14942 tablet_service.cc:1505] Processing CreateTablet for tablet fb4faadd4fc146a5af032ce815bd6cc4 (DEFAULT_TABLE table=default.Table_9ad25f68a3a040818a9cd919b194b424 [id=5c3e59374e02472bb347c7891cb16537]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.766647 16391 tablet_bootstrap.cc:492] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:28.771360 16391 ts_tablet_manager.cc:1403] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251025 08:02:28.771757 16391 raft_consensus.cc:359] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.771840 16391 raft_consensus.cc:385] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.771875 16391 raft_consensus.cc:740] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.771986 16391 consensus_queue.cc:260] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.772284 16391 ts_tablet_manager.cc:1434] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.772444 16391 tablet_bootstrap.cc:492] T f9a7f96be1e2427bb0c4e109c6bac400 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:28.772378 16371 ts_tablet_manager.cc:1929] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.772977 16371 log.cc:1199] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/2091a81ad64a4574b04c081bdeceda1f
I20251025 08:02:28.773350 16371 ts_tablet_manager.cc:1950] T 2091a81ad64a4574b04c081bdeceda1f P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
W20251025 08:02:28.783351 14722 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb3569ec2cdd4736b264b00abf1fa36a consensus state has no leader
I20251025 08:02:28.786139 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_19e4d10cf3d64b008591270ed9ee26f3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.786551 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19e4d10cf3d64b008591270ed9ee26f3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.794034 16392 tablet_bootstrap.cc:492] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.794137 16392 ts_tablet_manager.cc:1403] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.092s user 0.002s sys 0.000s
I20251025 08:02:28.794641 16392 raft_consensus.cc:359] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.794750 16392 raft_consensus.cc:385] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.794790 16392 raft_consensus.cc:740] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.794902 16392 consensus_queue.cc:260] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.795192 16392 ts_tablet_manager.cc:1434] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.795399 16392 tablet_bootstrap.cc:492] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.796469 16392 tablet_bootstrap.cc:654] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.797655 16392 tablet_bootstrap.cc:492] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.798434 16392 ts_tablet_manager.cc:1403] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:28.800724 16392 raft_consensus.cc:359] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.801290 16364 ts_tablet_manager.cc:1916] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.800937 16392 raft_consensus.cc:385] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.802152 16392 raft_consensus.cc:740] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.802362 16392 consensus_queue.cc:260] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.802846 16392 ts_tablet_manager.cc:1434] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20251025 08:02:28.803143 16392 tablet_bootstrap.cc:492] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.804080 15384 consensus_queue.cc:1048] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.808185 16392 tablet_bootstrap.cc:654] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.809466 16392 tablet_bootstrap.cc:492] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.809544 16392 ts_tablet_manager.cc:1403] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20251025 08:02:28.809962 16392 raft_consensus.cc:359] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.810072 16392 raft_consensus.cc:385] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.810114 16392 raft_consensus.cc:740] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.810257 16392 consensus_queue.cc:260] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.810511 16392 ts_tablet_manager.cc:1434] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:28.810676 16392 tablet_bootstrap.cc:492] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.811542 16392 tablet_bootstrap.cc:654] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.813659 16392 tablet_bootstrap.cc:492] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.814505 16392 ts_tablet_manager.cc:1403] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:28.814952 16392 raft_consensus.cc:359] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.815452 16392 raft_consensus.cc:385] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.815531 16392 raft_consensus.cc:740] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.815690 16392 consensus_queue.cc:260] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.816637 16392 ts_tablet_manager.cc:1434] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:28.816826 16392 tablet_bootstrap.cc:492] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.818110 16392 tablet_bootstrap.cc:654] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.819092 16392 tablet_bootstrap.cc:492] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.819167 16392 ts_tablet_manager.cc:1403] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:28.819569 16392 raft_consensus.cc:359] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.819654 16392 raft_consensus.cc:385] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.819682 16392 raft_consensus.cc:740] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.819787 16392 consensus_queue.cc:260] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.820037 16392 ts_tablet_manager.cc:1434] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:28.820191 16392 tablet_bootstrap.cc:492] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.822141 16392 tablet_bootstrap.cc:654] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.823249 16392 tablet_bootstrap.cc:492] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.823324 16392 ts_tablet_manager.cc:1403] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:28.823668 16392 raft_consensus.cc:359] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:28.823750 16392 raft_consensus.cc:385] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.823777 16392 raft_consensus.cc:740] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.823884 16392 consensus_queue.cc:260] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:28.824100 16392 ts_tablet_manager.cc:1434] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.824263 16392 tablet_bootstrap.cc:492] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.825068 16392 tablet_bootstrap.cc:654] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.825974 16392 tablet_bootstrap.cc:492] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.826045 16392 ts_tablet_manager.cc:1403] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:28.826459 16392 raft_consensus.cc:359] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.826550 16392 raft_consensus.cc:385] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.826584 16392 raft_consensus.cc:740] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.826686 16392 consensus_queue.cc:260] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.827135 16392 ts_tablet_manager.cc:1434] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.827355 16392 tablet_bootstrap.cc:492] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.828593 16392 tablet_bootstrap.cc:654] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.831430 14719 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]). Expected version 1 got 0
I20251025 08:02:28.831888 14719 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_1294a307080744bd964b420814ae843f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.832286 14719 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1294a307080744bd964b420814ae843f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.833271 15384 raft_consensus.cc:493] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.833352 15384 raft_consensus.cc:515] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.833705 15384 leader_election.cc:290] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.834081 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e87bae31e5e642a5a34a8c170c62fdca" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.834180 15111 raft_consensus.cc:2468] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:28.834842 15185 leader_election.cc:304] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.835796 15384 raft_consensus.cc:2804] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.835844 15384 raft_consensus.cc:493] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.835875 15384 raft_consensus.cc:3060] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.836756 15384 raft_consensus.cc:515] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.837059 15384 leader_election.cc:290] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.837618 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e87bae31e5e642a5a34a8c170c62fdca" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
W20251025 08:02:28.837677 14721 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2562325ea1c9436a85e1d675574c0a6c consensus state has no leader
I20251025 08:02:28.837723 15111 raft_consensus.cc:3060] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.838640 15111 raft_consensus.cc:2468] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:28.839228 15185 leader_election.cc:304] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.840067 15909 raft_consensus.cc:2804] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.840152 15909 raft_consensus.cc:697] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:28.840196 16199 raft_consensus.cc:493] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.840268 15909 consensus_queue.cc:237] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.840283 16199 raft_consensus.cc:515] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.840610 16199 leader_election.cc:290] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
W20251025 08:02:28.842187 15185 leader_election.cc:343] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 221f4c5432bc45e18728f5ed1453ad0f
I20251025 08:02:28.843048 14725 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet e762c440cb0947deb7e6a4186deebdc1
I20251025 08:02:28.843312 14725 catalog_manager.cc:6719] ReplaceTablet: tablet e762c440cb0947deb7e6a4186deebdc1 deleted and replaced by tablet 14b47bf733754b72b34bd74aa033afa3
I20251025 08:02:28.843472 14725 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_4a4b1eeaa5674710a1a13d7f0f395737" } modify_external_catalogs: true
I20251025 08:02:28.843567 14725 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_4a4b1eeaa5674710a1a13d7f0f395737" } modify_external_catalogs: true
I20251025 08:02:28.846607 15087 tablet_service.cc:1552] Processing DeleteTablet for tablet e762c440cb0947deb7e6a4186deebdc1 with delete_type TABLET_DATA_DELETED (replaced by tablet 14b47bf733754b72b34bd74aa033afa3) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.847056 15909 raft_consensus.cc:493] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.847129 15909 raft_consensus.cc:515] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.847429 15909 leader_election.cc:290] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
W20251025 08:02:28.847568 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet e762c440cb0947deb7e6a4186deebdc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e762c440cb0947deb7e6a4186deebdc1 already in progress: creating tablet
I20251025 08:02:28.772537 14945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a941ba28528d41699390e9db80f25594. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.848836 16371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41754 (request call id 66) took 1037 ms. Trace:
I20251025 08:02:28.848908 16371 rpcz_store.cc:276] 1025 08:02:27.810968 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:27.811011 (+ 43us) service_pool.cc:225] Handling call
1025 08:02:28.656410 (+845399us) ts_tablet_manager.cc:1151] Deleting tablet 2091a81ad64a4574b04c081bdeceda1f
1025 08:02:28.656418 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:28.770498 (+114080us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:28.772334 (+ 1836us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:28.848824 (+ 76490us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":828532}
I20251025 08:02:28.849116 16371 tablet_replica.cc:333] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.849256 16371 raft_consensus.cc:2243] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.849324 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 2091a81ad64a4574b04c081bdeceda1f (table default.Table_2931abc275064dfd818fc151a0267713 [id=87037802262e424ebe9c070b5ef7ba62]) successfully deleted
I20251025 08:02:28.849349 16371 raft_consensus.cc:2272] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.849673 16371 ts_tablet_manager.cc:1916] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.787395 16421 raft_consensus.cc:493] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.850785 16421 raft_consensus.cc:515] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.851082 16421 leader_election.cc:290] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:28.835428 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e87bae31e5e642a5a34a8c170c62fdca" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:28.841816 14915 consensus_peers.cc:597] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a0a2af3ed1f41fea41962db52cfe7d8. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.846516 14948 tablet_service.cc:1552] Processing DeleteTablet for tablet e762c440cb0947deb7e6a4186deebdc1 with delete_type TABLET_DATA_DELETED (replaced by tablet 14b47bf733754b72b34bd74aa033afa3) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.851706 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "04d3488a6b814223b742f0d5c946362f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.851822 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e87bae31e5e642a5a34a8c170c62fdca" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:28.851868 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "221f4c5432bc45e18728f5ed1453ad0f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.852136 16371 ts_tablet_manager.cc:1929] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.852217 16371 log.cc:1199] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/1bd788e8b38b401a89cbc250b3695088
I20251025 08:02:28.852349 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb4faadd4fc146a5af032ce815bd6cc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.852434 16371 ts_tablet_manager.cc:1950] T 1bd788e8b38b401a89cbc250b3695088 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.852833 16371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41754 (request call id 65) took 1056 ms. Trace:
I20251025 08:02:28.852882 16371 rpcz_store.cc:276] 1025 08:02:27.795986 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:27.799131 (+ 3145us) service_pool.cc:225] Handling call
1025 08:02:28.849090 (+1049959us) ts_tablet_manager.cc:1151] Deleting tablet 1bd788e8b38b401a89cbc250b3695088
1025 08:02:28.849096 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:28.850954 (+ 1858us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:28.852087 (+ 1133us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:28.852821 (+ 734us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1021148}
I20251025 08:02:28.853166 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 1bd788e8b38b401a89cbc250b3695088 (table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]) successfully deleted
I20251025 08:02:28.854070 14727 master_service.cc:954] ReplaceTablet: received request to replace tablet 4edf680e8d4a4b898fd6e64f8ec6f75d from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.854087 16364 ts_tablet_manager.cc:1929] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.854146 16364 log.cc:1199] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/40f70d2139534907ab929dae893c740d
W20251025 08:02:28.854334 15183 leader_election.cc:343] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.854393 16364 ts_tablet_manager.cc:1950] T 40f70d2139534907ab929dae893c740d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.854918 16364 tablet_replica.cc:333] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.855073 16364 raft_consensus.cc:2243] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
W20251025 08:02:28.855160 15185 leader_election.cc:343] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 04d3488a6b814223b742f0d5c946362f
I20251025 08:02:28.855237 16364 raft_consensus.cc:2272] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.855611 16364 ts_tablet_manager.cc:1916] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:28.855897 14915 leader_election.cc:343] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 1d7c262b73904f1f87188718617e38a8
I20251025 08:02:28.855926 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d7c262b73904f1f87188718617e38a8" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.856040 15237 raft_consensus.cc:2468] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
W20251025 08:02:28.856173 15183 leader_election.cc:343] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.856236 15183 leader_election.cc:304] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
W20251025 08:02:28.856390 15183 leader_election.cc:343] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:28.856513 15183 leader_election.cc:343] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.856552 15183 leader_election.cc:304] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.856793 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 40f70d2139534907ab929dae893c740d (table default.Table_6a66d07dc986487694277236df040244 [id=d720a49cc25f487fbfecb3771c5e5f73]) successfully deleted
I20251025 08:02:28.856979 16421 raft_consensus.cc:493] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.857067 16421 raft_consensus.cc:515] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.857175 16199 raft_consensus.cc:2749] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.857285 16199 raft_consensus.cc:2749] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:28.857409 16421 leader_election.cc:290] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:28.857900 14914 leader_election.cc:304] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.857882 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c59083b54df24c21a3114c34a73dd638" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.857990 15237 raft_consensus.cc:2468] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:28.858487 16421 raft_consensus.cc:2804] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.858537 16421 raft_consensus.cc:493] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.858568 16421 raft_consensus.cc:3060] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.859315 16421 raft_consensus.cc:515] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.859632 16421 leader_election.cc:290] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:28.859787 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet e762c440cb0947deb7e6a4186deebdc1 with delete_type TABLET_DATA_DELETED (replaced by tablet 14b47bf733754b72b34bd74aa033afa3) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.861310 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c59083b54df24c21a3114c34a73dd638" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.861413 15113 raft_consensus.cc:2468] T c59083b54df24c21a3114c34a73dd638 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:28.861853 16364 ts_tablet_manager.cc:1929] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.861919 16364 log.cc:1199] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/8e0cc372400447b48e5fecfc009a11c2
I20251025 08:02:28.861999 14914 leader_election.cc:304] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.862071 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1d7c262b73904f1f87188718617e38a8" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:28.862201 15237 raft_consensus.cc:3060] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.862287 16364 ts_tablet_manager.cc:1950] T 8e0cc372400447b48e5fecfc009a11c2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.862434 15864 raft_consensus.cc:2804] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.862476 15864 raft_consensus.cc:493] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.862529 15864 raft_consensus.cc:3060] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.862761 16364 tablet_replica.cc:333] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.862860 16364 raft_consensus.cc:2243] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.862929 16364 raft_consensus.cc:2272] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.863158 15237 raft_consensus.cc:2468] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:28.863210 16364 ts_tablet_manager.cc:1916] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.863348 16199 raft_consensus.cc:493] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.863368 15864 raft_consensus.cc:515] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.863404 16199 raft_consensus.cc:515] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.863627 15864 leader_election.cc:290] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:28.863689 16199 leader_election.cc:290] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
W20251025 08:02:28.865207 14915 leader_election.cc:343] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 1d7c262b73904f1f87188718617e38a8
I20251025 08:02:28.865253 16364 ts_tablet_manager.cc:1929] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.865310 16364 log.cc:1199] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/821de6815eb244058f1d8a7a06bf48a6
I20251025 08:02:28.865541 16364 ts_tablet_manager.cc:1950] T 821de6815eb244058f1d8a7a06bf48a6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.865660 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c59083b54df24c21a3114c34a73dd638" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:28.865746 15113 raft_consensus.cc:3060] T c59083b54df24c21a3114c34a73dd638 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.865816 16371 tablet_replica.cc:333] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.866755 15113 raft_consensus.cc:2468] T c59083b54df24c21a3114c34a73dd638 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:28.866783 16371 raft_consensus.cc:2243] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.866879 16371 raft_consensus.cc:2272] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.867411 14914 leader_election.cc:304] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:28.867602 15864 raft_consensus.cc:2804] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.867664 15864 raft_consensus.cc:697] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:28.867758 15864 consensus_queue.cc:237] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.868065 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c59083b54df24c21a3114c34a73dd638" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:28.868151 15238 raft_consensus.cc:3060] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.868585 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d84ee63450243f8910ad4bd1ec6459e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.868675 15113 raft_consensus.cc:2468] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:28.869164 14915 leader_election.cc:304] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:28.869313 16420 raft_consensus.cc:2804] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.869372 16420 raft_consensus.cc:697] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:28.869462 16420 consensus_queue.cc:237] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.870404 15185 leader_election.cc:304] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.870587 16199 raft_consensus.cc:2804] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.870643 16199 raft_consensus.cc:493] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.870674 16199 raft_consensus.cc:3060] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:28.870687 14914 consensus_peers.cc:597] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72ff369b973b4c5981ea0810e37e8562. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.871493 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 8e0cc372400447b48e5fecfc009a11c2 (table default.Table_ad3dee0a2af74757a17bc9fd115a69cb [id=e9162dd5a2524394b1cb11594293de96]) successfully deleted
I20251025 08:02:28.872109 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d84ee63450243f8910ad4bd1ec6459e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.874444 16371 ts_tablet_manager.cc:1916] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.874668 15909 raft_consensus.cc:493] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.874759 15909 raft_consensus.cc:515] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.875058 15909 leader_election.cc:290] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.876309 16371 ts_tablet_manager.cc:1929] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.876420 16371 log.cc:1199] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/8737df10a3c8482c995ac6aadc240c42
W20251025 08:02:28.876906 15183 leader_election.cc:343] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.877224 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9a7f96be1e2427bb0c4e109c6bac400" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.877847 16371 ts_tablet_manager.cc:1950] T 8737df10a3c8482c995ac6aadc240c42 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.879294 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9a7f96be1e2427bb0c4e109c6bac400" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.879410 15112 raft_consensus.cc:2468] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:28.880666 16391 tablet_bootstrap.cc:654] T f9a7f96be1e2427bb0c4e109c6bac400 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.881490 15185 leader_election.cc:304] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.881621 15909 raft_consensus.cc:2804] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.881665 15909 raft_consensus.cc:493] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.881711 15909 raft_consensus.cc:3060] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:28.882051 15183 leader_election.cc:343] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.882586 16463 tablet.cc:1722] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:28.883296 16415 tablet.cc:1722] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:28.892596 14718 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_5854b229e0af41b88196de4a1c9c0270" } modify_external_catalogs: true
I20251025 08:02:28.892741 14718 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_5854b229e0af41b88196de4a1c9c0270" } modify_external_catalogs: true
I20251025 08:02:28.895617 16391 tablet_bootstrap.cc:492] T f9a7f96be1e2427bb0c4e109c6bac400 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:28.895690 16391 ts_tablet_manager.cc:1403] T f9a7f96be1e2427bb0c4e109c6bac400 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.123s user 0.003s sys 0.000s
I20251025 08:02:28.896057 16391 raft_consensus.cc:359] T f9a7f96be1e2427bb0c4e109c6bac400 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.896142 16391 raft_consensus.cc:385] T f9a7f96be1e2427bb0c4e109c6bac400 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.896167 16391 raft_consensus.cc:740] T f9a7f96be1e2427bb0c4e109c6bac400 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.896412 16391 consensus_queue.cc:260] T f9a7f96be1e2427bb0c4e109c6bac400 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.896703 16391 ts_tablet_manager.cc:1434] T f9a7f96be1e2427bb0c4e109c6bac400 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.900264 16391 tablet_bootstrap.cc:492] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:28.901172 14720 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_14a3c11816aa4e2d93e0a9912024dbd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:28.901526 14720 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_14a3c11816aa4e2d93e0a9912024dbd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:28.902097 16391 tablet_bootstrap.cc:654] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.904599 16425 tablet.cc:1722] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:28.906030 14726 master_service.cc:954] ReplaceTablet: received request to replace tablet 3f5cff308fc9448db40b0d4df03c69bb from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.906306 14726 master_service.cc:954] ReplaceTablet: received request to replace tablet 4c301e7a80c64d8e8751ecfa681ab202 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:28.910889 16371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41754 (request call id 67) took 1068 ms. Trace:
I20251025 08:02:28.910976 16371 rpcz_store.cc:276] 1025 08:02:27.842291 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:27.842423 (+ 132us) service_pool.cc:225] Handling call
1025 08:02:28.853046 (+1010623us) ts_tablet_manager.cc:1151] Deleting tablet 8737df10a3c8482c995ac6aadc240c42
1025 08:02:28.853056 (+ 10us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:28.875496 (+ 22440us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:28.876267 (+ 771us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:28.910876 (+ 34609us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1010455}
I20251025 08:02:28.911005 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_f1d51a2bfd9f4822bde47b100d2e5161"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:28.911064 14974 raft_consensus.cc:3060] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.911204 16371 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41754 (request call id 69) took 1062 ms. Trace:
I20251025 08:02:28.911243 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 8737df10a3c8482c995ac6aadc240c42 (table default.Table_475579a80dad4c89bfd895cd2fdaafaf [id=c8b69f7419b842c18f324e0c08ba840a]) successfully deleted
I20251025 08:02:28.911252 16371 rpcz_store.cc:276] 1025 08:02:27.848737 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:27.848929 (+ 192us) service_pool.cc:225] Handling call
1025 08:02:28.911144 (+1062215us) ts_tablet_manager.cc:1151] Deleting tablet 0a187a088f5042c081aa87c79662c8cf
1025 08:02:28.911152 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:28.911195 (+ 43us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1062116}
W20251025 08:02:28.911355 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1d51a2bfd9f4822bde47b100d2e5161 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:28.911504 14712 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 0a187a088f5042c081aa87c79662c8cf because the tablet was not found. No further retry: Not found: Tablet not found: 0a187a088f5042c081aa87c79662c8cf
I20251025 08:02:28.911531 16371 tablet_replica.cc:333] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.911656 16371 raft_consensus.cc:2243] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20251025 08:02:28.911716 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 221f4c5432bc45e18728f5ed1453ad0f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 221f4c5432bc45e18728f5ed1453ad0f already in progress: creating tablet
I20251025 08:02:28.911756 16371 raft_consensus.cc:2272] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.912204 14719 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_4e8f86466ebb45b787d179ddb83d55b9" } new_table_name: "default.Table_5d847a37cb0c456294cb5137046f80bb" modify_external_catalogs: true
I20251025 08:02:28.912580 16364 tablet_replica.cc:333] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.913071 16371 ts_tablet_manager.cc:1916] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.913640 15238 raft_consensus.cc:2468] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:28.914263 16364 raft_consensus.cc:2243] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.914366 16364 raft_consensus.cc:2272] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.914515 16199 raft_consensus.cc:515] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.914662 16364 ts_tablet_manager.cc:1916] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.914829 16199 leader_election.cc:290] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.915120 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d84ee63450243f8910ad4bd1ec6459e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:28.915560 15183 leader_election.cc:343] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.915629 15909 raft_consensus.cc:515] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.915931 15909 leader_election.cc:290] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.916189 16392 tablet_bootstrap.cc:492] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.916283 16392 ts_tablet_manager.cc:1403] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.089s user 0.002s sys 0.000s
I20251025 08:02:28.916383 15380 consensus_queue.cc:1048] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.916741 16392 raft_consensus.cc:359] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.916851 16392 raft_consensus.cc:385] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.916888 16392 raft_consensus.cc:740] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.916949 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 821de6815eb244058f1d8a7a06bf48a6 (table default.Table_c485105a684f427295b74968c29fd30c [id=3abb3c7d3dd74d408db083bf0499f679]) successfully deleted
I20251025 08:02:28.917006 16392 consensus_queue.cc:260] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.917322 16392 ts_tablet_manager.cc:1434] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.917543 16392 tablet_bootstrap.cc:492] T f65b1ad4764a4ed3a33baccaf278f043 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.918282 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9a7f96be1e2427bb0c4e109c6bac400" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:28.918377 14974 raft_consensus.cc:3060] T f9a7f96be1e2427bb0c4e109c6bac400 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.918748 16364 ts_tablet_manager.cc:1929] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.918808 16364 log.cc:1199] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/7b8d94fc010046c7b37804f168471904
I20251025 08:02:28.919322 14974 raft_consensus.cc:2468] T f9a7f96be1e2427bb0c4e109c6bac400 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:28.919627 15183 leader_election.cc:304] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.919802 16390 tablet_bootstrap.cc:492] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.919898 16390 ts_tablet_manager.cc:1403] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.168s user 0.002s sys 0.000s
I20251025 08:02:28.920310 16390 raft_consensus.cc:359] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.920528 14721 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet b7ff0b4596944f38ae9325a95167c287 (table default.Table_f2e0f883fa4646a0aa3e785a7de7f152 [id=ea0a64fc70c84a7eb2b7c8e8e4a933fe]). Expected version 1 got 0
I20251025 08:02:28.920698 14721 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet e87bae31e5e642a5a34a8c170c62fdca (table default.Table_3ad0d85469a7485ba556f83ce20cecdf [id=edf9af4acd364a30814a645d32d35224]). Expected version 1 got 0
I20251025 08:02:28.920810 14721 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]). Expected version 1 got 0
I20251025 08:02:28.920858 16371 ts_tablet_manager.cc:1929] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.920917 16371 log.cc:1199] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/801d06a391e34bec8e1f74257937f069
I20251025 08:02:28.921212 16371 ts_tablet_manager.cc:1950] T 801d06a391e34bec8e1f74257937f069 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.921636 16390 raft_consensus.cc:385] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.921686 16390 raft_consensus.cc:740] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.921809 16390 consensus_queue.cc:260] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.921955 14721 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_e96eec11f48049a9b2a4332b23e60a6f" } modify_external_catalogs: true
I20251025 08:02:28.922055 14721 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_e96eec11f48049a9b2a4332b23e60a6f" } modify_external_catalogs: true
I20251025 08:02:28.922103 16390 ts_tablet_manager.cc:1434] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:28.922492 16390 tablet_bootstrap.cc:492] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.923147 14723 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_56dd2ffb46cc402fa6a8c180e157a2db" } new_table_name: "default.Table_37152b4a34aa41dbbf4a0be51631faf9" modify_external_catalogs: true
I20251025 08:02:28.923337 16390 tablet_bootstrap.cc:654] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.923825 15384 raft_consensus.cc:2804] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.923846 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d84ee63450243f8910ad4bd1ec6459e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:28.923895 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9a7f96be1e2427bb0c4e109c6bac400" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:28.923900 15384 raft_consensus.cc:697] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:28.923938 15112 raft_consensus.cc:3060] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.924031 15384 consensus_queue.cc:237] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.923954 15113 raft_consensus.cc:3060] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.924870 15112 raft_consensus.cc:2468] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:28.924868 15214 tablet_service.cc:1505] Processing CreateTablet for tablet 327c7f7679dd469cb6f5a9b346c40671 (DEFAULT_TABLE table=default.Table_b3ddde442f824bc6986a5d2e95a6b069 [id=b43a2ee282444f159384bc0849691707]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.924995 15113 raft_consensus.cc:2468] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:28.925110 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327c7f7679dd469cb6f5a9b346c40671. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.925289 15224 tablet_service.cc:1505] Processing CreateTablet for tablet fba2914feb95475fbbfc5cef5a653408 (DEFAULT_TABLE table=default.Table_cce271e6706043dabfbd2c4b55bf198b [id=3a6e3a35c29b486b9ed32bc6fe1ec042]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.925472 15217 tablet_service.cc:1505] Processing CreateTablet for tablet a547fb54ddbf4053b5be20ee6c4fc6b0 (DEFAULT_TABLE table=default.Table_a4db03b0afac4934abd7b889be3d9f30 [id=9759ac18bd46453eab5a8c294a229886]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.925693 16364 ts_tablet_manager.cc:1950] T 7b8d94fc010046c7b37804f168471904 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.925822 15212 tablet_service.cc:1505] Processing CreateTablet for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 (DEFAULT_TABLE table=default.Table_9f939300bcf646508b4f05ea510f6679 [id=0db02c1368044d17ba62f03bf3aac5d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.925267 15222 tablet_service.cc:1505] Processing CreateTablet for tablet 75d0c5e694734b37848c4127c4e97085 (DEFAULT_TABLE table=default.Table_78daee932a6e4b46b0271ad11e4715c8 [id=9a293f6565184a56a16bf3e755444870]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.925479 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba2914feb95475fbbfc5cef5a653408. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.926201 16364 tablet_replica.cc:333] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.926298 16364 raft_consensus.cc:2243] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.926384 16364 raft_consensus.cc:2272] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.926352 15088 tablet_service.cc:1505] Processing CreateTablet for tablet a547fb54ddbf4053b5be20ee6c4fc6b0 (DEFAULT_TABLE table=default.Table_a4db03b0afac4934abd7b889be3d9f30 [id=9759ac18bd46453eab5a8c294a229886]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.926524 16371 tablet_replica.cc:333] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.926558 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a547fb54ddbf4053b5be20ee6c4fc6b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.926631 16371 raft_consensus.cc:2243] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.926712 16371 raft_consensus.cc:2272] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.927129 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 23eedc2695db43afbd6f5dbebb0ea2be (DEFAULT_TABLE table=default.Table_d9fe75661236465ca4c58953ed0023c4 [id=c0f5ecd0d89d409785fbd905d22e3fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.927342 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23eedc2695db43afbd6f5dbebb0ea2be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.927440 16364 ts_tablet_manager.cc:1916] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.928063 16371 ts_tablet_manager.cc:1916] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.928201 15217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a547fb54ddbf4053b5be20ee6c4fc6b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.928557 15091 tablet_service.cc:1505] Processing CreateTablet for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 (DEFAULT_TABLE table=default.Table_9f939300bcf646508b4f05ea510f6679 [id=0db02c1368044d17ba62f03bf3aac5d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.928747 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.929227 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 2069ab40d30c4b8dab9d37c466522ac1 (DEFAULT_TABLE table=default.Table_017a3857ee554314b8b3da6ceb795262 [id=1a9876389ab64909a2405359ed420a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.929431 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2069ab40d30c4b8dab9d37c466522ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.929912 16371 ts_tablet_manager.cc:1929] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.930008 16371 log.cc:1199] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/4d9cd745bd3e42e98b0ae1d145007bee
I20251025 08:02:28.930115 15642 raft_consensus.cc:493] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.930212 15642 raft_consensus.cc:515] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.930274 16371 ts_tablet_manager.cc:1950] T 4d9cd745bd3e42e98b0ae1d145007bee P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.930538 15642 leader_election.cc:290] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.930680 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 327c7f7679dd469cb6f5a9b346c40671 (DEFAULT_TABLE table=default.Table_b3ddde442f824bc6986a5d2e95a6b069 [id=b43a2ee282444f159384bc0849691707]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.930733 16371 tablet_replica.cc:333] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.930809 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.930855 16371 raft_consensus.cc:2243] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.930866 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327c7f7679dd469cb6f5a9b346c40671. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.931041 16371 raft_consensus.cc:2272] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.931335 16371 ts_tablet_manager.cc:1916] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.931394 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 75d0c5e694734b37848c4127c4e97085 (DEFAULT_TABLE table=default.Table_78daee932a6e4b46b0271ad11e4715c8 [id=9a293f6565184a56a16bf3e755444870]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.931574 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d0c5e694734b37848c4127c4e97085. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.932598 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 0f55c551037a4619808e18e461940d6d with delete_type TABLET_DATA_DELETED (replaced by tablet bea55cdfbf454d76920806886c3d2c4e) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.932753 16372 tablet_replica.cc:333] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.932787 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d0c5e694734b37848c4127c4e97085. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.932870 16372 raft_consensus.cc:2243] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.932965 16372 raft_consensus.cc:2272] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.933435 16372 ts_tablet_manager.cc:1916] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.933692 15082 tablet_service.cc:1505] Processing CreateTablet for tablet fba2914feb95475fbbfc5cef5a653408 (DEFAULT_TABLE table=default.Table_cce271e6706043dabfbd2c4b55bf198b [id=3a6e3a35c29b486b9ed32bc6fe1ec042]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.933825 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 7b8d94fc010046c7b37804f168471904 (table default.Table_521f904aba4a4b309e9864df54df659d [id=a95abf5644c64177afde71baad186bca]) successfully deleted
I20251025 08:02:28.933902 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba2914feb95475fbbfc5cef5a653408. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.934269 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f55c551037a4619808e18e461940d6d" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.934365 15238 raft_consensus.cc:2468] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:28.934633 15049 leader_election.cc:304] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
W20251025 08:02:28.934728 15049 raft_consensus.cc:2686] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251025 08:02:28.935415 16372 ts_tablet_manager.cc:1929] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.935472 16372 log.cc:1199] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/0f55c551037a4619808e18e461940d6d
I20251025 08:02:28.935654 16372 ts_tablet_manager.cc:1950] T 0f55c551037a4619808e18e461940d6d P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.937141 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 0f55c551037a4619808e18e461940d6d (table default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]) successfully deleted
I20251025 08:02:28.937345 16392 tablet_bootstrap.cc:654] T f65b1ad4764a4ed3a33baccaf278f043 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.937393 14948 tablet_service.cc:1505] Processing CreateTablet for tablet 2069ab40d30c4b8dab9d37c466522ac1 (DEFAULT_TABLE table=default.Table_017a3857ee554314b8b3da6ceb795262 [id=1a9876389ab64909a2405359ed420a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.937613 14948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2069ab40d30c4b8dab9d37c466522ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.937582 14945 tablet_service.cc:1505] Processing CreateTablet for tablet 75d0c5e694734b37848c4127c4e97085 (DEFAULT_TABLE table=default.Table_78daee932a6e4b46b0271ad11e4715c8 [id=9a293f6565184a56a16bf3e755444870]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.937743 14945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d0c5e694734b37848c4127c4e97085. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.939527 14943 tablet_service.cc:1505] Processing CreateTablet for tablet a547fb54ddbf4053b5be20ee6c4fc6b0 (DEFAULT_TABLE table=default.Table_a4db03b0afac4934abd7b889be3d9f30 [id=9759ac18bd46453eab5a8c294a229886]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.939683 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 2069ab40d30c4b8dab9d37c466522ac1 (DEFAULT_TABLE table=default.Table_017a3857ee554314b8b3da6ceb795262 [id=1a9876389ab64909a2405359ed420a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.939752 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a547fb54ddbf4053b5be20ee6c4fc6b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.939877 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2069ab40d30c4b8dab9d37c466522ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.940049 16364 ts_tablet_manager.cc:1929] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.940110 16364 log.cc:1199] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/e4f92b0605754327883b144fb6c96aea
I20251025 08:02:28.940342 16364 ts_tablet_manager.cc:1950] T e4f92b0605754327883b144fb6c96aea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.940912 16371 ts_tablet_manager.cc:1929] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.940984 16371 log.cc:1199] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/88efe498fb6f4ce1a02b5389ff6f5797
I20251025 08:02:28.941200 16371 ts_tablet_manager.cc:1950] T 88efe498fb6f4ce1a02b5389ff6f5797 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.941672 16371 tablet_replica.cc:333] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.941782 16371 raft_consensus.cc:2243] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.941864 16371 raft_consensus.cc:2272] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.942013 14946 tablet_service.cc:1505] Processing CreateTablet for tablet 327c7f7679dd469cb6f5a9b346c40671 (DEFAULT_TABLE table=default.Table_b3ddde442f824bc6986a5d2e95a6b069 [id=b43a2ee282444f159384bc0849691707]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.942214 16371 ts_tablet_manager.cc:1916] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.942265 14946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 327c7f7679dd469cb6f5a9b346c40671. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.942972 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 23eedc2695db43afbd6f5dbebb0ea2be (DEFAULT_TABLE table=default.Table_d9fe75661236465ca4c58953ed0023c4 [id=c0f5ecd0d89d409785fbd905d22e3fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.943181 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23eedc2695db43afbd6f5dbebb0ea2be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.943673 16390 tablet_bootstrap.cc:492] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.943738 16390 ts_tablet_manager.cc:1403] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20251025 08:02:28.943868 16364 tablet_replica.cc:333] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.943994 16364 raft_consensus.cc:2243] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.944075 16364 raft_consensus.cc:2272] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.944139 16390 raft_consensus.cc:359] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.944254 16390 raft_consensus.cc:385] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.944291 16390 raft_consensus.cc:740] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.941870 14944 tablet_service.cc:1505] Processing CreateTablet for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 (DEFAULT_TABLE table=default.Table_9f939300bcf646508b4f05ea510f6679 [id=0db02c1368044d17ba62f03bf3aac5d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.944425 16390 consensus_queue.cc:260] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.944618 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.944706 16390 ts_tablet_manager.cc:1434] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.944720 14718 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 45be7daf50e741c9b6f1eeedccae8c8e
I20251025 08:02:28.944857 16390 tablet_bootstrap.cc:492] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.945690 16390 tablet_bootstrap.cc:654] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.946228 16371 ts_tablet_manager.cc:1929] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.946292 16371 log.cc:1199] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/90bb43eb01c949b09f7a4c703a99dc7e
I20251025 08:02:28.944424 16364 ts_tablet_manager.cc:1916] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.946523 16371 ts_tablet_manager.cc:1950] T 90bb43eb01c949b09f7a4c703a99dc7e P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.946578 14720 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_d4d0cf0460ca4188bf5e9e502111012c" } modify_external_catalogs: true
I20251025 08:02:28.946676 14720 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_d4d0cf0460ca4188bf5e9e502111012c" } modify_external_catalogs: true
I20251025 08:02:28.946802 14942 tablet_service.cc:1505] Processing CreateTablet for tablet 23eedc2695db43afbd6f5dbebb0ea2be (DEFAULT_TABLE table=default.Table_d9fe75661236465ca4c58953ed0023c4 [id=c0f5ecd0d89d409785fbd905d22e3fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.946981 16371 tablet_replica.cc:333] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.947000 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23eedc2695db43afbd6f5dbebb0ea2be. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.947088 16371 raft_consensus.cc:2243] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.947250 16371 raft_consensus.cc:2272] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.947543 16371 ts_tablet_manager.cc:1916] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.948169 16364 ts_tablet_manager.cc:1929] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.948253 16364 log.cc:1199] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/0f55c551037a4619808e18e461940d6d
I20251025 08:02:28.948398 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet e4f92b0605754327883b144fb6c96aea (table default.Table_eaf82018b440497e86dbf2cfdd3785e5 [id=2ef2d72066f446619f9045da34df7814]) successfully deleted
I20251025 08:02:28.948527 16364 ts_tablet_manager.cc:1950] T 0f55c551037a4619808e18e461940d6d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.948825 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 801d06a391e34bec8e1f74257937f069 (table default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]) successfully deleted
I20251025 08:02:28.948943 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 4d9cd745bd3e42e98b0ae1d145007bee (table default.Table_8540557c73a34cc2851ad08d71acac22 [id=abe30167767443d0b8e59f9418399d88]) successfully deleted
I20251025 08:02:28.949275 15082 tablet_service.cc:1552] Processing DeleteTablet for tablet 45be7daf50e741c9b6f1eeedccae8c8e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:28.949391 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 0f55c551037a4619808e18e461940d6d (table default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]) successfully deleted
I20251025 08:02:28.949443 16372 tablet_replica.cc:333] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:28.949501 16364 tablet_replica.cc:333] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
W20251025 08:02:28.949548 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 already in progress: creating tablet
I20251025 08:02:28.949568 16372 raft_consensus.cc:2243] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.949611 16364 raft_consensus.cc:2243] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.949715 16364 raft_consensus.cc:2272] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.949738 16372 raft_consensus.cc:2272] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:28.949910 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 3f5cff308fc9448db40b0d4df03c69bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f5cff308fc9448db40b0d4df03c69bb already in progress: creating tablet
I20251025 08:02:28.950124 16372 ts_tablet_manager.cc:1916] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.950450 16392 tablet_bootstrap.cc:492] T f65b1ad4764a4ed3a33baccaf278f043 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.950610 16392 ts_tablet_manager.cc:1403] T f65b1ad4764a4ed3a33baccaf278f043 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20251025 08:02:28.951217 16392 raft_consensus.cc:359] T f65b1ad4764a4ed3a33baccaf278f043 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.951308 16392 raft_consensus.cc:385] T f65b1ad4764a4ed3a33baccaf278f043 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.951344 16392 raft_consensus.cc:740] T f65b1ad4764a4ed3a33baccaf278f043 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.951452 16392 consensus_queue.cc:260] T f65b1ad4764a4ed3a33baccaf278f043 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.951743 16392 ts_tablet_manager.cc:1434] T f65b1ad4764a4ed3a33baccaf278f043 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:28.951748 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 90bb43eb01c949b09f7a4c703a99dc7e (table default.Table_2d1acf2ab32844f2a253a5d5ab46d842 [id=3abdeeb0fca0413d8af86b1c0ad383b4]) successfully deleted
I20251025 08:02:28.951920 16392 tablet_bootstrap.cc:492] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.952404 16372 ts_tablet_manager.cc:1929] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.952464 16372 log.cc:1199] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/45be7daf50e741c9b6f1eeedccae8c8e
I20251025 08:02:28.952695 16372 ts_tablet_manager.cc:1950] T 45be7daf50e741c9b6f1eeedccae8c8e P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:28.953435 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f55c551037a4619808e18e461940d6d" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.953541 14974 raft_consensus.cc:2468] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:28.953327 16392 tablet_bootstrap.cc:654] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.954416 16364 ts_tablet_manager.cc:1916] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.954460 16371 ts_tablet_manager.cc:1929] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.954636 16371 log.cc:1199] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/422e2c32a18a4e1ea9a5e371da17dfea
I20251025 08:02:28.954916 16371 ts_tablet_manager.cc:1950] T 422e2c32a18a4e1ea9a5e371da17dfea P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.955435 16371 tablet_replica.cc:333] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.955652 16371 raft_consensus.cc:2243] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:28.955861 16371 raft_consensus.cc:2272] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.956243 16371 ts_tablet_manager.cc:1916] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.956240 16364 ts_tablet_manager.cc:1929] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:28.956312 16364 log.cc:1199] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/049cc6add40d44fc9d67c89eca89ce59
I20251025 08:02:28.956271 16420 raft_consensus.cc:493] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.957820 16420 raft_consensus.cc:515] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.958106 15642 raft_consensus.cc:493] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.958151 16420 leader_election.cc:290] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:28.958201 15642 raft_consensus.cc:515] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.958240 16371 ts_tablet_manager.cc:1929] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:28.958299 16371 log.cc:1199] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/2a0a2af3ed1f41fea41962db52cfe7d8
I20251025 08:02:28.958488 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 45be7daf50e741c9b6f1eeedccae8c8e (table default.Table_5854b229e0af41b88196de4a1c9c0270 [id=e95f72536b1242469fd4dad2c4d1c276]) successfully deleted
I20251025 08:02:28.958526 16371 ts_tablet_manager.cc:1950] T 2a0a2af3ed1f41fea41962db52cfe7d8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.958559 15642 leader_election.cc:290] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.958891 16364 ts_tablet_manager.cc:1950] T 049cc6add40d44fc9d67c89eca89ce59 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.958922 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcc08d74df2d46c58ca27f5d467e060f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.958998 16371 tablet_replica.cc:333] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.959049 15238 raft_consensus.cc:2468] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:28.959101 16371 raft_consensus.cc:2243] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.959090 15185 leader_election.cc:304] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:28.959093 16572 consensus_queue.cc:1048] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.959235 16371 raft_consensus.cc:2272] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.959321 15909 raft_consensus.cc:2804] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.959408 15909 raft_consensus.cc:697] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:28.959513 15909 consensus_queue.cc:237] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.959595 16371 ts_tablet_manager.cc:1916] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.959895 16364 tablet_replica.cc:333] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.959997 16364 raft_consensus.cc:2243] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.960079 16364 raft_consensus.cc:2272] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.960237 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcc08d74df2d46c58ca27f5d467e060f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:28.960331 15240 raft_consensus.cc:2468] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:28.960482 16364 ts_tablet_manager.cc:1916] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.961005 15049 leader_election.cc:304] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.961206 15642 raft_consensus.cc:2804] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.961256 15642 raft_consensus.cc:493] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.961299 15642 raft_consensus.cc:3060] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.961504 16371 ts_tablet_manager.cc:1929] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.961560 16371 log.cc:1199] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/3faddc4af6ef4019be369ceb023cbc9d
I20251025 08:02:28.961750 16371 ts_tablet_manager.cc:1950] T 3faddc4af6ef4019be369ceb023cbc9d P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:28.961971 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 422e2c32a18a4e1ea9a5e371da17dfea (table default.Table_5bc70f62257c438bb0c52926674f2bdf [id=e62c2aba4e5546e2bd881c5f2ae3abd4]) successfully deleted
I20251025 08:02:28.962085 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 2a0a2af3ed1f41fea41962db52cfe7d8 (table default.Table_0db7fc431dff4c7f85007159dd715e19 [id=1e1120fd790b44569595d67fea5165c2]) successfully deleted
I20251025 08:02:28.962093 15642 raft_consensus.cc:515] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.962361 16364 ts_tablet_manager.cc:1929] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.962466 15642 leader_election.cc:290] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.962492 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcc08d74df2d46c58ca27f5d467e060f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.962536 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcc08d74df2d46c58ca27f5d467e060f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.962581 14975 raft_consensus.cc:2468] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:28.962657 15112 raft_consensus.cc:2393] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:28.963861 14942 tablet_service.cc:1552] Processing DeleteTablet for tablet 45be7daf50e741c9b6f1eeedccae8c8e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:28.964067 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcc08d74df2d46c58ca27f5d467e060f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:28.964160 14975 raft_consensus.cc:3060] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.964355 14914 leader_election.cc:304] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
W20251025 08:02:28.964576 14914 consensus_peers.cc:597] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 821de6815eb244058f1d8a7a06bf48a6. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:28.964984 14975 raft_consensus.cc:2468] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:28.965163 16420 raft_consensus.cc:2764] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251025 08:02:28.965809 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 049cc6add40d44fc9d67c89eca89ce59 (table default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]) successfully deleted
I20251025 08:02:28.967483 15082 tablet_service.cc:1505] Processing CreateTablet for tablet bf34039d909949af9357299bf8204891 (DEFAULT_TABLE table=default.Table_0762822d85ed47bc93809bd77c712935 [id=1e0739ca3fad4a22893a3453c3b2eac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.967733 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf34039d909949af9357299bf8204891. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.968634 15089 tablet_service.cc:1505] Processing CreateTablet for tablet a3379087113041beba7ddbc6596c3b0a (DEFAULT_TABLE table=default.Table_a05736b7077d457181534fd09c3a1946 [id=54160b89eff147188297e5017eaec741]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.968851 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3379087113041beba7ddbc6596c3b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.969772 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 17e61bb1e9c94b949361b2ca152eb3d4 (DEFAULT_TABLE table=default.Table_28c1103af6dc4e96a63ed0c2a0c2cbde [id=b228e3c8480f475ca877713e168bcba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.969992 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e61bb1e9c94b949361b2ca152eb3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.970352 15642 consensus_queue.cc:1048] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.971117 14944 tablet_service.cc:1505] Processing CreateTablet for tablet bf34039d909949af9357299bf8204891 (DEFAULT_TABLE table=default.Table_0762822d85ed47bc93809bd77c712935 [id=1e0739ca3fad4a22893a3453c3b2eac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.971367 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf34039d909949af9357299bf8204891. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.971560 14942 tablet_service.cc:1505] Processing CreateTablet for tablet fba2914feb95475fbbfc5cef5a653408 (DEFAULT_TABLE table=default.Table_cce271e6706043dabfbd2c4b55bf198b [id=3a6e3a35c29b486b9ed32bc6fe1ec042]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.971750 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fba2914feb95475fbbfc5cef5a653408. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.964888 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fcc08d74df2d46c58ca27f5d467e060f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:28.973459 15238 raft_consensus.cc:3060] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.973486 15224 tablet_service.cc:1505] Processing CreateTablet for tablet a3379087113041beba7ddbc6596c3b0a (DEFAULT_TABLE table=default.Table_a05736b7077d457181534fd09c3a1946 [id=54160b89eff147188297e5017eaec741]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.973706 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3379087113041beba7ddbc6596c3b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.974435 15238 raft_consensus.cc:2468] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:28.974702 15049 leader_election.cc:304] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:28.974920 15214 tablet_service.cc:1505] Processing CreateTablet for tablet d05bf0056dfc43eeb4105af559497bdc (DEFAULT_TABLE table=default.Table_ea3622c669ee4aa5a2b88a9e87aeadaf [id=72243e33e90940c09953a9ec2fcfd435]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.975133 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05bf0056dfc43eeb4105af559497bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.975334 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 6dd0f695a2904df5b750b45782a21ce2 (DEFAULT_TABLE table=default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.975536 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd0f695a2904df5b750b45782a21ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.975803 15217 tablet_service.cc:1505] Processing CreateTablet for tablet 17e61bb1e9c94b949361b2ca152eb3d4 (DEFAULT_TABLE table=default.Table_28c1103af6dc4e96a63ed0c2a0c2cbde [id=b228e3c8480f475ca877713e168bcba8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.976012 15217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e61bb1e9c94b949361b2ca152eb3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.965013 15909 consensus_queue.cc:1048] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:28.965337 16199 raft_consensus.cc:493] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:28.977291 16199 raft_consensus.cc:515] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.977604 15497 raft_consensus.cc:2804] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.977638 16199 leader_election.cc:290] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.977725 15497 raft_consensus.cc:697] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:28.977838 15497 consensus_queue.cc:237] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.977877 15093 tablet_service.cc:1505] Processing CreateTablet for tablet d05bf0056dfc43eeb4105af559497bdc (DEFAULT_TABLE table=default.Table_ea3622c669ee4aa5a2b88a9e87aeadaf [id=72243e33e90940c09953a9ec2fcfd435]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.978106 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05bf0056dfc43eeb4105af559497bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.979080 16390 tablet_bootstrap.cc:492] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.979149 16390 ts_tablet_manager.cc:1403] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
I20251025 08:02:28.979545 16390 raft_consensus.cc:359] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.979632 16390 raft_consensus.cc:385] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.979668 16390 raft_consensus.cc:740] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.979729 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5564705a3771425da1f33830e7b51e03" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:28.979769 16390 consensus_queue.cc:260] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.979812 15111 raft_consensus.cc:2468] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:28.979837 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 6dd0f695a2904df5b750b45782a21ce2 (DEFAULT_TABLE table=default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.980058 16390 ts_tablet_manager.cc:1434] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.980100 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd0f695a2904df5b750b45782a21ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.980212 16390 tablet_bootstrap.cc:492] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.980455 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5564705a3771425da1f33830e7b51e03" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:28.958935 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 45be7daf50e741c9b6f1eeedccae8c8e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:28.980567 14946 tablet_service.cc:1505] Processing CreateTablet for tablet 17e61bb1e9c94b949361b2ca152eb3d4 (DEFAULT_TABLE table=default.Table_28c1103af6dc4e96a63ed0c2a0c2cbde [id=b228e3c8480f475ca877713e168bcba8]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:28.980767 15183 leader_election.cc:343] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.980798 14946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17e61bb1e9c94b949361b2ca152eb3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.981031 16364 log.cc:1199] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/1d7c262b73904f1f87188718617e38a8
I20251025 08:02:28.981217 16390 tablet_bootstrap.cc:654] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.981274 16364 ts_tablet_manager.cc:1950] T 1d7c262b73904f1f87188718617e38a8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:28.981848 16364 tablet_replica.cc:333] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:28.981943 16364 raft_consensus.cc:2243] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.982043 16364 raft_consensus.cc:2272] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.982378 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 1d7c262b73904f1f87188718617e38a8 (table default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056]) successfully deleted
W20251025 08:02:28.982537 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet cfe9add2f8bf450bb6f49ad57be2caae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cfe9add2f8bf450bb6f49ad57be2caae already in progress: creating tablet
I20251025 08:02:28.983038 16392 tablet_bootstrap.cc:492] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:28.983134 16392 ts_tablet_manager.cc:1403] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20251025 08:02:28.982220 15185 leader_election.cc:304] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:28.968464 15212 tablet_service.cc:1505] Processing CreateTablet for tablet bf34039d909949af9357299bf8204891 (DEFAULT_TABLE table=default.Table_0762822d85ed47bc93809bd77c712935 [id=1e0739ca3fad4a22893a3453c3b2eac8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.983585 16392 raft_consensus.cc:359] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:28.983685 16392 raft_consensus.cc:385] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.983717 16392 raft_consensus.cc:740] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.983769 16199 raft_consensus.cc:2804] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:28.983824 16199 raft_consensus.cc:493] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:28.983844 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf34039d909949af9357299bf8204891. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.983862 16199 raft_consensus.cc:3060] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.983819 16392 consensus_queue.cc:260] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:28.984115 16392 ts_tablet_manager.cc:1434] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.984279 16392 tablet_bootstrap.cc:492] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:28.984753 16199 raft_consensus.cc:515] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.985095 16199 leader_election.cc:290] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:28.985282 16392 tablet_bootstrap.cc:654] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.985332 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5564705a3771425da1f33830e7b51e03" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:28.985616 15183 leader_election.cc:343] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:28.985975 16364 ts_tablet_manager.cc:1916] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.986346 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 06c159c643804acfb0c3b82190a7a02f (DEFAULT_TABLE table=default.Table_fa7f3472406144b795d1ec3e8669bf04 [id=73c88284db0345458af97c86039f6c5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.986375 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5564705a3771425da1f33830e7b51e03" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:28.986464 15113 raft_consensus.cc:3060] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:28.986487 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 09fccf0770604812940dd63106f7d993 (DEFAULT_TABLE table=default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.986544 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c159c643804acfb0c3b82190a7a02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.984763 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 09fccf0770604812940dd63106f7d993 (DEFAULT_TABLE table=default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.986714 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fccf0770604812940dd63106f7d993. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.987293 15113 raft_consensus.cc:2468] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:28.987651 15185 leader_election.cc:304] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:28.987795 16199 raft_consensus.cc:2804] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:28.987869 16199 raft_consensus.cc:697] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:28.987977 16199 consensus_queue.cc:237] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.988739 14942 tablet_service.cc:1505] Processing CreateTablet for tablet d05bf0056dfc43eeb4105af559497bdc (DEFAULT_TABLE table=default.Table_ea3622c669ee4aa5a2b88a9e87aeadaf [id=72243e33e90940c09953a9ec2fcfd435]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.988956 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d05bf0056dfc43eeb4105af559497bdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.989012 14943 tablet_service.cc:1505] Processing CreateTablet for tablet 09fccf0770604812940dd63106f7d993 (DEFAULT_TABLE table=default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.989197 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fccf0770604812940dd63106f7d993. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.990607 16371 tablet_replica.cc:333] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:28.990720 16371 raft_consensus.cc:2243] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:28.990801 16371 raft_consensus.cc:2272] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:28.990926 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fccf0770604812940dd63106f7d993. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.991096 16371 ts_tablet_manager.cc:1916] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:28.991833 15082 tablet_service.cc:1505] Processing CreateTablet for tablet d162f3ee21bd40ce9a9c74b7863a3878 (DEFAULT_TABLE table=default.Table_eaf82018b440497e86dbf2cfdd3785e5 [id=2ef2d72066f446619f9045da34df7814]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.993244 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d162f3ee21bd40ce9a9c74b7863a3878. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.993408 16390 tablet_bootstrap.cc:492] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:28.993489 16390 ts_tablet_manager.cc:1403] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20251025 08:02:28.993582 16364 ts_tablet_manager.cc:1929] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:28.993563 15090 tablet_service.cc:1505] Processing CreateTablet for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 (DEFAULT_TABLE table=default.Table_c485105a684f427295b74968c29fd30c [id=3abb3c7d3dd74d408db083bf0499f679]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.993633 16364 log.cc:1199] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/221f4c5432bc45e18728f5ed1453ad0f
I20251025 08:02:28.993760 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b8efa8ed634583b7bf7cc91bfc61a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.993852 16390 raft_consensus.cc:359] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.993959 16390 raft_consensus.cc:385] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:28.993990 16390 raft_consensus.cc:740] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.994103 16390 consensus_queue.cc:260] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:28.994251 15218 tablet_service.cc:1505] Processing CreateTablet for tablet d162f3ee21bd40ce9a9c74b7863a3878 (DEFAULT_TABLE table=default.Table_eaf82018b440497e86dbf2cfdd3785e5 [id=2ef2d72066f446619f9045da34df7814]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.994372 16390 ts_tablet_manager.cc:1434] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:28.994431 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d162f3ee21bd40ce9a9c74b7863a3878. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.994508 16390 tablet_bootstrap.cc:492] T c2415c51234f482ca295cc71a74e7cab P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:28.995363 16390 tablet_bootstrap.cc:654] T c2415c51234f482ca295cc71a74e7cab P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:28.997368 14942 tablet_service.cc:1505] Processing CreateTablet for tablet d162f3ee21bd40ce9a9c74b7863a3878 (DEFAULT_TABLE table=default.Table_eaf82018b440497e86dbf2cfdd3785e5 [id=2ef2d72066f446619f9045da34df7814]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.997571 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d162f3ee21bd40ce9a9c74b7863a3878. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:28.998602 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 6dd0f695a2904df5b750b45782a21ce2 (DEFAULT_TABLE table=default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:28.998788 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd0f695a2904df5b750b45782a21ce2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.000794 15642 raft_consensus.cc:493] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.000871 15642 raft_consensus.cc:515] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.001096 15218 tablet_service.cc:1505] Processing CreateTablet for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 (DEFAULT_TABLE table=default.Table_c485105a684f427295b74968c29fd30c [id=3abb3c7d3dd74d408db083bf0499f679]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.001190 15642 leader_election.cc:290] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.001312 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b8efa8ed634583b7bf7cc91bfc61a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.001315 16391 tablet_bootstrap.cc:492] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.001389 16391 ts_tablet_manager.cc:1403] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.101s user 0.002s sys 0.000s
I20251025 08:02:29.001886 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 9bb5b825be9a44d489151239947d471e (DEFAULT_TABLE table=default.Table_f84103a22819458c976f0d1ca4716b47 [id=fe4920e7d4f143388063f22590eb2f64]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.001869 16391 raft_consensus.cc:359] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.001988 16391 raft_consensus.cc:385] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.002027 16391 raft_consensus.cc:740] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:28.993813 16364 ts_tablet_manager.cc:1950] T 221f4c5432bc45e18728f5ed1453ad0f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.002102 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb5b825be9a44d489151239947d471e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.002112 16391 consensus_queue.cc:260] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.002383 16391 ts_tablet_manager.cc:1434] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.002641 14943 tablet_service.cc:1505] Processing CreateTablet for tablet 06c159c643804acfb0c3b82190a7a02f (DEFAULT_TABLE table=default.Table_fa7f3472406144b795d1ec3e8669bf04 [id=73c88284db0345458af97c86039f6c5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.003178 14942 tablet_service.cc:1505] Processing CreateTablet for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 (DEFAULT_TABLE table=default.Table_c485105a684f427295b74968c29fd30c [id=3abb3c7d3dd74d408db083bf0499f679]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.003432 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 06c159c643804acfb0c3b82190a7a02f (DEFAULT_TABLE table=default.Table_fa7f3472406144b795d1ec3e8669bf04 [id=73c88284db0345458af97c86039f6c5d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.003512 16364 tablet_replica.cc:333] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.003659 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c159c643804acfb0c3b82190a7a02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.003680 16364 raft_consensus.cc:2243] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.003832 16364 raft_consensus.cc:2272] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.004320 16364 ts_tablet_manager.cc:1916] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.004814 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 221f4c5432bc45e18728f5ed1453ad0f (table default.Table_4a9fc326b302473f86d8d3f7e7b8040f [id=15a38bbafe4045e9991cb846ec9e452c]) successfully deleted
I20251025 08:02:29.004855 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff20cd7d33a440bab24bd4a61fff1f30" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:29.004992 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet d5cd481a98514f16bed3fb0bf5003526 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5cd481a98514f16bed3fb0bf5003526 already in progress: creating tablet
I20251025 08:02:29.005007 15239 raft_consensus.cc:2468] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:29.005512 15049 leader_election.cc:304] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.005653 15642 raft_consensus.cc:2804] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.005697 15642 raft_consensus.cc:493] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.005739 15642 raft_consensus.cc:3060] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.005765 14946 tablet_service.cc:1505] Processing CreateTablet for tablet a3379087113041beba7ddbc6596c3b0a (DEFAULT_TABLE table=default.Table_a05736b7077d457181534fd09c3a1946 [id=54160b89eff147188297e5017eaec741]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.006505 15642 raft_consensus.cc:515] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.006793 15642 leader_election.cc:290] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.007164 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff20cd7d33a440bab24bd4a61fff1f30" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:29.007277 15239 raft_consensus.cc:3060] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.008138 15239 raft_consensus.cc:2468] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:29.008203 16364 ts_tablet_manager.cc:1929] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.008375 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff20cd7d33a440bab24bd4a61fff1f30" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.008538 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff20cd7d33a440bab24bd4a61fff1f30" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:29.008806 15048 leader_election.cc:343] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.008855 16392 tablet_bootstrap.cc:492] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.008919 16392 ts_tablet_manager.cc:1403] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
W20251025 08:02:29.008934 15048 leader_election.cc:343] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.009093 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2b8efa8ed634583b7bf7cc91bfc61a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.009341 16392 raft_consensus.cc:359] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.009438 16392 raft_consensus.cc:385] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.009474 16392 raft_consensus.cc:740] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.009585 16392 consensus_queue.cc:260] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.009855 16392 ts_tablet_manager.cc:1434] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.010066 16392 tablet_bootstrap.cc:492] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.010967 16392 tablet_bootstrap.cc:654] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.011047 14946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3379087113041beba7ddbc6596c3b0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.014811 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c159c643804acfb0c3b82190a7a02f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.016167 16364 log.cc:1199] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/04d3488a6b814223b742f0d5c946362f
W20251025 08:02:29.016683 15183 consensus_peers.cc:597] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:29.016815 15049 leader_election.cc:304] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.016963 16582 raft_consensus.cc:2804] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.017038 16582 raft_consensus.cc:697] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:29.017149 16582 consensus_queue.cc:237] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.018072 16391 tablet_bootstrap.cc:492] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.018998 16391 tablet_bootstrap.cc:654] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.019428 16392 tablet_bootstrap.cc:492] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.019531 16392 ts_tablet_manager.cc:1403] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:29.019903 16392 raft_consensus.cc:359] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.020001 16392 raft_consensus.cc:385] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.020030 16392 raft_consensus.cc:740] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.020118 16392 consensus_queue.cc:260] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.020336 16392 ts_tablet_manager.cc:1434] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.020481 16392 tablet_bootstrap.cc:492] T c2415c51234f482ca295cc71a74e7cab P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.021349 16392 tablet_bootstrap.cc:654] T c2415c51234f482ca295cc71a74e7cab P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.022022 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 6cedb44483cf4f62acf52b90b6708dfb (DEFAULT_TABLE table=default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.022271 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cedb44483cf4f62acf52b90b6708dfb. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:29.022317 14915 consensus_peers.cc:597] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a940a0698d64770bf5826d9290117b4. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:29.023104 15093 tablet_service.cc:1505] Processing CreateTablet for tablet bea55cdfbf454d76920806886c3d2c4e (DEFAULT_TABLE table=default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.023298 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea55cdfbf454d76920806886c3d2c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.023718 16371 ts_tablet_manager.cc:1929] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.023782 16371 log.cc:1199] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/1aa4677de4604abaa2dc6e5413c616a3
I20251025 08:02:29.024013 16371 ts_tablet_manager.cc:1950] T 1aa4677de4604abaa2dc6e5413c616a3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.024741 15218 tablet_service.cc:1505] Processing CreateTablet for tablet bea55cdfbf454d76920806886c3d2c4e (DEFAULT_TABLE table=default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.024932 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea55cdfbf454d76920806886c3d2c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.025770 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 6cedb44483cf4f62acf52b90b6708dfb (DEFAULT_TABLE table=default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.025985 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cedb44483cf4f62acf52b90b6708dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.028375 16390 tablet_bootstrap.cc:492] T c2415c51234f482ca295cc71a74e7cab P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.028385 16371 tablet_replica.cc:333] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.028467 16390 ts_tablet_manager.cc:1403] T c2415c51234f482ca295cc71a74e7cab P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.000s
I20251025 08:02:29.028501 16371 raft_consensus.cc:2243] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.029003 16390 raft_consensus.cc:359] T c2415c51234f482ca295cc71a74e7cab P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.029105 16390 raft_consensus.cc:385] T c2415c51234f482ca295cc71a74e7cab P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.029145 16390 raft_consensus.cc:740] T c2415c51234f482ca295cc71a74e7cab P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.029263 16390 consensus_queue.cc:260] T c2415c51234f482ca295cc71a74e7cab P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.029567 14726 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 4c301e7a80c64d8e8751ecfa681ab202
I20251025 08:02:29.029619 16390 ts_tablet_manager.cc:1434] T c2415c51234f482ca295cc71a74e7cab P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251025 08:02:29.029866 14726 catalog_manager.cc:6719] ReplaceTablet: tablet 4c301e7a80c64d8e8751ecfa681ab202 deleted and replaced by tablet e0cc4859d32a4e119b413e1cbbb52834
I20251025 08:02:29.029870 16390 tablet_bootstrap.cc:492] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.030493 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 9bb5b825be9a44d489151239947d471e (DEFAULT_TABLE table=default.Table_f84103a22819458c976f0d1ca4716b47 [id=fe4920e7d4f143388063f22590eb2f64]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.030851 16390 tablet_bootstrap.cc:654] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.032990 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb5b825be9a44d489151239947d471e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.033805 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 4c301e7a80c64d8e8751ecfa681ab202 with delete_type TABLET_DATA_DELETED (replaced by tablet e0cc4859d32a4e119b413e1cbbb52834) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.034333 16372 tablet_replica.cc:333] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.034476 16372 raft_consensus.cc:2243] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.034566 16372 raft_consensus.cc:2272] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.035108 16371 raft_consensus.cc:2272] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.035207 16392 tablet_bootstrap.cc:492] T c2415c51234f482ca295cc71a74e7cab P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.035291 16392 ts_tablet_manager.cc:1403] T c2415c51234f482ca295cc71a74e7cab P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251025 08:02:29.035346 16372 ts_tablet_manager.cc:1916] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.035810 16371 ts_tablet_manager.cc:1916] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.035816 16392 raft_consensus.cc:359] T c2415c51234f482ca295cc71a74e7cab P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.035916 16392 raft_consensus.cc:385] T c2415c51234f482ca295cc71a74e7cab P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.035962 16392 raft_consensus.cc:740] T c2415c51234f482ca295cc71a74e7cab P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.036080 16392 consensus_queue.cc:260] T c2415c51234f482ca295cc71a74e7cab P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.036370 16392 ts_tablet_manager.cc:1434] T c2415c51234f482ca295cc71a74e7cab P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.036530 16392 tablet_bootstrap.cc:492] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.037334 16372 ts_tablet_manager.cc:1929] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.037405 16372 log.cc:1199] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/4c301e7a80c64d8e8751ecfa681ab202
I20251025 08:02:29.037508 16392 tablet_bootstrap.cc:654] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.037662 16372 ts_tablet_manager.cc:1950] T 4c301e7a80c64d8e8751ecfa681ab202 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.038489 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 4c301e7a80c64d8e8751ecfa681ab202 with delete_type TABLET_DATA_DELETED (replaced by tablet e0cc4859d32a4e119b413e1cbbb52834) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.039351 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 1aa4677de4604abaa2dc6e5413c616a3 (table default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]) successfully deleted
I20251025 08:02:29.039811 14943 tablet_service.cc:1505] Processing CreateTablet for tablet 9bb5b825be9a44d489151239947d471e (DEFAULT_TABLE table=default.Table_f84103a22819458c976f0d1ca4716b47 [id=fe4920e7d4f143388063f22590eb2f64]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.040000 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 4c301e7a80c64d8e8751ecfa681ab202 with delete_type TABLET_DATA_DELETED (replaced by tablet e0cc4859d32a4e119b413e1cbbb52834) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.040042 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9bb5b825be9a44d489151239947d471e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.040185 15380 raft_consensus.cc:493] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.040258 15380 raft_consensus.cc:515] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.040593 15380 leader_election.cc:290] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.041836 14942 tablet_service.cc:1505] Processing CreateTablet for tablet bea55cdfbf454d76920806886c3d2c4e (DEFAULT_TABLE table=default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.042060 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bea55cdfbf454d76920806886c3d2c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.042392 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 4c301e7a80c64d8e8751ecfa681ab202 (table default.Table_acf14806991f4da89dc9bb3361537133 [id=e63210d8c6d148e18496c0bc0d326ab9]) successfully deleted
I20251025 08:02:29.043190 16392 tablet_bootstrap.cc:492] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.043269 16392 ts_tablet_manager.cc:1403] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20251025 08:02:29.043287 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "143b073e21a4456591fa1f96668118b4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:29.043560 15048 leader_election.cc:343] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.043748 16364 ts_tablet_manager.cc:1950] T 04d3488a6b814223b742f0d5c946362f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.043733 16392 raft_consensus.cc:359] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.043828 16392 raft_consensus.cc:385] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.043860 16392 raft_consensus.cc:740] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.043956 16390 tablet_bootstrap.cc:492] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.044032 16390 ts_tablet_manager.cc:1403] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.001s
I20251025 08:02:29.043984 16392 consensus_queue.cc:260] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.044270 16392 ts_tablet_manager.cc:1434] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.044427 16392 tablet_bootstrap.cc:492] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.044498 16390 raft_consensus.cc:359] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.044602 16390 raft_consensus.cc:385] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.044631 16390 raft_consensus.cc:740] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.044684 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 04d3488a6b814223b742f0d5c946362f (table default.Table_32f95976a4704d3fbba9e5c01cb8f9d9 [id=bdcc7cd59c78409fad7b5f687ae81310]) successfully deleted
I20251025 08:02:29.044723 16390 consensus_queue.cc:260] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.044845 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "143b073e21a4456591fa1f96668118b4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.044925 15240 raft_consensus.cc:2468] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:29.044971 16390 ts_tablet_manager.cc:1434] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.045125 16390 tablet_bootstrap.cc:492] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.045148 15049 leader_election.cc:304] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.045240 14946 tablet_service.cc:1505] Processing CreateTablet for tablet 6cedb44483cf4f62acf52b90b6708dfb (DEFAULT_TABLE table=default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.045351 15642 raft_consensus.cc:2804] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.045395 15642 raft_consensus.cc:493] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.045434 14946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cedb44483cf4f62acf52b90b6708dfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.045439 15642 raft_consensus.cc:3060] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.045552 16392 tablet_bootstrap.cc:654] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.046167 16390 tablet_bootstrap.cc:654] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.046515 16392 tablet_bootstrap.cc:492] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.046535 15642 raft_consensus.cc:515] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.046583 16392 ts_tablet_manager.cc:1403] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:29.046846 15642 leader_election.cc:290] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.046994 16392 raft_consensus.cc:359] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.047086 16392 raft_consensus.cc:385] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.047120 16392 raft_consensus.cc:740] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.047232 16392 consensus_queue.cc:260] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.047426 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "143b073e21a4456591fa1f96668118b4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:29.047511 15240 raft_consensus.cc:3060] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.047528 16392 ts_tablet_manager.cc:1434] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.047691 16392 tablet_bootstrap.cc:492] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.048395 15240 raft_consensus.cc:2468] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:29.048566 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "143b073e21a4456591fa1f96668118b4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.048616 16392 tablet_bootstrap.cc:654] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.051733 16364 tablet_replica.cc:333] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.051903 16364 raft_consensus.cc:2243] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.052069 16364 raft_consensus.cc:2272] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.052177 15049 leader_election.cc:304] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.052381 15642 raft_consensus.cc:2804] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.052455 15642 raft_consensus.cc:697] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:29.052562 15642 consensus_queue.cc:237] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.053365 16390 tablet_bootstrap.cc:492] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
W20251025 08:02:29.053364 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 31c9e3906dac487e8585daa13d3fe4b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31c9e3906dac487e8585daa13d3fe4b1 already in progress: creating tablet
I20251025 08:02:29.053439 16390 ts_tablet_manager.cc:1403] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
W20251025 08:02:29.053602 15048 leader_election.cc:343] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.053838 16390 raft_consensus.cc:359] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.053944 16390 raft_consensus.cc:385] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.053977 16390 raft_consensus.cc:740] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.054085 16390 consensus_queue.cc:260] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.054358 16390 ts_tablet_manager.cc:1434] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.054502 16390 tablet_bootstrap.cc:492] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.054925 16364 ts_tablet_manager.cc:1916] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.055404 16390 tablet_bootstrap.cc:654] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.057200 16364 ts_tablet_manager.cc:1929] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:29.057292 16364 log.cc:1199] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/5a940a0698d64770bf5826d9290117b4
I20251025 08:02:29.057525 16364 ts_tablet_manager.cc:1950] T 5a940a0698d64770bf5826d9290117b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.058390 16364 tablet_replica.cc:333] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.058380 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 5a940a0698d64770bf5826d9290117b4 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]) successfully deleted
I20251025 08:02:29.058531 16364 raft_consensus.cc:2243] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
W20251025 08:02:29.058542 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet e762c440cb0947deb7e6a4186deebdc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e762c440cb0947deb7e6a4186deebdc1 already in progress: creating tablet
I20251025 08:02:29.058647 16364 raft_consensus.cc:2272] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.058969 16390 tablet_bootstrap.cc:492] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.059046 16390 ts_tablet_manager.cc:1403] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20251025 08:02:29.059216 16364 ts_tablet_manager.cc:1916] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.059479 16390 raft_consensus.cc:359] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.059562 16390 raft_consensus.cc:385] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.059594 16390 raft_consensus.cc:740] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.059697 16390 consensus_queue.cc:260] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.059947 16390 ts_tablet_manager.cc:1434] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.060101 16390 tablet_bootstrap.cc:492] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.061049 16364 ts_tablet_manager.cc:1929] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.061121 16364 log.cc:1199] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/45be7daf50e741c9b6f1eeedccae8c8e
I20251025 08:02:29.061383 16364 ts_tablet_manager.cc:1950] T 45be7daf50e741c9b6f1eeedccae8c8e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.061893 16391 tablet_bootstrap.cc:492] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.061976 16391 ts_tablet_manager.cc:1403] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.044s user 0.000s sys 0.002s
I20251025 08:02:29.062558 16391 raft_consensus.cc:359] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.062700 16391 raft_consensus.cc:385] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.062772 16391 raft_consensus.cc:740] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.062999 16390 tablet_bootstrap.cc:654] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.062981 16391 consensus_queue.cc:260] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.064867 16364 tablet_replica.cc:333] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.064981 16364 raft_consensus.cc:2243] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.065063 16364 raft_consensus.cc:2272] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.065481 16391 ts_tablet_manager.cc:1434] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:29.065660 16391 tablet_bootstrap.cc:492] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.066627 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 45be7daf50e741c9b6f1eeedccae8c8e (table default.Table_5854b229e0af41b88196de4a1c9c0270 [id=e95f72536b1242469fd4dad2c4d1c276]) successfully deleted
I20251025 08:02:29.067075 16364 ts_tablet_manager.cc:1916] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.068102 16391 tablet_bootstrap.cc:654] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.069128 16364 ts_tablet_manager.cc:1929] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.069204 16364 log.cc:1199] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/4c301e7a80c64d8e8751ecfa681ab202
I20251025 08:02:29.069444 16364 ts_tablet_manager.cc:1950] T 4c301e7a80c64d8e8751ecfa681ab202 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.070042 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 4c301e7a80c64d8e8751ecfa681ab202 (table default.Table_acf14806991f4da89dc9bb3361537133 [id=e63210d8c6d148e18496c0bc0d326ab9]) successfully deleted
I20251025 08:02:29.072733 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_66c1bf4cbbca4bf086d9409663f762f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.073069 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_66c1bf4cbbca4bf086d9409663f762f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.073580 14723 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_c91b6d76e1384dd99d7e69ddee320afb" } modify_external_catalogs: true
I20251025 08:02:29.073652 14721 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 3092fd602dc7478693595ffcbc3bcf45
I20251025 08:02:29.073670 14723 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_c91b6d76e1384dd99d7e69ddee320afb" } modify_external_catalogs: true
W20251025 08:02:29.073781 14719 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 42e8a5ee7d6a42aaaf95c33617abff3f consensus state has no leader
I20251025 08:02:29.073896 14719 master_service.cc:954] ReplaceTablet: received request to replace tablet e106f20977444dd4a49b6e4ae0f45380 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:29.074025 14721 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_b67672426aa24686a8955d366f86ff2d" } new_table_name: "default.Table_1ba04ec4ed664c8eaaeddbf2485375ae" modify_external_catalogs: true
I20251025 08:02:29.074510 14727 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 4edf680e8d4a4b898fd6e64f8ec6f75d
I20251025 08:02:29.074695 14727 catalog_manager.cc:6719] ReplaceTablet: tablet 4edf680e8d4a4b898fd6e64f8ec6f75d deleted and replaced by tablet 1ab6b9d8278045ae92043ada5ce6dd71
I20251025 08:02:29.074823 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_b1d8db45b7d745a0b4dd9ff09300da89"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.075103 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1d8db45b7d745a0b4dd9ff09300da89 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.075313 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 3092fd602dc7478693595ffcbc3bcf45 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.075454 16364 tablet_replica.cc:333] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.075544 16364 raft_consensus.cc:2243] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.075557 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 3092fd602dc7478693595ffcbc3bcf45 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.075727 16372 tablet_replica.cc:333] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.075851 16372 raft_consensus.cc:2243] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.075804 14718 catalog_manager.cc:5649] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:29.075943 16372 raft_consensus.cc:2272] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.076017 14718 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 0078dd6fb0e34d01a54889326dd6dfd7 (table default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b]). Expected version 1 got 0
I20251025 08:02:29.076238 16372 ts_tablet_manager.cc:1916] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.076159 14718 catalog_manager.cc:5649] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:29.076333 14718 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet e87bae31e5e642a5a34a8c170c62fdca (table default.Table_3ad0d85469a7485ba556f83ce20cecdf [id=edf9af4acd364a30814a645d32d35224]). Expected version 1 got 0
I20251025 08:02:29.077180 14725 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 7711a974f4a84d639f1c3077da9d855f
I20251025 08:02:29.077462 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d with delete_type TABLET_DATA_DELETED (replaced by tablet 1ab6b9d8278045ae92043ada5ce6dd71) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.077592 14725 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_ebce5278d348458e8ab930ddd6088775"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.077883 14725 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ebce5278d348458e8ab930ddd6088775 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.077988 14943 tablet_service.cc:1552] Processing DeleteTablet for tablet 7711a974f4a84d639f1c3077da9d855f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.078434 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 7711a974f4a84d639f1c3077da9d855f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.078644 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d with delete_type TABLET_DATA_DELETED (replaced by tablet 1ab6b9d8278045ae92043ada5ce6dd71) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.078651 14724 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_643cee182de94bbf9718fb59a00cf85c" } new_table_name: "default.Table_789c5c7cc2df43f4b7c5c63316f47042" modify_external_catalogs: true
I20251025 08:02:29.078926 16372 ts_tablet_manager.cc:1929] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.078996 16372 log.cc:1199] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/3092fd602dc7478693595ffcbc3bcf45
I20251025 08:02:29.079222 16372 ts_tablet_manager.cc:1950] T 3092fd602dc7478693595ffcbc3bcf45 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.079903 16364 raft_consensus.cc:2272] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.080086 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 3092fd602dc7478693595ffcbc3bcf45 (table default.Table_e96eec11f48049a9b2a4332b23e60a6f [id=de8b64679bcb4ef582d6edd600342a82]) successfully deleted
W20251025 08:02:29.080241 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4edf680e8d4a4b898fd6e64f8ec6f75d already in progress: creating tablet
I20251025 08:02:29.080369 16364 ts_tablet_manager.cc:1916] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.080801 14943 tablet_service.cc:1552] Processing DeleteTablet for tablet 88efe498fb6f4ce1a02b5389ff6f5797 with delete_type TABLET_DATA_DELETED (replaced by tablet bd0cb1245acc40ada9a0b0415bc41291) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.082149 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 7711a974f4a84d639f1c3077da9d855f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.082474 16372 tablet_replica.cc:333] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.082607 16372 raft_consensus.cc:2243] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.082690 16372 raft_consensus.cc:2272] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.083088 14720 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 792c6d7038624ec29e5e36c0145c64db
I20251025 08:02:29.083155 16372 ts_tablet_manager.cc:1916] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.083521 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 792c6d7038624ec29e5e36c0145c64db with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.083880 14943 tablet_service.cc:1552] Processing DeleteTablet for tablet 792c6d7038624ec29e5e36c0145c64db with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.084532 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 792c6d7038624ec29e5e36c0145c64db with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.084894 14942 tablet_service.cc:1552] Processing DeleteTablet for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d with delete_type TABLET_DATA_DELETED (replaced by tablet 1ab6b9d8278045ae92043ada5ce6dd71) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.085177 16372 ts_tablet_manager.cc:1929] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.085238 14946 tablet_service.cc:1552] Processing DeleteTablet for tablet 3092fd602dc7478693595ffcbc3bcf45 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.085273 16372 log.cc:1199] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/7711a974f4a84d639f1c3077da9d855f
I20251025 08:02:29.085522 16372 ts_tablet_manager.cc:1950] T 7711a974f4a84d639f1c3077da9d855f P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.086316 16372 tablet_replica.cc:333] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.086325 14722 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_eb227195b7e4404bb817d7d5e6a87e14" } new_table_name: "default.Table_55260f898adb4a5e9438ea958a0a28ce" modify_external_catalogs: true
I20251025 08:02:29.086434 16372 raft_consensus.cc:2243] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.086535 16372 raft_consensus.cc:2272] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.086856 16372 ts_tablet_manager.cc:1916] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.087100 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 7711a974f4a84d639f1c3077da9d855f (table default.Table_4a4b1eeaa5674710a1a13d7f0f395737 [id=f9c1f298fed0456eb9fd34fe9c124190]) successfully deleted
I20251025 08:02:29.088485 16371 ts_tablet_manager.cc:1929] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:29.088595 16371 log.cc:1199] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/5a70808199034508833e4d2e5550b29b
I20251025 08:02:29.088701 16372 ts_tablet_manager.cc:1929] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:29.088784 16372 log.cc:1199] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/792c6d7038624ec29e5e36c0145c64db
I20251025 08:02:29.088853 16371 ts_tablet_manager.cc:1950] T 5a70808199034508833e4d2e5550b29b P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.089028 16372 ts_tablet_manager.cc:1950] T 792c6d7038624ec29e5e36c0145c64db P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.089388 16371 tablet_replica.cc:333] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.089462 16364 ts_tablet_manager.cc:1929] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.089524 16364 log.cc:1199] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/3092fd602dc7478693595ffcbc3bcf45
I20251025 08:02:29.089509 16371 raft_consensus.cc:2243] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.089614 16371 raft_consensus.cc:2272] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.089756 16364 ts_tablet_manager.cc:1950] T 3092fd602dc7478693595ffcbc3bcf45 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.089986 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 5a70808199034508833e4d2e5550b29b (table default.Table_fb3af07031d2433fa1949ff417c1e03f [id=a788bc4f491d4d7580a83895797f5651]) successfully deleted
I20251025 08:02:29.090319 16364 tablet_replica.cc:333] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.090411 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 3092fd602dc7478693595ffcbc3bcf45 (table default.Table_e96eec11f48049a9b2a4332b23e60a6f [id=de8b64679bcb4ef582d6edd600342a82]) successfully deleted
I20251025 08:02:29.090427 16371 ts_tablet_manager.cc:1916] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.090432 16364 raft_consensus.cc:2243] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.090600 16364 raft_consensus.cc:2272] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.090608 16392 tablet_bootstrap.cc:492] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.090615 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 792c6d7038624ec29e5e36c0145c64db (table default.Table_d4d0cf0460ca4188bf5e9e502111012c [id=7505f67ea24847a6aa9c90955f1596fa]) successfully deleted
I20251025 08:02:29.090682 16392 ts_tablet_manager.cc:1403] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.043s user 0.001s sys 0.000s
I20251025 08:02:29.091121 16392 raft_consensus.cc:359] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.091204 16392 raft_consensus.cc:385] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.091230 16392 raft_consensus.cc:740] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.091333 16392 consensus_queue.cc:260] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.091569 16392 ts_tablet_manager.cc:1434] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.091722 16392 tablet_bootstrap.cc:492] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.092181 16371 ts_tablet_manager.cc:1929] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:29.092236 16371 log.cc:1199] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/1ee00271d2354ae38dcb5a3289cea72f
I20251025 08:02:29.092460 16371 ts_tablet_manager.cc:1950] T 1ee00271d2354ae38dcb5a3289cea72f P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.092604 16392 tablet_bootstrap.cc:654] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.092723 16364 ts_tablet_manager.cc:1916] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.092908 14719 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet e106f20977444dd4a49b6e4ae0f45380
I20251025 08:02:29.093036 16371 tablet_replica.cc:333] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.093134 16371 raft_consensus.cc:2243] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.093185 14719 catalog_manager.cc:6719] ReplaceTablet: tablet e106f20977444dd4a49b6e4ae0f45380 deleted and replaced by tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c
I20251025 08:02:29.093274 16371 raft_consensus.cc:2272] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.093330 14719 master_service.cc:954] ReplaceTablet: received request to replace tablet a3379087113041beba7ddbc6596c3b0a from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:29.093564 16371 ts_tablet_manager.cc:1916] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.094040 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet e106f20977444dd4a49b6e4ae0f45380 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.094358 14946 tablet_service.cc:1552] Processing DeleteTablet for tablet e106f20977444dd4a49b6e4ae0f45380 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.094460 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 1ee00271d2354ae38dcb5a3289cea72f (table default.Table_987c3335f4514378a8db45a9f45e3c4d [id=1ee33ee129d749d0bd7f26dc49fca0fe]) successfully deleted
W20251025 08:02:29.094594 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 04d3488a6b814223b742f0d5c946362f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 04d3488a6b814223b742f0d5c946362f already in progress: creating tablet
I20251025 08:02:29.094771 16391 tablet_bootstrap.cc:492] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.094832 16391 ts_tablet_manager.cc:1403] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20251025 08:02:29.095258 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet e106f20977444dd4a49b6e4ae0f45380 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.095362 16391 raft_consensus.cc:359] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.095903 16391 raft_consensus.cc:385] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.095957 16391 raft_consensus.cc:740] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.096071 16391 consensus_queue.cc:260] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.097785 16364 ts_tablet_manager.cc:1929] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.097841 16364 log.cc:1199] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/7711a974f4a84d639f1c3077da9d855f
W20251025 08:02:29.097882 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet e106f20977444dd4a49b6e4ae0f45380 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e106f20977444dd4a49b6e4ae0f45380 already in progress: creating tablet
I20251025 08:02:29.098078 16364 ts_tablet_manager.cc:1950] T 7711a974f4a84d639f1c3077da9d855f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.098104 16391 ts_tablet_manager.cc:1434] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:29.098524 16391 tablet_bootstrap.cc:492] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.098709 16364 tablet_replica.cc:333] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.098699 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 7711a974f4a84d639f1c3077da9d855f (table default.Table_4a4b1eeaa5674710a1a13d7f0f395737 [id=f9c1f298fed0456eb9fd34fe9c124190]) successfully deleted
I20251025 08:02:29.098816 16364 raft_consensus.cc:2243] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
W20251025 08:02:29.098937 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4edf680e8d4a4b898fd6e64f8ec6f75d already in progress: creating tablet
I20251025 08:02:29.098990 16364 raft_consensus.cc:2272] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.099321 16364 ts_tablet_manager.cc:1916] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.099418 16391 tablet_bootstrap.cc:654] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.100875 15642 raft_consensus.cc:493] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.100955 15642 raft_consensus.cc:515] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.101219 16392 tablet_bootstrap.cc:492] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.101287 16392 ts_tablet_manager.cc:1403] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:29.101322 15642 leader_election.cc:290] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.101670 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7ff0b4596944f38ae9325a95167c287" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.101696 16392 raft_consensus.cc:359] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.101780 16392 raft_consensus.cc:385] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.101809 16392 raft_consensus.cc:740] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.101794 15239 raft_consensus.cc:2468] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:29.101910 16392 consensus_queue.cc:260] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.102208 16392 ts_tablet_manager.cc:1434] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.102380 16392 tablet_bootstrap.cc:492] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.102557 16199 raft_consensus.cc:493] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.102630 16199 raft_consensus.cc:515] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.102960 16199 leader_election.cc:290] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.103143 16390 tablet_bootstrap.cc:492] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.103211 16390 ts_tablet_manager.cc:1403] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.043s user 0.001s sys 0.000s
I20251025 08:02:29.103252 16392 tablet_bootstrap.cc:654] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.103674 16390 raft_consensus.cc:359] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.103753 16390 raft_consensus.cc:385] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.103781 16390 raft_consensus.cc:740] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.103866 16390 consensus_queue.cc:260] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.104120 16390 ts_tablet_manager.cc:1434] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.104302 16390 tablet_bootstrap.cc:492] T 090117a75882489d84687e41b50616e9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.104351 15049 leader_election.cc:304] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.104389 16364 ts_tablet_manager.cc:1929] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:29.104436 16364 log.cc:1199] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/792c6d7038624ec29e5e36c0145c64db
I20251025 08:02:29.104671 16364 ts_tablet_manager.cc:1950] T 792c6d7038624ec29e5e36c0145c64db P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.104739 16582 raft_consensus.cc:2804] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.104795 16582 raft_consensus.cc:493] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.104833 16582 raft_consensus.cc:3060] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.105113 16425 tablet.cc:1722] T 3743a9de419d40689c49aae471edfa01 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.104744 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51fca67cb1b84e44a491b6a788c01062" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.105409 16390 tablet_bootstrap.cc:654] T 090117a75882489d84687e41b50616e9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.105427 15113 raft_consensus.cc:2468] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:29.105751 16582 raft_consensus.cc:515] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.106046 16582 leader_election.cc:290] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.106273 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51fca67cb1b84e44a491b6a788c01062" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.106417 15185 leader_election.cc:304] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.106621 16570 raft_consensus.cc:2804] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.106666 16570 raft_consensus.cc:493] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.106703 16570 raft_consensus.cc:3060] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.107471 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 792c6d7038624ec29e5e36c0145c64db (table default.Table_d4d0cf0460ca4188bf5e9e502111012c [id=7505f67ea24847a6aa9c90955f1596fa]) successfully deleted
W20251025 08:02:29.107635 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet e106f20977444dd4a49b6e4ae0f45380 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e106f20977444dd4a49b6e4ae0f45380 already in progress: creating tablet
I20251025 08:02:29.107661 16570 raft_consensus.cc:515] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.107968 16570 leader_election.cc:290] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
W20251025 08:02:29.108302 15183 leader_election.cc:343] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.109252 16391 tablet_bootstrap.cc:492] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.109321 16391 ts_tablet_manager.cc:1403] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.001s
I20251025 08:02:29.109603 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51fca67cb1b84e44a491b6a788c01062" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:29.109694 15113 raft_consensus.cc:3060] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.109690 16391 raft_consensus.cc:359] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.109768 16391 raft_consensus.cc:385] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.109793 16391 raft_consensus.cc:740] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.109887 16391 consensus_queue.cc:260] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.110258 16391 ts_tablet_manager.cc:1434] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.110392 16391 tablet_bootstrap.cc:492] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.110587 15113 raft_consensus.cc:2468] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:29.111637 15185 leader_election.cc:304] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.111802 16199 raft_consensus.cc:2804] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.111878 16199 raft_consensus.cc:697] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:29.111984 16199 consensus_queue.cc:237] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.112766 16391 tablet_bootstrap.cc:654] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.113898 16570 consensus_queue.cc:1048] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.115516 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51fca67cb1b84e44a491b6a788c01062" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.115837 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7ff0b4596944f38ae9325a95167c287" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.116030 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7ff0b4596944f38ae9325a95167c287" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.117008 16371 ts_tablet_manager.cc:1929] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:29.117061 16371 log.cc:1199] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/72ff369b973b4c5981ea0810e37e8562
I20251025 08:02:29.117367 16582 raft_consensus.cc:493] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.117434 16582 raft_consensus.cc:515] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.117733 16582 leader_election.cc:290] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:29.118103 15183 leader_election.cc:343] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.118449 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7ff0b4596944f38ae9325a95167c287" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:29.118546 15239 raft_consensus.cc:3060] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.118579 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b04e5c106dd7400aa039dbf6666ad3aa" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.118672 15237 raft_consensus.cc:2468] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:29.119398 15239 raft_consensus.cc:2468] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:29.119534 16371 ts_tablet_manager.cc:1950] T 72ff369b973b4c5981ea0810e37e8562 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.119370 16463 tablet.cc:1722] T 3743a9de419d40689c49aae471edfa01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.120024 16371 tablet_replica.cc:333] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
W20251025 08:02:29.120038 15048 leader_election.cc:343] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:29.120162 15048 leader_election.cc:343] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.120203 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b04e5c106dd7400aa039dbf6666ad3aa" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.120235 16371 raft_consensus.cc:2243] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.120391 16371 raft_consensus.cc:2272] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.120394 16415 tablet.cc:1722] T 3743a9de419d40689c49aae471edfa01 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.120729 16371 ts_tablet_manager.cc:1916] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.121878 16390 tablet_bootstrap.cc:492] T 090117a75882489d84687e41b50616e9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.121948 16390 ts_tablet_manager.cc:1403] T 090117a75882489d84687e41b50616e9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20251025 08:02:29.122411 16390 raft_consensus.cc:359] T 090117a75882489d84687e41b50616e9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.122467 16371 ts_tablet_manager.cc:1929] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:29.122494 16390 raft_consensus.cc:385] T 090117a75882489d84687e41b50616e9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.122521 16371 log.cc:1199] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/e3cd7b63fa174ee192ff909f149e8b17
I20251025 08:02:29.122524 16390 raft_consensus.cc:740] T 090117a75882489d84687e41b50616e9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.122630 16390 consensus_queue.cc:260] T 090117a75882489d84687e41b50616e9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.122896 16390 ts_tablet_manager.cc:1434] T 090117a75882489d84687e41b50616e9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.123073 16390 tablet_bootstrap.cc:492] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.123494 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 72ff369b973b4c5981ea0810e37e8562 (table default.Table_beff096618394ac1b31db74a94a9f991 [id=8a0e4fe9e4544c539cb23b0279c1deaf]) successfully deleted
I20251025 08:02:29.123664 16371 ts_tablet_manager.cc:1950] T e3cd7b63fa174ee192ff909f149e8b17 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.123973 16390 tablet_bootstrap.cc:654] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.124228 16371 tablet_replica.cc:333] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.124346 16371 raft_consensus.cc:2243] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.124419 16371 raft_consensus.cc:2272] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:29.124537 15048 leader_election.cc:343] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.124688 16371 ts_tablet_manager.cc:1916] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.126252 15049 leader_election.cc:304] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.126410 16371 ts_tablet_manager.cc:1929] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.126463 16371 log.cc:1199] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/8e0cc372400447b48e5fecfc009a11c2
I20251025 08:02:29.126493 15049 leader_election.cc:304] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.126667 16371 ts_tablet_manager.cc:1950] T 8e0cc372400447b48e5fecfc009a11c2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.126742 15380 raft_consensus.cc:2804] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.126789 15380 raft_consensus.cc:493] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.126824 15380 raft_consensus.cc:3060] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.127012 16582 raft_consensus.cc:2804] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.127070 16582 raft_consensus.cc:697] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:29.127095 16371 tablet_replica.cc:333] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.127188 16371 raft_consensus.cc:2243] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.127163 16582 consensus_queue.cc:237] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.127314 16371 raft_consensus.cc:2272] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.127565 16371 ts_tablet_manager.cc:1916] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.127710 15380 raft_consensus.cc:515] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.127849 16199 raft_consensus.cc:493] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.127912 16199 raft_consensus.cc:515] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.127996 15380 leader_election.cc:290] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.128216 16199 leader_election.cc:290] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.128535 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f1b1d6cc6cf4f9b8aa5c7d121468bf4" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.128629 15112 raft_consensus.cc:2468] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:29.129009 15185 leader_election.cc:304] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.129155 16199 raft_consensus.cc:2804] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.129200 16199 raft_consensus.cc:493] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.129243 16199 raft_consensus.cc:3060] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.129647 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet e3cd7b63fa174ee192ff909f149e8b17 (table default.Table_a368af9d0b8d46d78f9158b8f9949b01 [id=425e69ea7f8a407e8d22b735ee62c709]) successfully deleted
W20251025 08:02:29.129798 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet e48ddcfccc1340d39d21ce94bec4bf27 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e48ddcfccc1340d39d21ce94bec4bf27 already in progress: creating tablet
I20251025 08:02:29.129914 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 8e0cc372400447b48e5fecfc009a11c2 (table default.Table_ad3dee0a2af74757a17bc9fd115a69cb [id=e9162dd5a2524394b1cb11594293de96]) successfully deleted
I20251025 08:02:29.129984 16390 tablet_bootstrap.cc:492] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.130074 16390 ts_tablet_manager.cc:1403] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251025 08:02:29.130049 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b04e5c106dd7400aa039dbf6666ad3aa" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.130194 16199 raft_consensus.cc:515] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.130468 16199 leader_election.cc:290] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.130512 16390 raft_consensus.cc:359] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.130612 16390 raft_consensus.cc:385] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.130641 16390 raft_consensus.cc:740] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.130739 16390 consensus_queue.cc:260] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.130856 16570 raft_consensus.cc:493] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.130873 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f1b1d6cc6cf4f9b8aa5c7d121468bf4" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:29.130900 16570 raft_consensus.cc:515] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.130959 15112 raft_consensus.cc:3060] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.131165 16570 leader_election.cc:290] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.131402 16390 ts_tablet_manager.cc:1434] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.131532 16390 tablet_bootstrap.cc:492] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.131836 15112 raft_consensus.cc:2468] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:29.131856 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b04e5c106dd7400aa039dbf6666ad3aa" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:29.131958 15239 raft_consensus.cc:3060] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.132324 15185 leader_election.cc:304] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.132984 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f1b1d6cc6cf4f9b8aa5c7d121468bf4" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.133191 16570 raft_consensus.cc:2804] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.133261 16570 raft_consensus.cc:697] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:29.133301 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f1b1d6cc6cf4f9b8aa5c7d121468bf4" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.133363 16570 consensus_queue.cc:237] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.133466 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f65b1ad4764a4ed3a33baccaf278f043" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.133703 15239 raft_consensus.cc:2468] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
W20251025 08:02:29.134649 15048 leader_election.cc:343] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.134719 16421 raft_consensus.cc:493] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.134784 16421 raft_consensus.cc:515] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:29.135002 15183 leader_election.cc:343] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.135133 16421 leader_election.cc:290] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:29.135154 15183 leader_election.cc:343] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:29.135319 15183 leader_election.cc:343] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.135483 16390 tablet_bootstrap.cc:654] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.135711 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d84ee63450243f8910ad4bd1ec6459e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.135716 15049 leader_election.cc:304] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.135953 15642 raft_consensus.cc:2804] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.136030 15642 raft_consensus.cc:697] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:29.136125 15642 consensus_queue.cc:237] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.136300 16371 ts_tablet_manager.cc:1929] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.136353 16371 log.cc:1199] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/821de6815eb244058f1d8a7a06bf48a6
I20251025 08:02:29.136557 16371 ts_tablet_manager.cc:1950] T 821de6815eb244058f1d8a7a06bf48a6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.135716 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f65b1ad4764a4ed3a33baccaf278f043" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.136950 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4d84ee63450243f8910ad4bd1ec6459e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.136963 15112 raft_consensus.cc:2468] T f65b1ad4764a4ed3a33baccaf278f043 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:29.137050 15111 raft_consensus.cc:2393] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:29.137238 15185 leader_election.cc:304] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.137293 14915 leader_election.cc:304] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.137424 16570 raft_consensus.cc:2804] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.137444 16421 raft_consensus.cc:3060] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.137472 16570 raft_consensus.cc:493] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.137504 16570 raft_consensus.cc:3060] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.138334 16421 raft_consensus.cc:2749] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.138348 16570 raft_consensus.cc:515] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.138652 16570 leader_election.cc:290] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.138993 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f65b1ad4764a4ed3a33baccaf278f043" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:29.139079 15111 raft_consensus.cc:3060] T f65b1ad4764a4ed3a33baccaf278f043 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.139468 16371 tablet_replica.cc:333] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.139567 16371 raft_consensus.cc:2243] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.139648 16371 raft_consensus.cc:2272] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.139933 16371 ts_tablet_manager.cc:1916] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.139952 15111 raft_consensus.cc:2468] T f65b1ad4764a4ed3a33baccaf278f043 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:29.140244 15185 leader_election.cc:304] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.140592 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f65b1ad4764a4ed3a33baccaf278f043" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.140650 16425 tablet.cc:1722] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:29.141139 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 821de6815eb244058f1d8a7a06bf48a6 (table default.Table_c485105a684f427295b74968c29fd30c [id=3abb3c7d3dd74d408db083bf0499f679]) successfully deleted
I20251025 08:02:29.141232 16199 raft_consensus.cc:2804] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.141327 16199 raft_consensus.cc:697] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:29.141475 16199 consensus_queue.cc:237] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.141921 16415 tablet.cc:1722] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:29.143719 16371 ts_tablet_manager.cc:1929] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.143795 16371 log.cc:1199] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/7b8d94fc010046c7b37804f168471904
I20251025 08:02:29.144026 16371 ts_tablet_manager.cc:1950] T 7b8d94fc010046c7b37804f168471904 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.144467 16371 tablet_replica.cc:333] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.144603 16371 raft_consensus.cc:2243] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.147066 16392 tablet_bootstrap.cc:492] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.147200 16392 ts_tablet_manager.cc:1403] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.000s
I20251025 08:02:29.147593 16392 raft_consensus.cc:359] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.147680 16392 raft_consensus.cc:385] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.147706 16392 raft_consensus.cc:740] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.147783 16392 consensus_queue.cc:260] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.147993 16392 ts_tablet_manager.cc:1434] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:29.148125 16392 tablet_bootstrap.cc:492] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.148337 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 7b8d94fc010046c7b37804f168471904 (table default.Table_521f904aba4a4b309e9864df54df659d [id=a95abf5644c64177afde71baad186bca]) successfully deleted
W20251025 08:02:29.149205 15183 leader_election.cc:343] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.150038 16390 tablet_bootstrap.cc:492] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.150117 16390 ts_tablet_manager.cc:1403] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.001s
I20251025 08:02:29.150308 16463 tablet.cc:1722] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:29.150575 16390 raft_consensus.cc:359] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.150657 16390 raft_consensus.cc:385] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.150683 16390 raft_consensus.cc:740] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.150779 16390 consensus_queue.cc:260] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.151028 16390 ts_tablet_manager.cc:1434] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:29.144778 16371 raft_consensus.cc:2272] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.151213 16390 tablet_bootstrap.cc:492] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.151573 16371 ts_tablet_manager.cc:1916] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.148489 16391 tablet_bootstrap.cc:492] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.151976 16391 ts_tablet_manager.cc:1403] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.042s user 0.001s sys 0.000s
I20251025 08:02:29.152374 16392 tablet_bootstrap.cc:654] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.152483 16391 raft_consensus.cc:359] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.152570 16391 raft_consensus.cc:385] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.152601 16391 raft_consensus.cc:740] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.152697 16391 consensus_queue.cc:260] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.152935 16391 ts_tablet_manager.cc:1434] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.153095 16391 tablet_bootstrap.cc:492] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.153924 16391 tablet_bootstrap.cc:654] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.155980 16392 tablet_bootstrap.cc:492] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.156117 16392 ts_tablet_manager.cc:1403] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251025 08:02:29.156582 16390 tablet_bootstrap.cc:654] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.156596 16392 raft_consensus.cc:359] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.156745 16392 raft_consensus.cc:385] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.156819 16392 raft_consensus.cc:740] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.156980 16392 consensus_queue.cc:260] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.156694 16570 consensus_queue.cc:1048] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.158650 16391 tablet_bootstrap.cc:492] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.158733 16391 ts_tablet_manager.cc:1403] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:29.158777 16371 ts_tablet_manager.cc:1929] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.158831 16371 log.cc:1199] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/e4f92b0605754327883b144fb6c96aea
I20251025 08:02:29.159149 14721 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_221091e6cc7f49d0ba8ff4c967382bce"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:29.159211 16391 raft_consensus.cc:359] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.159284 16391 raft_consensus.cc:385] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.159312 16391 raft_consensus.cc:740] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.159423 16371 ts_tablet_manager.cc:1950] T e4f92b0605754327883b144fb6c96aea P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.159407 16391 consensus_queue.cc:260] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:29.159545 14721 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_221091e6cc7f49d0ba8ff4c967382bce in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.159631 16391 ts_tablet_manager.cc:1434] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.159802 16391 tablet_bootstrap.cc:492] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.159921 16371 tablet_replica.cc:333] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.160041 16371 raft_consensus.cc:2243] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.160123 16371 raft_consensus.cc:2272] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.160703 16391 tablet_bootstrap.cc:654] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.163321 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet e4f92b0605754327883b144fb6c96aea (table default.Table_eaf82018b440497e86dbf2cfdd3785e5 [id=2ef2d72066f446619f9045da34df7814]) successfully deleted
I20251025 08:02:29.165831 16391 tablet_bootstrap.cc:492] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.165899 16391 ts_tablet_manager.cc:1403] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:29.166314 16391 raft_consensus.cc:359] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.166389 16391 raft_consensus.cc:385] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.166414 16391 raft_consensus.cc:740] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.166502 16391 consensus_queue.cc:260] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.166728 16391 ts_tablet_manager.cc:1434] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.166859 16391 tablet_bootstrap.cc:492] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.167698 16391 tablet_bootstrap.cc:654] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.168901 16391 tablet_bootstrap.cc:492] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.168967 16391 ts_tablet_manager.cc:1403] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:29.169512 16391 raft_consensus.cc:359] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.169592 16391 raft_consensus.cc:385] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.169621 16391 raft_consensus.cc:740] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.169731 16391 consensus_queue.cc:260] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.170020 16391 ts_tablet_manager.cc:1434] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.170168 16391 tablet_bootstrap.cc:492] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.170670 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_27c6a21fc727493fba3613698ba9e108"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:29.171015 16391 tablet_bootstrap.cc:654] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:29.171000 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_27c6a21fc727493fba3613698ba9e108 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.171880 16570 raft_consensus.cc:493] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.171954 16570 raft_consensus.cc:515] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.172279 16570 leader_election.cc:290] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.172632 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60c49b70f8f44dd3aec433206b897843" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:29.172887 15183 leader_election.cc:343] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.173372 16391 tablet_bootstrap.cc:492] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.173444 16391 ts_tablet_manager.cc:1403] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20251025 08:02:29.173825 16391 raft_consensus.cc:359] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.173921 16391 raft_consensus.cc:385] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.173951 16391 raft_consensus.cc:740] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.174067 16391 consensus_queue.cc:260] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.174310 16391 ts_tablet_manager.cc:1434] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.174351 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60c49b70f8f44dd3aec433206b897843" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.174463 15111 raft_consensus.cc:2468] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:29.174475 16391 tablet_bootstrap.cc:492] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.175341 16391 tablet_bootstrap.cc:654] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.177649 16371 ts_tablet_manager.cc:1916] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.177873 15185 leader_election.cc:304] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.178037 16570 raft_consensus.cc:2804] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.178097 16570 raft_consensus.cc:493] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.178138 16570 raft_consensus.cc:3060] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.178424 16392 ts_tablet_manager.cc:1434] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.022s user 0.001s sys 0.000s
I20251025 08:02:29.179057 16570 raft_consensus.cc:515] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.179409 16570 leader_election.cc:290] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.179795 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60c49b70f8f44dd3aec433206b897843" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:29.180156 15183 leader_election.cc:343] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.180657 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "60c49b70f8f44dd3aec433206b897843" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:29.180745 15111 raft_consensus.cc:3060] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.181272 14725 master_service.cc:954] ReplaceTablet: received request to replace tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:29.181512 14723 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet a8393462039d4bb4aba66aee9e90b94a
I20251025 08:02:29.181569 15111 raft_consensus.cc:2468] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:29.181808 15185 leader_election.cc:304] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.182001 16570 raft_consensus.cc:2804] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.182317 16570 raft_consensus.cc:697] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:29.182442 16570 consensus_queue.cc:237] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.182735 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet a8393462039d4bb4aba66aee9e90b94a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.182932 16364 tablet_replica.cc:333] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.183048 16364 raft_consensus.cc:2243] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.183127 16364 raft_consensus.cc:2272] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.183434 16364 ts_tablet_manager.cc:1916] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:29.185263 14722 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fcc08d74df2d46c58ca27f5d467e060f consensus state has no leader
I20251025 08:02:29.185346 14723 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_6c4b782dd6a04a1bbeb82b8537829558"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:29.185477 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_c2e0c935fdb34bc38f482cac268ad080"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:29.185509 16364 ts_tablet_manager.cc:1929] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.185563 16364 log.cc:1199] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/a8393462039d4bb4aba66aee9e90b94a
W20251025 08:02:29.185639 14723 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c4b782dd6a04a1bbeb82b8537829558 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:29.185678 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c2e0c935fdb34bc38f482cac268ad080 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.185792 16364 ts_tablet_manager.cc:1950] T a8393462039d4bb4aba66aee9e90b94a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.186296 14719 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet a3379087113041beba7ddbc6596c3b0a
I20251025 08:02:29.186568 14719 catalog_manager.cc:6719] ReplaceTablet: tablet a3379087113041beba7ddbc6596c3b0a deleted and replaced by tablet bc56844d88604fa5be02cd82b5856cd1
I20251025 08:02:29.186738 14719 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_05fb668587d14b6c8f3a12bb75fa1423" } modify_external_catalogs: true
I20251025 08:02:29.186826 14719 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_05fb668587d14b6c8f3a12bb75fa1423" } modify_external_catalogs: true
I20251025 08:02:29.181941 16371 ts_tablet_manager.cc:1929] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.187217 16371 log.cc:1199] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/0f55c551037a4619808e18e461940d6d
I20251025 08:02:29.187433 14724 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_e3dddd8db8a64833bd7de5ad2fec599a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.187724 14724 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3dddd8db8a64833bd7de5ad2fec599a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.188104 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet a3379087113041beba7ddbc6596c3b0a with delete_type TABLET_DATA_DELETED (replaced by tablet bc56844d88604fa5be02cd82b5856cd1) from {username='slave'} at 127.0.0.1:47274
W20251025 08:02:29.188584 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet a3379087113041beba7ddbc6596c3b0a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3379087113041beba7ddbc6596c3b0a already in progress: creating tablet
I20251025 08:02:29.188906 16371 ts_tablet_manager.cc:1950] T 0f55c551037a4619808e18e461940d6d P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.189273 14721 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_9292537f05ee4b0ba5356d5f4edc0840"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:29.190052 16371 tablet_replica.cc:333] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.190128 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet a8393462039d4bb4aba66aee9e90b94a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.190253 16371 raft_consensus.cc:2243] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.184144 14942 tablet_service.cc:1552] Processing DeleteTablet for tablet a8393462039d4bb4aba66aee9e90b94a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.190315 16372 tablet_replica.cc:333] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.190409 14946 tablet_service.cc:1552] Processing DeleteTablet for tablet a3379087113041beba7ddbc6596c3b0a with delete_type TABLET_DATA_DELETED (replaced by tablet bc56844d88604fa5be02cd82b5856cd1) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.190416 16372 raft_consensus.cc:2243] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.190418 16371 raft_consensus.cc:2272] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.190441 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 0f55c551037a4619808e18e461940d6d (table default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]) successfully deleted
I20251025 08:02:29.184221 15374 raft_consensus.cc:493] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251025 08:02:29.190572 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 already in progress: creating tablet
I20251025 08:02:29.190616 16372 raft_consensus.cc:2272] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.190600 15374 raft_consensus.cc:515] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:29.190691 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 3f5cff308fc9448db40b0d4df03c69bb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3f5cff308fc9448db40b0d4df03c69bb already in progress: creating tablet
W20251025 08:02:29.190858 14721 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9292537f05ee4b0ba5356d5f4edc0840 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.190915 15374 leader_election.cc:290] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.190905 16371 ts_tablet_manager.cc:1916] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.190929 16372 ts_tablet_manager.cc:1916] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.192842 16371 ts_tablet_manager.cc:1929] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.192956 16371 log.cc:1199] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/049cc6add40d44fc9d67c89eca89ce59
I20251025 08:02:29.193214 16372 ts_tablet_manager.cc:1929] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.193257 16371 ts_tablet_manager.cc:1950] T 049cc6add40d44fc9d67c89eca89ce59 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.193383 15374 raft_consensus.cc:493] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.193430 16372 log.cc:1199] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/a8393462039d4bb4aba66aee9e90b94a
I20251025 08:02:29.193449 15374 raft_consensus.cc:515] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.193661 16372 ts_tablet_manager.cc:1950] T a8393462039d4bb4aba66aee9e90b94a P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.193734 15374 leader_election.cc:290] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.194058 15384 raft_consensus.cc:493] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.194129 15384 raft_consensus.cc:515] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.194442 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet a8393462039d4bb4aba66aee9e90b94a (table default.Table_c91b6d76e1384dd99d7e69ddee320afb [id=244c5edd72af4af790d96dd294e8d8c4]) successfully deleted
I20251025 08:02:29.195211 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "143b073e21a4456591fa1f96668118b4" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.195688 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "143b073e21a4456591fa1f96668118b4" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.195843 15239 raft_consensus.cc:2393] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:29.197127 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet a8393462039d4bb4aba66aee9e90b94a (table default.Table_c91b6d76e1384dd99d7e69ddee320afb [id=244c5edd72af4af790d96dd294e8d8c4]) successfully deleted
W20251025 08:02:29.197166 14914 leader_election.cc:343] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: 40f70d2139534907ab929dae893c740d
I20251025 08:02:29.197284 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet a3379087113041beba7ddbc6596c3b0a with delete_type TABLET_DATA_DELETED (replaced by tablet bc56844d88604fa5be02cd82b5856cd1) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.197672 15384 leader_election.cc:290] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:29.198462 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cc676245d2984363b4af1e817b444c3d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:29.198802 15183 leader_election.cc:343] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:29.199494 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet a3379087113041beba7ddbc6596c3b0a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3379087113041beba7ddbc6596c3b0a already in progress: creating tablet
W20251025 08:02:29.200718 14915 leader_election.cc:343] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 40f70d2139534907ab929dae893c740d
I20251025 08:02:29.200798 14915 leader_election.cc:304] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.200997 15374 raft_consensus.cc:2749] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.201021 14915 leader_election.cc:304] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.201153 15374 raft_consensus.cc:3060] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.201974 15374 raft_consensus.cc:2749] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.202330 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cc676245d2984363b4af1e817b444c3d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.202440 15112 raft_consensus.cc:2468] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:29.203354 15185 leader_election.cc:304] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.203799 16392 tablet_bootstrap.cc:492] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.204130 16415 tablet.cc:1722] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.204399 16572 raft_consensus.cc:2804] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.204454 16572 raft_consensus.cc:493] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.204493 16572 raft_consensus.cc:3060] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.203569 16463 tablet.cc:1722] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.205142 16392 tablet_bootstrap.cc:654] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.205403 16572 raft_consensus.cc:515] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.205694 16572 leader_election.cc:290] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:29.210659 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 24e0f02dd56644a3930c1cc0a972132e (DEFAULT_TABLE table=default.Table_14a3c11816aa4e2d93e0a9912024dbd2 [id=4e3924f6f712459db0d167bb72825701]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.210870 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24e0f02dd56644a3930c1cc0a972132e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.213781 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 93d383e3e2f4493d9cc8a71a4284e107 (DEFAULT_TABLE table=default.Table_0ac9d6fdd08b48f0b70da65d5f7a722a [id=7c9a46c4cada46ad916b89605c18190f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.213807 15217 tablet_service.cc:1505] Processing CreateTablet for tablet 1927cf6a9013402a92c9e6e89e2e1715 (DEFAULT_TABLE table=default.Table_d03eda3087a54490a502678eeeeeabc8 [id=1297b3a21b8a458d80575525d6df9783]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.213920 15222 tablet_service.cc:1505] Processing CreateTablet for tablet 6a3ec64b273d4e8c92b1e24061ac7336 (DEFAULT_TABLE table=default.Table_1068ad8fb18a4d21954bb70b20fd5760 [id=79c76995e71143438cb6e30a9df85c31]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.214036 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d383e3e2f4493d9cc8a71a4284e107. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.214159 15214 tablet_service.cc:1505] Processing CreateTablet for tablet 8b69d792862540b6ad1b5d56dea17499 (DEFAULT_TABLE table=default.Table_8c890e1813a149b88e2168cf6a19b056 [id=90132a732dd24174a9b63820b5ce85f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.213781 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 64996b8137f647b993923cb1bb093211 (DEFAULT_TABLE table=default.Table_c8ac7973eef94a68bf4ebe1459c2e6e6 [id=3c371b3791fd45be983458cd55d67827]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.214691 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 446194cf013c4b6499deb00fab8db42a (DEFAULT_TABLE table=default.Table_1294a307080744bd964b420814ae843f [id=8be0a7e83b634a6b90b3bf1bb535585c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.214169 15217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1927cf6a9013402a92c9e6e89e2e1715. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.214922 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 14b47bf733754b72b34bd74aa033afa3 (DEFAULT_TABLE table=default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.214975 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446194cf013c4b6499deb00fab8db42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.215101 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b47bf733754b72b34bd74aa033afa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.215864 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64996b8137f647b993923cb1bb093211. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.216152 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3ec64b273d4e8c92b1e24061ac7336. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.216481 14720 catalog_manager.cc:5649] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:29.216797 14720 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 0078dd6fb0e34d01a54889326dd6dfd7 (table default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b]). Expected version 1 got 0
I20251025 08:02:29.216928 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b69d792862540b6ad1b5d56dea17499. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.217332 15384 raft_consensus.cc:493] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.217396 15384 raft_consensus.cc:515] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.217670 15384 leader_election.cc:290] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:29.218729 16371 tablet_replica.cc:333] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.218864 16371 raft_consensus.cc:2243] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.218976 16371 pending_rounds.cc:70] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:29.219012 16371 pending_rounds.cc:77] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609812963299328 op_type: NO_OP noop_request { }
I20251025 08:02:29.219051 16371 raft_consensus.cc:2889] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:29.219094 16371 raft_consensus.cc:2272] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.219619 16391 tablet_bootstrap.cc:492] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.219686 16391 ts_tablet_manager.cc:1403] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.045s user 0.001s sys 0.001s
I20251025 08:02:29.220194 16391 raft_consensus.cc:359] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.220304 16391 raft_consensus.cc:385] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.220331 16391 raft_consensus.cc:740] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.220440 16391 consensus_queue.cc:260] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.220701 16391 ts_tablet_manager.cc:1434] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.220852 16391 tablet_bootstrap.cc:492] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.221179 14718 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_c13a8bad402148f19fcdc19766286842 [id=b5be4f412cc04aa59c819d0e1cc403bf] alter complete (version 1)
I20251025 08:02:29.221769 16391 tablet_bootstrap.cc:654] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.223274 16391 tablet_bootstrap.cc:492] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.223347 16391 ts_tablet_manager.cc:1403] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:29.223379 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 049cc6add40d44fc9d67c89eca89ce59 (table default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]) successfully deleted
I20251025 08:02:29.223717 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cc676245d2984363b4af1e817b444c3d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.223853 16391 raft_consensus.cc:359] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.223937 16391 raft_consensus.cc:385] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.223966 16391 raft_consensus.cc:740] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.223994 14946 tablet_service.cc:1505] Processing CreateTablet for tablet 24e0f02dd56644a3930c1cc0a972132e (DEFAULT_TABLE table=default.Table_14a3c11816aa4e2d93e0a9912024dbd2 [id=4e3924f6f712459db0d167bb72825701]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.223984 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 36cb8c32d8cb4fbb9be18767c0336506 (DEFAULT_TABLE table=default.Table_19e4d10cf3d64b008591270ed9ee26f3 [id=2481098eb7b44b7ca9be9b9393a44523]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.224076 16391 consensus_queue.cc:260] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.224174 14946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24e0f02dd56644a3930c1cc0a972132e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.224172 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36cb8c32d8cb4fbb9be18767c0336506. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.224324 16391 ts_tablet_manager.cc:1434] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.224464 16391 tablet_bootstrap.cc:492] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.224445 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 6a3ec64b273d4e8c92b1e24061ac7336 (DEFAULT_TABLE table=default.Table_1068ad8fb18a4d21954bb70b20fd5760 [id=79c76995e71143438cb6e30a9df85c31]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.224619 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3ec64b273d4e8c92b1e24061ac7336. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.225309 16391 tablet_bootstrap.cc:654] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.225924 14943 tablet_service.cc:1505] Processing CreateTablet for tablet 64996b8137f647b993923cb1bb093211 (DEFAULT_TABLE table=default.Table_c8ac7973eef94a68bf4ebe1459c2e6e6 [id=3c371b3791fd45be983458cd55d67827]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.226116 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64996b8137f647b993923cb1bb093211. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.226205 14942 tablet_service.cc:1505] Processing CreateTablet for tablet 36cb8c32d8cb4fbb9be18767c0336506 (DEFAULT_TABLE table=default.Table_19e4d10cf3d64b008591270ed9ee26f3 [id=2481098eb7b44b7ca9be9b9393a44523]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.226358 14945 tablet_service.cc:1505] Processing CreateTablet for tablet 1927cf6a9013402a92c9e6e89e2e1715 (DEFAULT_TABLE table=default.Table_d03eda3087a54490a502678eeeeeabc8 [id=1297b3a21b8a458d80575525d6df9783]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.226414 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36cb8c32d8cb4fbb9be18767c0336506. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.226485 14953 tablet_service.cc:1505] Processing CreateTablet for tablet 446194cf013c4b6499deb00fab8db42a (DEFAULT_TABLE table=default.Table_1294a307080744bd964b420814ae843f [id=8be0a7e83b634a6b90b3bf1bb535585c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.226624 14948 tablet_service.cc:1505] Processing CreateTablet for tablet 93d383e3e2f4493d9cc8a71a4284e107 (DEFAULT_TABLE table=default.Table_0ac9d6fdd08b48f0b70da65d5f7a722a [id=7c9a46c4cada46ad916b89605c18190f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.226359 14947 tablet_service.cc:1505] Processing CreateTablet for tablet 14b47bf733754b72b34bd74aa033afa3 (DEFAULT_TABLE table=default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:29.226850 15183 leader_election.cc:343] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.227425 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet 7711a974f4a84d639f1c3077da9d855f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.227869 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 1927cf6a9013402a92c9e6e89e2e1715 (DEFAULT_TABLE table=default.Table_d03eda3087a54490a502678eeeeeabc8 [id=1297b3a21b8a458d80575525d6df9783]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.228106 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1927cf6a9013402a92c9e6e89e2e1715. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.228363 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 8b69d792862540b6ad1b5d56dea17499 (DEFAULT_TABLE table=default.Table_8c890e1813a149b88e2168cf6a19b056 [id=90132a732dd24174a9b63820b5ce85f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.228612 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 24e0f02dd56644a3930c1cc0a972132e (DEFAULT_TABLE table=default.Table_14a3c11816aa4e2d93e0a9912024dbd2 [id=4e3924f6f712459db0d167bb72825701]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.228826 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24e0f02dd56644a3930c1cc0a972132e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.229564 15082 tablet_service.cc:1505] Processing CreateTablet for tablet 6a3ec64b273d4e8c92b1e24061ac7336 (DEFAULT_TABLE table=default.Table_1068ad8fb18a4d21954bb70b20fd5760 [id=79c76995e71143438cb6e30a9df85c31]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.229765 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3ec64b273d4e8c92b1e24061ac7336. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.230243 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 8b69d792862540b6ad1b5d56dea17499 (DEFAULT_TABLE table=default.Table_8c890e1813a149b88e2168cf6a19b056 [id=90132a732dd24174a9b63820b5ce85f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.230446 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b69d792862540b6ad1b5d56dea17499. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.230417 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 36cb8c32d8cb4fbb9be18767c0336506 (DEFAULT_TABLE table=default.Table_19e4d10cf3d64b008591270ed9ee26f3 [id=2481098eb7b44b7ca9be9b9393a44523]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.230612 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36cb8c32d8cb4fbb9be18767c0336506. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.230880 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 93d383e3e2f4493d9cc8a71a4284e107 (DEFAULT_TABLE table=default.Table_0ac9d6fdd08b48f0b70da65d5f7a722a [id=7c9a46c4cada46ad916b89605c18190f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.231074 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d383e3e2f4493d9cc8a71a4284e107. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.232576 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 64996b8137f647b993923cb1bb093211 (DEFAULT_TABLE table=default.Table_c8ac7973eef94a68bf4ebe1459c2e6e6 [id=3c371b3791fd45be983458cd55d67827]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.232748 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet e4f92b0605754327883b144fb6c96aea with delete_type TABLET_DATA_DELETED (replaced by tablet d162f3ee21bd40ce9a9c74b7863a3878) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.232776 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64996b8137f647b993923cb1bb093211. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.232862 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 049cc6add40d44fc9d67c89eca89ce59 with delete_type TABLET_DATA_DELETED (replaced by tablet 6dd0f695a2904df5b750b45782a21ce2) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.233034 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 14b47bf733754b72b34bd74aa033afa3 (DEFAULT_TABLE table=default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.233219 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b47bf733754b72b34bd74aa033afa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.233986 14975 raft_consensus.cc:3060] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.235165 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b41e092b7f40410a979bcfd5bbc7c225" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.235164 15085 tablet_service.cc:1505] Processing CreateTablet for tablet 446194cf013c4b6499deb00fab8db42a (DEFAULT_TABLE table=default.Table_1294a307080744bd964b420814ae843f [id=8be0a7e83b634a6b90b3bf1bb535585c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.235369 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446194cf013c4b6499deb00fab8db42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.235625 14945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1927cf6a9013402a92c9e6e89e2e1715. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.237613 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446194cf013c4b6499deb00fab8db42a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.238163 16390 tablet_bootstrap.cc:492] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.238279 16390 ts_tablet_manager.cc:1403] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.087s user 0.001s sys 0.001s
I20251025 08:02:29.238747 16390 raft_consensus.cc:359] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.238840 16390 raft_consensus.cc:385] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.238869 16390 raft_consensus.cc:740] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.238973 16390 consensus_queue.cc:260] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.239224 16390 ts_tablet_manager.cc:1434] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.239377 16390 tablet_bootstrap.cc:492] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.239570 14948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d383e3e2f4493d9cc8a71a4284e107. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.239702 16391 tablet_bootstrap.cc:492] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.239773 16391 ts_tablet_manager.cc:1403] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:29.240199 16391 raft_consensus.cc:359] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.240279 16390 tablet_bootstrap.cc:654] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.240288 16391 raft_consensus.cc:385] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.240322 16391 raft_consensus.cc:740] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.240427 16391 consensus_queue.cc:260] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.240684 16391 ts_tablet_manager.cc:1434] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.240835 16391 tablet_bootstrap.cc:492] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.240823 14725 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet f814b8ab1c9747e4b7da69f0ef4f2eb4
I20251025 08:02:29.241245 14725 catalog_manager.cc:6719] ReplaceTablet: tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 deleted and replaced by tablet e7a34f24b89b4003b6590f8259a57199
I20251025 08:02:29.241559 14719 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 7e90c358ef454760b8317d78724ee377
I20251025 08:02:29.241596 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b47bf733754b72b34bd74aa033afa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.241901 16391 tablet_bootstrap.cc:654] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.243274 16391 tablet_bootstrap.cc:492] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.243350 16391 ts_tablet_manager.cc:1403] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:29.243674 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b69d792862540b6ad1b5d56dea17499. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.243814 16391 raft_consensus.cc:359] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.243916 16391 raft_consensus.cc:385] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.243960 16391 raft_consensus.cc:740] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.243814 15374 raft_consensus.cc:493] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.244055 16391 consensus_queue.cc:260] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.244321 16391 ts_tablet_manager.cc:1434] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:29.244510 16391 tablet_bootstrap.cc:492] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.244057 15374 raft_consensus.cc:515] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.245019 15374 leader_election.cc:290] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.245395 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 with delete_type TABLET_DATA_DELETED (replaced by tablet e7a34f24b89b4003b6590f8259a57199) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.245553 16391 tablet_bootstrap.cc:654] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.245616 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 7e90c358ef454760b8317d78724ee377 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.245932 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet 40f70d2139534907ab929dae893c740d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.246061 14948 tablet_service.cc:1552] Processing DeleteTablet for tablet e3cd7b63fa174ee192ff909f149e8b17 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.246145 14947 tablet_service.cc:1552] Processing DeleteTablet for tablet 7e90c358ef454760b8317d78724ee377 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.246592 16420 raft_consensus.cc:493] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.246671 16420 raft_consensus.cc:515] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.246984 16420 leader_election.cc:290] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.247026 14942 tablet_service.cc:1552] Processing DeleteTablet for tablet 821de6815eb244058f1d8a7a06bf48a6 with delete_type TABLET_DATA_DELETED (replaced by tablet a2b8efa8ed634583b7bf7cc91bfc61a3) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.247370 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 with delete_type TABLET_DATA_DELETED (replaced by tablet e7a34f24b89b4003b6590f8259a57199) from {username='slave'} at 127.0.0.1:41754
W20251025 08:02:29.247648 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 already in progress: creating tablet
W20251025 08:02:29.247777 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 7e90c358ef454760b8317d78724ee377 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e90c358ef454760b8317d78724ee377 already in progress: creating tablet
I20251025 08:02:29.249893 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2415c51234f482ca295cc71a74e7cab" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.250021 15114 raft_consensus.cc:2468] T c2415c51234f482ca295cc71a74e7cab P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:29.250332 14915 leader_election.cc:304] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:29.250780 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cc676245d2984363b4af1e817b444c3d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:29.250880 15114 raft_consensus.cc:3060] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.251011 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51fca67cb1b84e44a491b6a788c01062" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.251125 15113 raft_consensus.cc:2393] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:29.251626 15864 raft_consensus.cc:2804] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.251677 15864 raft_consensus.cc:493] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.251709 15864 raft_consensus.cc:3060] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.251787 15114 raft_consensus.cc:2468] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:29.252177 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 5a940a0698d64770bf5826d9290117b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6cedb44483cf4f62acf52b90b6708dfb) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.252472 16572 consensus_queue.cc:1048] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.252530 15864 raft_consensus.cc:515] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.252734 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b41e092b7f40410a979bcfd5bbc7c225" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.252817 15864 leader_election.cc:290] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.252830 15110 raft_consensus.cc:2468] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
W20251025 08:02:29.252835 15183 leader_election.cc:343] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.253681 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet 7e90c358ef454760b8317d78724ee377 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.253850 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 with delete_type TABLET_DATA_DELETED (replaced by tablet e7a34f24b89b4003b6590f8259a57199) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.254019 16415 tablet.cc:1722] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:29.255673 14713 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 7711a974f4a84d639f1c3077da9d855f because the tablet was not found. No further retry: Not found: Tablet not found: 7711a974f4a84d639f1c3077da9d855f
I20251025 08:02:29.255797 16392 tablet_bootstrap.cc:492] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.255782 14725 master_service.cc:954] ReplaceTablet: received request to replace tablet bea55cdfbf454d76920806886c3d2c4e from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:29.255880 16392 ts_tablet_manager.cc:1403] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.052s user 0.001s sys 0.000s
I20251025 08:02:29.256316 16392 raft_consensus.cc:359] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.256413 16392 raft_consensus.cc:385] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.256453 16392 raft_consensus.cc:740] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.256575 16392 consensus_queue.cc:260] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.256861 16392 ts_tablet_manager.cc:1434] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.257036 16392 tablet_bootstrap.cc:492] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.257746 16392 tablet_bootstrap.cc:654] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:29.255796 14713 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet e4f92b0605754327883b144fb6c96aea because the tablet was not found. No further retry: Not found: Tablet not found: e4f92b0605754327883b144fb6c96aea
W20251025 08:02:29.258785 14713 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 049cc6add40d44fc9d67c89eca89ce59 because the tablet was not found. No further retry: Not found: Tablet not found: 049cc6add40d44fc9d67c89eca89ce59
W20251025 08:02:29.258896 14713 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 5a940a0698d64770bf5826d9290117b4 because the tablet was not found. No further retry: Not found: Tablet not found: 5a940a0698d64770bf5826d9290117b4
W20251025 08:02:29.258991 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 7e90c358ef454760b8317d78724ee377 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e90c358ef454760b8317d78724ee377 already in progress: creating tablet
W20251025 08:02:29.259095 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 already in progress: creating tablet
I20251025 08:02:29.262487 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "51fca67cb1b84e44a491b6a788c01062" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.262866 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2415c51234f482ca295cc71a74e7cab" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.262976 16392 tablet_bootstrap.cc:492] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.262974 15239 raft_consensus.cc:2468] T c2415c51234f482ca295cc71a74e7cab P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:29.263039 16392 ts_tablet_manager.cc:1403] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:29.263420 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2415c51234f482ca295cc71a74e7cab" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:29.263458 16392 raft_consensus.cc:359] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.263514 15239 raft_consensus.cc:3060] T c2415c51234f482ca295cc71a74e7cab P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.263536 16392 raft_consensus.cc:385] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.263571 16392 raft_consensus.cc:740] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.263664 16392 consensus_queue.cc:260] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.263881 16392 ts_tablet_manager.cc:1434] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.264026 16392 tablet_bootstrap.cc:492] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.264467 15239 raft_consensus.cc:2468] T c2415c51234f482ca295cc71a74e7cab P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:29.264680 14725 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet bea55cdfbf454d76920806886c3d2c4e
I20251025 08:02:29.264854 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c2415c51234f482ca295cc71a74e7cab" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:29.264902 16392 tablet_bootstrap.cc:654] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.264937 15110 raft_consensus.cc:3060] T c2415c51234f482ca295cc71a74e7cab P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.264957 14725 catalog_manager.cc:6719] ReplaceTablet: tablet bea55cdfbf454d76920806886c3d2c4e deleted and replaced by tablet 17339d7c0a4b40a78b3252d17481c192
I20251025 08:02:29.265569 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet bea55cdfbf454d76920806886c3d2c4e with delete_type TABLET_DATA_DELETED (replaced by tablet 17339d7c0a4b40a78b3252d17481c192) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.265779 15185 leader_election.cc:304] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.265848 15110 raft_consensus.cc:2468] T c2415c51234f482ca295cc71a74e7cab P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:29.266011 16425 tablet.cc:1722] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.266115 15185 leader_election.cc:304] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.265920 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet bea55cdfbf454d76920806886c3d2c4e with delete_type TABLET_DATA_DELETED (replaced by tablet 17339d7c0a4b40a78b3252d17481c192) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.266296 16463 tablet.cc:1722] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.266306 15384 raft_consensus.cc:2804] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.266667 15384 raft_consensus.cc:697] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:29.266785 15384 consensus_queue.cc:237] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:29.267014 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet bea55cdfbf454d76920806886c3d2c4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bea55cdfbf454d76920806886c3d2c4e already in progress: creating tablet
W20251025 08:02:29.267155 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet bea55cdfbf454d76920806886c3d2c4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bea55cdfbf454d76920806886c3d2c4e already in progress: creating tablet
I20251025 08:02:29.268785 15384 raft_consensus.cc:2804] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.268832 15384 raft_consensus.cc:493] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.268870 15384 raft_consensus.cc:3060] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.269647 15384 raft_consensus.cc:515] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.269923 15384 leader_election.cc:290] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:29.270061 14914 consensus_peers.cc:597] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a940a0698d64770bf5826d9290117b4. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:29.270155 14914 leader_election.cc:304] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.270489 14914 leader_election.cc:304] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.270742 16413 raft_consensus.cc:3060] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.270905 15374 raft_consensus.cc:2804] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.270982 15374 raft_consensus.cc:697] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:29.271086 15374 consensus_queue.cc:237] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.271579 16413 raft_consensus.cc:2749] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.271651 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b41e092b7f40410a979bcfd5bbc7c225" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:29.271737 15114 raft_consensus.cc:3060] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.272403 15114 raft_consensus.cc:2468] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:29.273487 16425 tablet.cc:1722] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.273801 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet bea55cdfbf454d76920806886c3d2c4e with delete_type TABLET_DATA_DELETED (replaced by tablet 17339d7c0a4b40a78b3252d17481c192) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.274580 15384 consensus_queue.cc:1048] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.275146 15185 leader_election.cc:304] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.275302 15384 raft_consensus.cc:2804] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.275369 15384 raft_consensus.cc:697] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:29.275473 15384 consensus_queue.cc:237] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.275566 16392 tablet_bootstrap.cc:492] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.275629 16392 ts_tablet_manager.cc:1403] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20251025 08:02:29.276084 16392 raft_consensus.cc:359] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.276172 16392 raft_consensus.cc:385] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.276216 16392 raft_consensus.cc:740] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.276314 16392 consensus_queue.cc:260] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.276538 16392 ts_tablet_manager.cc:1434] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.276671 16392 tablet_bootstrap.cc:492] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.277392 14726 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_7387f487853a4b608f5e5237684550d8" } new_table_name: "default.Table_754e539219a14fbba92f1f3fe54b0f2e" modify_external_catalogs: true
I20251025 08:02:29.277532 16392 tablet_bootstrap.cc:654] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.278256 14718 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_a05736b7077d457181534fd09c3a1946" } modify_external_catalogs: true
I20251025 08:02:29.278347 14718 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_a05736b7077d457181534fd09c3a1946" } modify_external_catalogs: true
I20251025 08:02:29.279692 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b41e092b7f40410a979bcfd5bbc7c225" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.279659 14724 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_f197d92f8dea445c807047cbd1086229"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.279974 14724 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f197d92f8dea445c807047cbd1086229 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.281004 14723 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_9f939300bcf646508b4f05ea510f6679" } modify_external_catalogs: true
I20251025 08:02:29.281093 14723 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_9f939300bcf646508b4f05ea510f6679" } modify_external_catalogs: true
I20251025 08:02:29.284626 16392 tablet_bootstrap.cc:492] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.284709 16392 ts_tablet_manager.cc:1403] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20251025 08:02:29.285135 16392 raft_consensus.cc:359] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.285241 16392 raft_consensus.cc:385] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.285282 16392 raft_consensus.cc:740] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.285394 16392 consensus_queue.cc:260] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.285652 16392 ts_tablet_manager.cc:1434] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.285671 14723 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet e7a34f24b89b4003b6590f8259a57199
I20251025 08:02:29.285820 16392 tablet_bootstrap.cc:492] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.286895 16392 tablet_bootstrap.cc:654] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.287577 14726 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_89fbe6e89c5b4265a3becdf00dc8a9e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.287909 14726 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_89fbe6e89c5b4265a3becdf00dc8a9e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.288411 14718 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet bc56844d88604fa5be02cd82b5856cd1
I20251025 08:02:29.289592 14718 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_28db4c3dec79421c9ad752690a383ea4" } modify_external_catalogs: true
I20251025 08:02:29.289685 14718 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_28db4c3dec79421c9ad752690a383ea4" } modify_external_catalogs: true
I20251025 08:02:29.292232 16392 tablet_bootstrap.cc:492] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.292310 16392 ts_tablet_manager.cc:1403] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.001s
W20251025 08:02:29.292403 15183 leader_election.cc:343] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.292732 16392 raft_consensus.cc:359] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.292768 15864 raft_consensus.cc:493] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.292830 16392 raft_consensus.cc:385] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.292867 16392 raft_consensus.cc:740] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.292843 15864 raft_consensus.cc:515] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.292977 16392 consensus_queue.cc:260] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.293154 15864 leader_election.cc:290] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.293207 16392 ts_tablet_manager.cc:1434] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.293354 16392 tablet_bootstrap.cc:492] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:29.294257 14915 leader_election.cc:343] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 04d3488a6b814223b742f0d5c946362f
I20251025 08:02:29.294932 14725 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_94e6d6f804c346ce97b427caf864614e" } new_table_name: "default.Table_06d9fbe4ef5e4a59b12abb65af8ce2a0" modify_external_catalogs: true
I20251025 08:02:29.295838 16392 tablet_bootstrap.cc:654] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.297001 16392 tablet_bootstrap.cc:492] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.297086 16392 ts_tablet_manager.cc:1403] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:29.297549 16392 raft_consensus.cc:359] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.297657 16392 raft_consensus.cc:385] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.297704 16392 raft_consensus.cc:740] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.297814 16392 consensus_queue.cc:260] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.298076 16392 ts_tablet_manager.cc:1434] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.298257 16392 tablet_bootstrap.cc:492] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.299058 16392 tablet_bootstrap.cc:654] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.300690 16463 tablet.cc:1722] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:29.300879 15497 raft_consensus.cc:493] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.300962 15497 raft_consensus.cc:515] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.301290 15497 leader_election.cc:290] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.301806 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f64072c416f4a77b1c81855d7db8f01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.301934 15239 raft_consensus.cc:2468] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:29.302526 15049 leader_election.cc:304] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.302660 15642 raft_consensus.cc:493] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.302717 15642 raft_consensus.cc:515] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.302992 15642 leader_election.cc:290] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.303066 15642 raft_consensus.cc:2804] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.303097 15642 raft_consensus.cc:493] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.303130 15642 raft_consensus.cc:3060] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.303826 16392 tablet_bootstrap.cc:492] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.303889 15642 raft_consensus.cc:515] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.303894 16392 ts_tablet_manager.cc:1403] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251025 08:02:29.304200 15642 leader_election.cc:290] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.304416 16392 raft_consensus.cc:359] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.304508 16392 raft_consensus.cc:385] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.304541 16392 raft_consensus.cc:740] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.304648 16392 consensus_queue.cc:260] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.304916 16392 ts_tablet_manager.cc:1434] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:29.305058 16392 tablet_bootstrap.cc:492] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.305370 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27d1e084fbdf43e2a1cc60fb6dfd194b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.305940 16392 tablet_bootstrap.cc:654] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:29.306131 15049 leader_election.cc:343] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:29.306274 14914 leader_election.cc:343] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: 04d3488a6b814223b742f0d5c946362f
I20251025 08:02:29.301167 16415 tablet.cc:1722] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:29.304812 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27d1e084fbdf43e2a1cc60fb6dfd194b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.306551 14914 leader_election.cc:304] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.306571 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f64072c416f4a77b1c81855d7db8f01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:29.304908 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f64072c416f4a77b1c81855d7db8f01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.306654 15238 raft_consensus.cc:3060] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:29.306876 15048 leader_election.cc:343] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.306938 15048 leader_election.cc:304] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:29.307121 15048 leader_election.cc:343] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.307224 15642 raft_consensus.cc:2749] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.307356 15864 raft_consensus.cc:2749] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.307579 15238 raft_consensus.cc:2468] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:29.307686 16425 tablet.cc:1722] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:29.308066 15049 leader_election.cc:304] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.308279 15642 raft_consensus.cc:2804] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.308349 15642 raft_consensus.cc:697] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:29.308451 15642 consensus_queue.cc:237] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.308600 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2f64072c416f4a77b1c81855d7db8f01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:29.309172 15048 leader_election.cc:343] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.313030 14725 master_service.cc:954] ReplaceTablet: received request to replace tablet b04e5c106dd7400aa039dbf6666ad3aa from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:29.315514 16463 tablet.cc:1722] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:29.316874 16392 tablet_bootstrap.cc:492] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.316951 16392 ts_tablet_manager.cc:1403] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20251025 08:02:29.317404 16392 raft_consensus.cc:359] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.317492 16392 raft_consensus.cc:385] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.317523 16392 raft_consensus.cc:740] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.317623 16392 consensus_queue.cc:260] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.317914 16392 ts_tablet_manager.cc:1434] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:29.318053 16392 tablet_bootstrap.cc:492] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.318945 16392 tablet_bootstrap.cc:654] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.320392 14725 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet b04e5c106dd7400aa039dbf6666ad3aa
I20251025 08:02:29.320684 14725 catalog_manager.cc:6719] ReplaceTablet: tablet b04e5c106dd7400aa039dbf6666ad3aa deleted and replaced by tablet 454a76de5e2c421ab035e6cf1a958c11
I20251025 08:02:29.320714 15864 raft_consensus.cc:493] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.320777 15864 raft_consensus.cc:515] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.320991 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet b04e5c106dd7400aa039dbf6666ad3aa with delete_type TABLET_DATA_DELETED (replaced by tablet 454a76de5e2c421ab035e6cf1a958c11) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.321347 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet b04e5c106dd7400aa039dbf6666ad3aa with delete_type TABLET_DATA_DELETED (replaced by tablet 454a76de5e2c421ab035e6cf1a958c11) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.321417 15864 leader_election.cc:290] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.321748 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet b04e5c106dd7400aa039dbf6666ad3aa with delete_type TABLET_DATA_DELETED (replaced by tablet 454a76de5e2c421ab035e6cf1a958c11) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.321902 16364 tablet_replica.cc:333] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.321902 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f65b1ad4764a4ed3a33baccaf278f043" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.322016 15111 raft_consensus.cc:2393] T f65b1ad4764a4ed3a33baccaf278f043 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:29.322044 16364 raft_consensus.cc:2243] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.322139 16364 raft_consensus.cc:2272] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.322213 16415 tablet.cc:1722] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:29.322304 16372 tablet_replica.cc:333] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.322410 16372 raft_consensus.cc:2243] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.322538 16372 pending_rounds.cc:70] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:29.322571 16372 pending_rounds.cc:77] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609814062694400 op_type: NO_OP noop_request { }
I20251025 08:02:29.322613 16372 raft_consensus.cc:2889] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:29.322659 16372 raft_consensus.cc:2272] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.323225 16372 ts_tablet_manager.cc:1916] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.323916 16364 ts_tablet_manager.cc:1916] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.324877 16371 ts_tablet_manager.cc:1916] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.325399 16372 ts_tablet_manager.cc:1929] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.325457 16372 log.cc:1199] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/b04e5c106dd7400aa039dbf6666ad3aa
I20251025 08:02:29.325682 16372 ts_tablet_manager.cc:1950] T b04e5c106dd7400aa039dbf6666ad3aa P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.325927 16364 ts_tablet_manager.cc:1929] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.325999 16364 log.cc:1199] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/b04e5c106dd7400aa039dbf6666ad3aa
I20251025 08:02:29.327103 16371 ts_tablet_manager.cc:1929] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.327188 16371 log.cc:1199] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/1d7c262b73904f1f87188718617e38a8
I20251025 08:02:29.327446 16371 ts_tablet_manager.cc:1950] T 1d7c262b73904f1f87188718617e38a8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.327754 16364 ts_tablet_manager.cc:1950] T b04e5c106dd7400aa039dbf6666ad3aa P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.328090 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f65b1ad4764a4ed3a33baccaf278f043" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.328428 14725 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_d4e0362387994cd8a9584073e55c7b32" } new_table_name: "default.Table_85b56f9883d74360a81c24c7dbe31f32" modify_external_catalogs: true
I20251025 08:02:29.329175 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet b04e5c106dd7400aa039dbf6666ad3aa (table default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]) successfully deleted
I20251025 08:02:29.330542 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet b04e5c106dd7400aa039dbf6666ad3aa (table default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]) successfully deleted
I20251025 08:02:29.334304 16658 tablet.cc:1722] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:29.334491 15111 raft_consensus.cc:1275] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer f0f2f8ce3e9f4d9ba3f3f02813397c31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:29.334856 16572 consensus_queue.cc:1048] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.336071 16392 tablet_bootstrap.cc:492] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.336166 16392 ts_tablet_manager.cc:1403] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251025 08:02:29.336557 16392 raft_consensus.cc:359] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.336642 16392 raft_consensus.cc:385] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.336668 16392 raft_consensus.cc:740] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.336764 16392 consensus_queue.cc:260] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.336995 16392 ts_tablet_manager.cc:1434] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.337666 16463 tablet.cc:1722] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.337857 16371 tablet_replica.cc:333] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.337968 16371 raft_consensus.cc:2243] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.329160 14914 leader_election.cc:304] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.338124 16371 raft_consensus.cc:2272] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.338542 15864 raft_consensus.cc:3060] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.338644 16371 ts_tablet_manager.cc:1916] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.339422 15864 raft_consensus.cc:2749] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.339609 16392 tablet_bootstrap.cc:492] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.334482 14975 raft_consensus.cc:1275] T f9a7f96be1e2427bb0c4e109c6bac400 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer f0f2f8ce3e9f4d9ba3f3f02813397c31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:29.340180 14725 master_service.cc:954] ReplaceTablet: received request to replace tablet 2069ab40d30c4b8dab9d37c466522ac1 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:29.340554 16392 tablet_bootstrap.cc:654] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.341431 16392 tablet_bootstrap.cc:492] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.341552 16392 ts_tablet_manager.cc:1403] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:29.341796 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 1d7c262b73904f1f87188718617e38a8 (table default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056]) successfully deleted
W20251025 08:02:29.341974 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet cfe9add2f8bf450bb6f49ad57be2caae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cfe9add2f8bf450bb6f49ad57be2caae already in progress: creating tablet
I20251025 08:02:29.342048 16658 tablet.cc:1722] T f9a7f96be1e2427bb0c4e109c6bac400 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:29.342130 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet d5cd481a98514f16bed3fb0bf5003526 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d5cd481a98514f16bed3fb0bf5003526 already in progress: creating tablet
I20251025 08:02:29.342128 16392 raft_consensus.cc:359] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.342408 16392 raft_consensus.cc:385] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.342471 16392 raft_consensus.cc:740] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.342589 16392 consensus_queue.cc:260] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.342890 16392 ts_tablet_manager.cc:1434] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.342870 15864 consensus_queue.cc:1048] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.343048 16392 tablet_bootstrap.cc:492] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.343480 16570 consensus_queue.cc:1048] T f9a7f96be1e2427bb0c4e109c6bac400 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.343688 16420 raft_consensus.cc:493] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.343761 16420 raft_consensus.cc:515] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.344069 16420 leader_election.cc:290] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.344295 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff20cd7d33a440bab24bd4a61fff1f30" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.344491 16392 tablet_bootstrap.cc:654] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.344885 16415 tablet.cc:1722] T f9a7f96be1e2427bb0c4e109c6bac400 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.348251 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff20cd7d33a440bab24bd4a61fff1f30" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.348366 15239 raft_consensus.cc:2393] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:29.349467 14914 leader_election.cc:304] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.349599 16413 raft_consensus.cc:3060] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.350574 16413 raft_consensus.cc:2749] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.351785 16391 tablet_bootstrap.cc:492] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.351858 16391 ts_tablet_manager.cc:1403] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.107s user 0.002s sys 0.000s
I20251025 08:02:29.352258 16391 raft_consensus.cc:359] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.352344 16391 raft_consensus.cc:385] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.352378 16391 raft_consensus.cc:740] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.352473 16391 consensus_queue.cc:260] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.352723 16391 ts_tablet_manager.cc:1434] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.352880 16391 tablet_bootstrap.cc:492] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.353611 16391 tablet_bootstrap.cc:654] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.354576 16391 tablet_bootstrap.cc:492] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.354641 16391 ts_tablet_manager.cc:1403] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:29.355031 16391 raft_consensus.cc:359] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.355108 16391 raft_consensus.cc:385] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.355134 16391 raft_consensus.cc:740] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.355245 16391 consensus_queue.cc:260] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.355458 16391 ts_tablet_manager.cc:1434] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.355620 16391 tablet_bootstrap.cc:492] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.356639 16391 tablet_bootstrap.cc:654] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.357597 16391 tablet_bootstrap.cc:492] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.357718 16391 ts_tablet_manager.cc:1403] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:29.358397 16391 raft_consensus.cc:359] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.358490 16391 raft_consensus.cc:385] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.358518 16391 raft_consensus.cc:740] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.358628 16391 consensus_queue.cc:260] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.358863 16391 ts_tablet_manager.cc:1434] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:29.359009 16391 tablet_bootstrap.cc:492] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.359849 16391 tablet_bootstrap.cc:654] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.367861 16390 tablet_bootstrap.cc:492] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.367961 16390 ts_tablet_manager.cc:1403] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.129s user 0.000s sys 0.001s
I20251025 08:02:29.368430 16390 raft_consensus.cc:359] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.368531 16390 raft_consensus.cc:385] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.368568 16390 raft_consensus.cc:740] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.368686 16390 consensus_queue.cc:260] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.368552 16371 ts_tablet_manager.cc:1929] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:29.368870 16371 log.cc:1199] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/5a940a0698d64770bf5826d9290117b4
I20251025 08:02:29.368957 16390 ts_tablet_manager.cc:1434] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.369127 16390 tablet_bootstrap.cc:492] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.369252 16371 ts_tablet_manager.cc:1950] T 5a940a0698d64770bf5826d9290117b4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.370003 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 5a940a0698d64770bf5826d9290117b4 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]) successfully deleted
I20251025 08:02:29.370311 16371 tablet_replica.cc:333] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
W20251025 08:02:29.370311 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 31c9e3906dac487e8585daa13d3fe4b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 31c9e3906dac487e8585daa13d3fe4b1 already in progress: creating tablet
I20251025 08:02:29.370411 16390 tablet_bootstrap.cc:654] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.370442 16371 raft_consensus.cc:2243] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.370548 16371 raft_consensus.cc:2272] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:29.370579 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet e762c440cb0947deb7e6a4186deebdc1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e762c440cb0947deb7e6a4186deebdc1 already in progress: creating tablet
I20251025 08:02:29.370894 16371 ts_tablet_manager.cc:1916] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.372836 16371 ts_tablet_manager.cc:1929] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.372946 16371 log.cc:1199] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/45be7daf50e741c9b6f1eeedccae8c8e
I20251025 08:02:29.372864 14726 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_e0041c8cf73f46c5b49515b6f328f500"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.373258 14726 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0041c8cf73f46c5b49515b6f328f500 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.373505 16371 ts_tablet_manager.cc:1950] T 45be7daf50e741c9b6f1eeedccae8c8e P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.374055 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 45be7daf50e741c9b6f1eeedccae8c8e (table default.Table_5854b229e0af41b88196de4a1c9c0270 [id=e95f72536b1242469fd4dad2c4d1c276]) successfully deleted
I20251025 08:02:29.374266 16371 tablet_replica.cc:333] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.374367 16371 raft_consensus.cc:2243] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.374516 16371 raft_consensus.cc:2272] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.374738 16390 tablet_bootstrap.cc:492] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.374804 16390 ts_tablet_manager.cc:1403] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251025 08:02:29.374809 16371 ts_tablet_manager.cc:1916] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.375206 16390 raft_consensus.cc:359] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.375285 16390 raft_consensus.cc:385] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.375313 16390 raft_consensus.cc:740] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.375422 16390 consensus_queue.cc:260] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.376191 15642 raft_consensus.cc:493] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.376271 15642 raft_consensus.cc:515] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.376595 15642 leader_election.cc:290] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.376664 15642 raft_consensus.cc:493] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.376713 15642 raft_consensus.cc:515] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.376960 15642 leader_election.cc:290] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.377054 16371 ts_tablet_manager.cc:1929] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.377115 16371 log.cc:1199] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/4c301e7a80c64d8e8751ecfa681ab202
I20251025 08:02:29.377410 16371 ts_tablet_manager.cc:1950] T 4c301e7a80c64d8e8751ecfa681ab202 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.377611 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f5cff308fc9448db40b0d4df03c69bb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.377628 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e48ddcfccc1340d39d21ce94bec4bf27" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.377717 15238 raft_consensus.cc:2468] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:29.377728 15239 raft_consensus.cc:2468] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:29.378551 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 4c301e7a80c64d8e8751ecfa681ab202 (table default.Table_acf14806991f4da89dc9bb3361537133 [id=e63210d8c6d148e18496c0bc0d326ab9]) successfully deleted
I20251025 08:02:29.378569 15049 leader_election.cc:304] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.378713 15049 leader_election.cc:304] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.378794 16371 tablet_replica.cc:333] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.378822 15497 raft_consensus.cc:2804] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.378856 15497 raft_consensus.cc:493] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.378887 15497 raft_consensus.cc:3060] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.378898 16371 raft_consensus.cc:2243] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.378981 16371 raft_consensus.cc:2272] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.379751 15497 raft_consensus.cc:515] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.380052 15497 leader_election.cc:290] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.380127 15497 raft_consensus.cc:2804] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.380157 15497 raft_consensus.cc:493] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.380198 15497 raft_consensus.cc:3060] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.380962 15497 raft_consensus.cc:515] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.381230 15497 leader_election.cc:290] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.381747 16371 ts_tablet_manager.cc:1916] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.382905 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e48ddcfccc1340d39d21ce94bec4bf27" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.382967 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f5cff308fc9448db40b0d4df03c69bb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.383666 14726 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_f1d51a2bfd9f4822bde47b100d2e5161" } new_table_name: "default.Table_9c7e0359120c415cba47b89251b0be94" modify_external_catalogs: true
I20251025 08:02:29.384114 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f5cff308fc9448db40b0d4df03c69bb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:29.384230 15239 raft_consensus.cc:3060] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:29.384346 15048 leader_election.cc:343] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:29.384490 15048 leader_election.cc:343] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.384908 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3f5cff308fc9448db40b0d4df03c69bb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:29.385215 15048 leader_election.cc:343] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.375656 16390 ts_tablet_manager.cc:1434] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.385339 15239 raft_consensus.cc:2468] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:29.385547 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e48ddcfccc1340d39d21ce94bec4bf27" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:29.385634 15238 raft_consensus.cc:3060] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.385610 14724 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_c485105a684f427295b74968c29fd30c" } modify_external_catalogs: true
I20251025 08:02:29.385707 14724 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_c485105a684f427295b74968c29fd30c" } modify_external_catalogs: true
I20251025 08:02:29.386066 14723 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_3447d48d82304580af188ed3290be5af"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.386411 14723 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3447d48d82304580af188ed3290be5af in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.386413 15049 leader_election.cc:304] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.386544 15238 raft_consensus.cc:2468] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:29.386778 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e48ddcfccc1340d39d21ce94bec4bf27" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.386811 15642 raft_consensus.cc:2804] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.386909 15642 raft_consensus.cc:697] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:29.387033 15642 consensus_queue.cc:237] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.389135 15049 leader_election.cc:304] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.389159 14722 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_9d2b453ce59a456d9a0988f2bc484b6d" } new_table_name: "default.Table_c6928dca846645b8887db36cc7cb9675" modify_external_catalogs: true
W20251025 08:02:29.389303 15048 leader_election.cc:343] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.390602 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_ec7c18f36d434e0b9d294354387082e6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.390875 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec7c18f36d434e0b9d294354387082e6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.392802 15642 raft_consensus.cc:2804] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.392887 15642 raft_consensus.cc:697] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:29.393006 15642 consensus_queue.cc:237] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.396397 16390 tablet_bootstrap.cc:492] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.397244 16390 tablet_bootstrap.cc:654] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.397591 16371 ts_tablet_manager.cc:1929] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.397657 16371 log.cc:1199] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/7711a974f4a84d639f1c3077da9d855f
I20251025 08:02:29.397924 16371 ts_tablet_manager.cc:1950] T 7711a974f4a84d639f1c3077da9d855f P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
W20251025 08:02:29.398691 14722 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d709ecb9ac9a4525985c7d2bf10719f5 consensus state has no leader
I20251025 08:02:29.399793 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_cc90154d79cc47bd82be7afaff1b0186"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.400091 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc90154d79cc47bd82be7afaff1b0186 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:29.401450 14726 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ce5ae591c86c4455a1dd3704f1c95d1c has no consensus state
I20251025 08:02:29.403447 16371 tablet_replica.cc:333] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.403614 16371 raft_consensus.cc:2243] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.403752 16371 raft_consensus.cc:2272] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.404713 16371 ts_tablet_manager.cc:1916] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.405114 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 7711a974f4a84d639f1c3077da9d855f (table default.Table_4a4b1eeaa5674710a1a13d7f0f395737 [id=f9c1f298fed0456eb9fd34fe9c124190]) successfully deleted
W20251025 08:02:29.405362 14712 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 88efe498fb6f4ce1a02b5389ff6f5797 because the tablet was not found. No further retry: Not found: Tablet not found: 88efe498fb6f4ce1a02b5389ff6f5797
I20251025 08:02:29.406648 16371 ts_tablet_manager.cc:1929] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:29.406759 16371 log.cc:1199] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/792c6d7038624ec29e5e36c0145c64db
I20251025 08:02:29.407019 16371 ts_tablet_manager.cc:1950] T 792c6d7038624ec29e5e36c0145c64db P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.407665 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 792c6d7038624ec29e5e36c0145c64db (table default.Table_d4d0cf0460ca4188bf5e9e502111012c [id=7505f67ea24847a6aa9c90955f1596fa]) successfully deleted
I20251025 08:02:29.405719 15642 consensus_queue.cc:1048] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20251025 08:02:29.410495 16390 tablet_bootstrap.cc:492] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.410575 16390 ts_tablet_manager.cc:1403] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20251025 08:02:29.410933 16390 raft_consensus.cc:359] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.411017 16390 raft_consensus.cc:385] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.411042 16390 raft_consensus.cc:740] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.411145 16390 consensus_queue.cc:260] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.411392 16390 ts_tablet_manager.cc:1434] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.411700 16390 tablet_bootstrap.cc:492] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.412376 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_cac23e61bde0461d9772761aba8b3abb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:29.412417 14723 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_7c6a96cbfd864aa9842d67953f6853d4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:29.412672 16390 tablet_bootstrap.cc:654] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:29.412680 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cac23e61bde0461d9772761aba8b3abb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:29.412732 14723 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7c6a96cbfd864aa9842d67953f6853d4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.413462 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_215d6056104143a2a5c44b771c493865"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:29.413554 15380 consensus_queue.cc:1048] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:29.413712 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_215d6056104143a2a5c44b771c493865 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.414800 14726 master_service.cc:954] ReplaceTablet: received request to replace tablet d709ecb9ac9a4525985c7d2bf10719f5 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:29.416237 16371 tablet_replica.cc:333] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.416414 16371 raft_consensus.cc:2243] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.416538 16371 raft_consensus.cc:2272] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.416859 16371 ts_tablet_manager.cc:1916] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:29.417093 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4edf680e8d4a4b898fd6e64f8ec6f75d already in progress: creating tablet
I20251025 08:02:29.419811 15497 raft_consensus.cc:493] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.419885 15497 raft_consensus.cc:515] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.420199 15497 leader_election.cc:290] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.420583 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090117a75882489d84687e41b50616e9" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.420698 15238 raft_consensus.cc:2468] T 090117a75882489d84687e41b50616e9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:29.422084 15049 leader_election.cc:304] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.422351 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090117a75882489d84687e41b50616e9" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:29.422688 15048 leader_election.cc:343] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.422813 15497 raft_consensus.cc:2804] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.422876 15497 raft_consensus.cc:493] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.422914 15497 raft_consensus.cc:3060] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.422971 14725 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 2069ab40d30c4b8dab9d37c466522ac1
I20251025 08:02:29.423204 14725 catalog_manager.cc:6719] ReplaceTablet: tablet 2069ab40d30c4b8dab9d37c466522ac1 deleted and replaced by tablet 6d1979a4f43a4659976b0cd6d1b888ef
I20251025 08:02:29.423816 15497 raft_consensus.cc:515] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.424137 15497 leader_election.cc:290] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.424482 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 2069ab40d30c4b8dab9d37c466522ac1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d1979a4f43a4659976b0cd6d1b888ef) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.425350 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 2069ab40d30c4b8dab9d37c466522ac1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d1979a4f43a4659976b0cd6d1b888ef) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.427672 14720 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet e87bae31e5e642a5a34a8c170c62fdca (table default.Table_3ad0d85469a7485ba556f83ce20cecdf [id=edf9af4acd364a30814a645d32d35224]). Expected version 1 got 0
I20251025 08:02:29.427838 14720 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]). Expected version 1 got 0
I20251025 08:02:29.427837 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 2069ab40d30c4b8dab9d37c466522ac1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d1979a4f43a4659976b0cd6d1b888ef) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.428081 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090117a75882489d84687e41b50616e9" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:29.428200 15238 raft_consensus.cc:3060] T 090117a75882489d84687e41b50616e9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.429297 15238 raft_consensus.cc:2468] T 090117a75882489d84687e41b50616e9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:29.429965 14721 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 0078dd6fb0e34d01a54889326dd6dfd7 (table default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b]). Expected version 1 got 0
I20251025 08:02:29.430100 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090117a75882489d84687e41b50616e9" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.430146 14721 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet cc676245d2984363b4af1e817b444c3d (table default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8]). Expected version 1 got 0
I20251025 08:02:29.430317 14721 catalog_manager.cc:5649] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
W20251025 08:02:29.430516 15048 leader_election.cc:343] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.430550 14721 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 090117a75882489d84687e41b50616e9 (table default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e]). Expected version 1 got 0
I20251025 08:02:29.430665 14721 catalog_manager.cc:5649] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:29.430835 14721 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet b7ff0b4596944f38ae9325a95167c287 (table default.Table_f2e0f883fa4646a0aa3e785a7de7f152 [id=ea0a64fc70c84a7eb2b7c8e8e4a933fe]). Expected version 1 got 0
I20251025 08:02:29.430979 14721 catalog_manager.cc:5649] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:29.431129 14721 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]). Expected version 1 got 0
I20251025 08:02:29.431248 14721 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 2f64072c416f4a77b1c81855d7db8f01 (table default.Table_b9669fd414104dcca80167117a5b0ed7 [id=431195fe6a3847caa5b39d62cb399ffb]). Expected version 1 got 0
I20251025 08:02:29.431383 14721 catalog_manager.cc:5649] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:29.431532 14721 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet fcc08d74df2d46c58ca27f5d467e060f (table default.Table_55260f898adb4a5e9438ea958a0a28ce [id=8b67aaea93414dcb9b66d5124952bcee]). Expected version 1 got 0
I20251025 08:02:29.431963 15049 leader_election.cc:304] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.432822 14724 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet a2b8efa8ed634583b7bf7cc91bfc61a3
W20251025 08:02:29.431252 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 2069ab40d30c4b8dab9d37c466522ac1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2069ab40d30c4b8dab9d37c466522ac1 already in progress: creating tablet
I20251025 08:02:29.433434 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41754
W20251025 08:02:29.433725 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 2069ab40d30c4b8dab9d37c466522ac1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2069ab40d30c4b8dab9d37c466522ac1 already in progress: creating tablet
I20251025 08:02:29.433748 14726 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet d709ecb9ac9a4525985c7d2bf10719f5
I20251025 08:02:29.434299 14726 catalog_manager.cc:6719] ReplaceTablet: tablet d709ecb9ac9a4525985c7d2bf10719f5 deleted and replaced by tablet b7bb3d7d89674b7e825868c17495bbb3
I20251025 08:02:29.434741 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.434803 16371 ts_tablet_manager.cc:1929] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.435010 16371 log.cc:1199] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/3092fd602dc7478693595ffcbc3bcf45
I20251025 08:02:29.435149 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.435320 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet d709ecb9ac9a4525985c7d2bf10719f5 with delete_type TABLET_DATA_DELETED (replaced by tablet b7bb3d7d89674b7e825868c17495bbb3) from {username='slave'} at 127.0.0.1:42694
W20251025 08:02:29.435470 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2b8efa8ed634583b7bf7cc91bfc61a3 already in progress: creating tablet
I20251025 08:02:29.435545 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet d709ecb9ac9a4525985c7d2bf10719f5 with delete_type TABLET_DATA_DELETED (replaced by tablet b7bb3d7d89674b7e825868c17495bbb3) from {username='slave'} at 127.0.0.1:47274
W20251025 08:02:29.435698 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2b8efa8ed634583b7bf7cc91bfc61a3 already in progress: creating tablet
W20251025 08:02:29.435843 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet d709ecb9ac9a4525985c7d2bf10719f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d709ecb9ac9a4525985c7d2bf10719f5 already in progress: creating tablet
I20251025 08:02:29.437326 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet d709ecb9ac9a4525985c7d2bf10719f5 with delete_type TABLET_DATA_DELETED (replaced by tablet b7bb3d7d89674b7e825868c17495bbb3) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.437387 14726 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_d69575be86d241a797b7167bbe70fa79"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.437497 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet d709ecb9ac9a4525985c7d2bf10719f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d709ecb9ac9a4525985c7d2bf10719f5 already in progress: creating tablet
W20251025 08:02:29.437711 14726 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d69575be86d241a797b7167bbe70fa79 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.440142 15497 raft_consensus.cc:2804] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.440227 15497 raft_consensus.cc:697] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:29.440343 15497 consensus_queue.cc:237] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.443069 14719 catalog_manager.cc:5649] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:29.443279 14719 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet b7ff0b4596944f38ae9325a95167c287 (table default.Table_f2e0f883fa4646a0aa3e785a7de7f152 [id=ea0a64fc70c84a7eb2b7c8e8e4a933fe]). Expected version 1 got 0
I20251025 08:02:29.443363 14719 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet cc676245d2984363b4af1e817b444c3d (table default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8]). Expected version 1 got 0
I20251025 08:02:29.443490 14719 catalog_manager.cc:5649] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:29.443728 14719 catalog_manager.cc:5649] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:29.444010 14719 catalog_manager.cc:5649] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:29.444229 14719 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 090117a75882489d84687e41b50616e9 (table default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e]). Expected version 1 got 0
I20251025 08:02:29.444674 14718 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 51fca67cb1b84e44a491b6a788c01062
I20251025 08:02:29.444928 15214 tablet_service.cc:1505] Processing CreateTablet for tablet 1f4add8060af4a9da95c3e78567f871f (DEFAULT_TABLE table=default.Table_6c4b782dd6a04a1bbeb82b8537829558 [id=838e1bc6ed30426ba4dd16cc04efb68e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.445145 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4add8060af4a9da95c3e78567f871f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.445721 15212 tablet_service.cc:1505] Processing CreateTablet for tablet b4d1c652b6a4420a81e03cd58c6dbc69 (DEFAULT_TABLE table=default.Table_c2e0c935fdb34bc38f482cac268ad080 [id=62e3c831964e4f71a8ee6aca23069b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.445938 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4d1c652b6a4420a81e03cd58c6dbc69. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.446849 14720 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_1ba04ec4ed664c8eaaeddbf2485375ae [id=2283253a9522485d93d6c484c5eef6e4] alter complete (version 2)
I20251025 08:02:29.447065 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 51fca67cb1b84e44a491b6a788c01062 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.447284 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 685d09c4a80b4d48b477cd4c0fc9db40 (DEFAULT_TABLE table=default.Table_27c6a21fc727493fba3613698ba9e108 [id=8e0aa39fb7de4352b22bd41fb1313236]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.447467 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685d09c4a80b4d48b477cd4c0fc9db40. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.448030 16364 tablet_replica.cc:333] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.448182 16364 raft_consensus.cc:2243] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.448319 16364 pending_rounds.cc:70] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 1 pending ops.
I20251025 08:02:29.448356 16364 pending_rounds.cc:77] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609813963821056 op_type: NO_OP noop_request { }
I20251025 08:02:29.448402 16364 raft_consensus.cc:2889] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:29.448448 16364 raft_consensus.cc:2272] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.448959 16364 ts_tablet_manager.cc:1916] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.449419 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 442d83935a0a41658508e3022f4b557f (DEFAULT_TABLE table=default.Table_221091e6cc7f49d0ba8ff4c967382bce [id=816e76daa7934c3498290c4154c8fce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.449602 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442d83935a0a41658508e3022f4b557f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.451047 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 6c582efa6d334a06a48e2f2b94167776 (DEFAULT_TABLE table=default.Table_b1d8db45b7d745a0b4dd9ff09300da89 [id=be37bd4a45da444e83846233c335d445]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.451061 14726 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_67e95c34b6c44449abf8828cc3b6e9c2" } modify_external_catalogs: true
I20251025 08:02:29.451150 14726 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_67e95c34b6c44449abf8828cc3b6e9c2" } modify_external_catalogs: true
I20251025 08:02:29.451850 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 1f4add8060af4a9da95c3e78567f871f (DEFAULT_TABLE table=default.Table_6c4b782dd6a04a1bbeb82b8537829558 [id=838e1bc6ed30426ba4dd16cc04efb68e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.451944 14942 tablet_service.cc:1505] Processing CreateTablet for tablet b4d1c652b6a4420a81e03cd58c6dbc69 (DEFAULT_TABLE table=default.Table_c2e0c935fdb34bc38f482cac268ad080 [id=62e3c831964e4f71a8ee6aca23069b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.451982 14947 tablet_service.cc:1505] Processing CreateTablet for tablet 685d09c4a80b4d48b477cd4c0fc9db40 (DEFAULT_TABLE table=default.Table_27c6a21fc727493fba3613698ba9e108 [id=8e0aa39fb7de4352b22bd41fb1313236]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.452072 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4add8060af4a9da95c3e78567f871f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.452207 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4d1c652b6a4420a81e03cd58c6dbc69. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.454121 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 51fca67cb1b84e44a491b6a788c01062 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.454699 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet 51fca67cb1b84e44a491b6a788c01062 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.454878 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c582efa6d334a06a48e2f2b94167776. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.455050 14943 tablet_service.cc:1505] Processing CreateTablet for tablet 442d83935a0a41658508e3022f4b557f (DEFAULT_TABLE table=default.Table_221091e6cc7f49d0ba8ff4c967382bce [id=816e76daa7934c3498290c4154c8fce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.455667 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 1f4add8060af4a9da95c3e78567f871f (DEFAULT_TABLE table=default.Table_6c4b782dd6a04a1bbeb82b8537829558 [id=838e1bc6ed30426ba4dd16cc04efb68e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.456007 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 685d09c4a80b4d48b477cd4c0fc9db40 (DEFAULT_TABLE table=default.Table_27c6a21fc727493fba3613698ba9e108 [id=8e0aa39fb7de4352b22bd41fb1313236]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.456038 15089 tablet_service.cc:1505] Processing CreateTablet for tablet b4d1c652b6a4420a81e03cd58c6dbc69 (DEFAULT_TABLE table=default.Table_c2e0c935fdb34bc38f482cac268ad080 [id=62e3c831964e4f71a8ee6aca23069b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.456411 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 442d83935a0a41658508e3022f4b557f (DEFAULT_TABLE table=default.Table_221091e6cc7f49d0ba8ff4c967382bce [id=816e76daa7934c3498290c4154c8fce3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.456645 16372 tablet_replica.cc:333] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.456764 16372 raft_consensus.cc:2243] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.456851 16372 raft_consensus.cc:2272] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.457209 16372 ts_tablet_manager.cc:1916] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.458477 16421 consensus_queue.cc:1048] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.459102 14720 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_37152b4a34aa41dbbf4a0be51631faf9 [id=7956205ae4e9408988c3d82c46db1706] alter complete (version 1)
I20251025 08:02:29.454149 16413 raft_consensus.cc:493] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.459408 16413 raft_consensus.cc:515] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.459743 16413 leader_election.cc:290] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.460462 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f4add8060af4a9da95c3e78567f871f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.460815 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442d83935a0a41658508e3022f4b557f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.462714 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442d83935a0a41658508e3022f4b557f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.463996 14726 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet ae3c8e134d164edd8781f27e7bdc3b92
I20251025 08:02:29.464673 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4d1c652b6a4420a81e03cd58c6dbc69. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.464697 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet ae3c8e134d164edd8781f27e7bdc3b92 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.466353 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685d09c4a80b4d48b477cd4c0fc9db40. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:29.466873 14914 leader_election.cc:343] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: 221f4c5432bc45e18728f5ed1453ad0f
I20251025 08:02:29.467341 14720 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b] alter complete (version 1)
I20251025 08:02:29.469368 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.469622 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet b04e5c106dd7400aa039dbf6666ad3aa with delete_type TABLET_DATA_DELETED (replaced by tablet 454a76de5e2c421ab035e6cf1a958c11) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.470024 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 685d09c4a80b4d48b477cd4c0fc9db40. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.470486 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet ae3c8e134d164edd8781f27e7bdc3b92 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.470870 14975 raft_consensus.cc:3060] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.436388 16371 ts_tablet_manager.cc:1950] T 3092fd602dc7478693595ffcbc3bcf45 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.471925 16371 tablet_replica.cc:333] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.472012 14943 tablet_service.cc:1552] Processing DeleteTablet for tablet ae3c8e134d164edd8781f27e7bdc3b92 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.472049 16371 raft_consensus.cc:2243] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.472148 16371 raft_consensus.cc:2272] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.472479 16371 ts_tablet_manager.cc:1916] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.472641 14719 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet fcc08d74df2d46c58ca27f5d467e060f (table default.Table_55260f898adb4a5e9438ea958a0a28ce [id=8b67aaea93414dcb9b66d5124952bcee]). Expected version 1 got 0
I20251025 08:02:29.472728 14719 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet e87bae31e5e642a5a34a8c170c62fdca (table default.Table_3ad0d85469a7485ba556f83ce20cecdf [id=edf9af4acd364a30814a645d32d35224]). Expected version 1 got 0
I20251025 08:02:29.472792 14719 catalog_manager.cc:5649] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:29.472986 14719 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet b7ff0b4596944f38ae9325a95167c287 (table default.Table_f2e0f883fa4646a0aa3e785a7de7f152 [id=ea0a64fc70c84a7eb2b7c8e8e4a933fe]). Expected version 1 got 0
I20251025 08:02:29.473826 16364 ts_tablet_manager.cc:1929] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.473883 16364 log.cc:1199] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/51fca67cb1b84e44a491b6a788c01062
I20251025 08:02:29.474141 16364 ts_tablet_manager.cc:1950] T 51fca67cb1b84e44a491b6a788c01062 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.474356 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 3092fd602dc7478693595ffcbc3bcf45 (table default.Table_e96eec11f48049a9b2a4332b23e60a6f [id=de8b64679bcb4ef582d6edd600342a82]) successfully deleted
W20251025 08:02:29.474543 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet e106f20977444dd4a49b6e4ae0f45380 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e106f20977444dd4a49b6e4ae0f45380 already in progress: creating tablet
I20251025 08:02:29.474828 16582 consensus_queue.cc:1048] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.475595 16371 ts_tablet_manager.cc:1929] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.475649 16371 log.cc:1199] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/a8393462039d4bb4aba66aee9e90b94a
I20251025 08:02:29.475860 16371 ts_tablet_manager.cc:1950] T a8393462039d4bb4aba66aee9e90b94a P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.476539 16371 tablet_replica.cc:333] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.476634 16371 raft_consensus.cc:2243] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.476701 16371 raft_consensus.cc:2272] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.477653 16371 ts_tablet_manager.cc:1916] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.478255 14947 tablet_service.cc:1552] Processing DeleteTablet for tablet 04d3488a6b814223b742f0d5c946362f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.478368 14943 tablet_service.cc:1552] Processing DeleteTablet for tablet 221f4c5432bc45e18728f5ed1453ad0f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:27 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.478473 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet a8393462039d4bb4aba66aee9e90b94a (table default.Table_c91b6d76e1384dd99d7e69ddee320afb [id=244c5edd72af4af790d96dd294e8d8c4]) successfully deleted
I20251025 08:02:29.478967 16372 ts_tablet_manager.cc:1929] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.479027 16372 log.cc:1199] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/51fca67cb1b84e44a491b6a788c01062
I20251025 08:02:29.479111 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 51fca67cb1b84e44a491b6a788c01062 (table default.Table_28db4c3dec79421c9ad752690a383ea4 [id=593c3f07bdaa45d49e1c8cf97cf0c2c7]) successfully deleted
I20251025 08:02:29.479219 16372 ts_tablet_manager.cc:1950] T 51fca67cb1b84e44a491b6a788c01062 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
W20251025 08:02:29.479305 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet ae3c8e134d164edd8781f27e7bdc3b92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae3c8e134d164edd8781f27e7bdc3b92 already in progress: creating tablet
I20251025 08:02:29.479354 16364 tablet_replica.cc:333] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.479462 16364 raft_consensus.cc:2243] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.479481 16372 tablet_replica.cc:333] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.479589 16364 pending_rounds.cc:70] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 1 pending ops.
I20251025 08:02:29.479595 16372 raft_consensus.cc:2243] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.479617 16364 pending_rounds.cc:77] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609814051565568 op_type: NO_OP noop_request { }
I20251025 08:02:29.479663 16364 raft_consensus.cc:2889] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:29.479679 16372 raft_consensus.cc:2272] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.479714 16364 raft_consensus.cc:2272] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.480137 16372 ts_tablet_manager.cc:1916] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.480381 16364 ts_tablet_manager.cc:1916] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:29.483238 14915 leader_election.cc:343] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 221f4c5432bc45e18728f5ed1453ad0f
I20251025 08:02:29.483309 14915 leader_election.cc:304] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.483507 16413 raft_consensus.cc:2749] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.484040 14720 catalog_manager.cc:5649] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:29.484293 14720 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet cc676245d2984363b4af1e817b444c3d (table default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8]). Expected version 1 got 0
I20251025 08:02:29.484405 14720 catalog_manager.cc:5649] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:29.484601 14720 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet fcc08d74df2d46c58ca27f5d467e060f (table default.Table_55260f898adb4a5e9438ea958a0a28ce [id=8b67aaea93414dcb9b66d5124952bcee]). Expected version 1 got 0
I20251025 08:02:29.484735 14720 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b (table default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064]). Expected version 2 got 0
I20251025 08:02:29.484752 16372 ts_tablet_manager.cc:1929] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.484836 14720 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet e87bae31e5e642a5a34a8c170c62fdca (table default.Table_3ad0d85469a7485ba556f83ce20cecdf [id=edf9af4acd364a30814a645d32d35224]). Expected version 1 got 0
I20251025 08:02:29.484930 14720 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 2f64072c416f4a77b1c81855d7db8f01 (table default.Table_b9669fd414104dcca80167117a5b0ed7 [id=431195fe6a3847caa5b39d62cb399ffb]). Expected version 1 got 0
I20251025 08:02:29.485183 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 3f5cff308fc9448db40b0d4df03c69bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.485273 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet b04e5c106dd7400aa039dbf6666ad3aa with delete_type TABLET_DATA_DELETED (replaced by tablet 454a76de5e2c421ab035e6cf1a958c11) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.485431 16372 log.cc:1199] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/ae3c8e134d164edd8781f27e7bdc3b92
I20251025 08:02:29.485652 16372 ts_tablet_manager.cc:1950] T ae3c8e134d164edd8781f27e7bdc3b92 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.485834 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 51fca67cb1b84e44a491b6a788c01062 (table default.Table_28db4c3dec79421c9ad752690a383ea4 [id=593c3f07bdaa45d49e1c8cf97cf0c2c7]) successfully deleted
I20251025 08:02:29.486368 16364 ts_tablet_manager.cc:1929] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.486428 16364 log.cc:1199] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/2f1b1d6cc6cf4f9b8aa5c7d121468bf4
I20251025 08:02:29.486654 16364 ts_tablet_manager.cc:1950] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.487232 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 (table default.Table_bb8443c590c54dea9dd2e448f2380697 [id=78794c8ceec3479ca3ac3ef55594762f]) successfully deleted
W20251025 08:02:29.487555 14713 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet b04e5c106dd7400aa039dbf6666ad3aa because the tablet was not found. No further retry: Not found: Tablet not found: b04e5c106dd7400aa039dbf6666ad3aa
I20251025 08:02:29.487757 16371 ts_tablet_manager.cc:1929] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.487808 16371 log.cc:1199] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/40f70d2139534907ab929dae893c740d
I20251025 08:02:29.487988 16371 ts_tablet_manager.cc:1950] T 40f70d2139534907ab929dae893c740d P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.488137 14721 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_b22d946b289a4a0aa9c6ef1135c68e60" } new_table_name: "default.Table_a9afe52cc64243a295d043eb385ef7d9" modify_external_catalogs: true
I20251025 08:02:29.488638 14718 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_9292537f05ee4b0ba5356d5f4edc0840" } modify_external_catalogs: true
I20251025 08:02:29.488720 14718 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_9292537f05ee4b0ba5356d5f4edc0840" } modify_external_catalogs: true
I20251025 08:02:29.490222 16371 tablet_replica.cc:333] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.490289 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 40f70d2139534907ab929dae893c740d (table default.Table_6a66d07dc986487694277236df040244 [id=d720a49cc25f487fbfecb3771c5e5f73]) successfully deleted
I20251025 08:02:29.490379 16371 raft_consensus.cc:2243] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
W20251025 08:02:29.490410 14712 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet e3cd7b63fa174ee192ff909f149e8b17 because the tablet was not found. No further retry: Not found: Tablet not found: e3cd7b63fa174ee192ff909f149e8b17
W20251025 08:02:29.490516 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 7e90c358ef454760b8317d78724ee377 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e90c358ef454760b8317d78724ee377 already in progress: creating tablet
W20251025 08:02:29.490701 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet bea55cdfbf454d76920806886c3d2c4e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bea55cdfbf454d76920806886c3d2c4e already in progress: creating tablet
I20251025 08:02:29.491932 14724 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_401f8def453c48a19fc90b04a3294a16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.492250 14724 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_401f8def453c48a19fc90b04a3294a16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.492966 14725 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_d57dfa9ab2164520aa85ebfdd8a85546" } modify_external_catalogs: true
I20251025 08:02:29.493042 14725 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_d57dfa9ab2164520aa85ebfdd8a85546" } modify_external_catalogs: true
I20251025 08:02:29.493594 14723 master_service.cc:954] ReplaceTablet: received request to replace tablet 143b073e21a4456591fa1f96668118b4 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:29.490783 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.494522 16372 tablet_replica.cc:333] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.494637 16372 raft_consensus.cc:2243] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.494748 16372 pending_rounds.cc:70] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:29.494776 16372 pending_rounds.cc:77] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609815090532352 op_type: NO_OP noop_request { }
I20251025 08:02:29.494817 16372 raft_consensus.cc:2889] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:29.494859 16372 raft_consensus.cc:2272] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.495463 16392 tablet_bootstrap.cc:492] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.495451 14722 master_service.cc:954] ReplaceTablet: received request to replace tablet 6cedb44483cf4f62acf52b90b6708dfb from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:29.495503 16372 ts_tablet_manager.cc:1916] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.495538 16392 ts_tablet_manager.cc:1403] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.153s user 0.002s sys 0.000s
I20251025 08:02:29.495990 16392 raft_consensus.cc:359] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.496080 16392 raft_consensus.cc:385] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.496114 16392 raft_consensus.cc:740] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.496227 16392 consensus_queue.cc:260] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.496383 15384 consensus_queue.cc:1048] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.496510 16392 ts_tablet_manager.cc:1434] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.496675 16392 tablet_bootstrap.cc:492] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.496829 16371 raft_consensus.cc:2272] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.497659 16392 tablet_bootstrap.cc:654] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.498224 16372 ts_tablet_manager.cc:1929] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.498289 16372 log.cc:1199] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/3f5cff308fc9448db40b0d4df03c69bb
I20251025 08:02:29.498510 16372 ts_tablet_manager.cc:1950] T 3f5cff308fc9448db40b0d4df03c69bb P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.499048 16372 tablet_replica.cc:333] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.499392 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet ae3c8e134d164edd8781f27e7bdc3b92 (table default.Table_67e95c34b6c44449abf8828cc3b6e9c2 [id=b0f029b25327468c94a2c78b37c6d203]) successfully deleted
I20251025 08:02:29.499668 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_6ae9d9f6f9b942e689eecb0548fdf715"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.499989 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6ae9d9f6f9b942e689eecb0548fdf715 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.500840 14718 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet 4e4f5539876e4d5094ea72d50d66d499
I20251025 08:02:29.500831 16582 raft_consensus.cc:493] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.500905 16582 raft_consensus.cc:515] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.501022 15384 raft_consensus.cc:493] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.501039 16372 raft_consensus.cc:2243] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.501087 15384 raft_consensus.cc:515] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.501137 16372 raft_consensus.cc:2272] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.501258 16582 leader_election.cc:290] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.501462 15384 leader_election.cc:290] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:29.501536 16372 ts_tablet_manager.cc:1916] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.501644 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0769fe05ef364f8e80786bded1ec44cf" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.501878 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "54de7e83e8ea42ef93218b0204c61ec6" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.502130 14721 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_a210a38e85814b3db16726f2a0a830b8" } new_table_name: "default.Table_56b69a1e3b4d4e7dbaa6a4697a940880" modify_external_catalogs: true
W20251025 08:02:29.502266 15048 leader_election.cc:343] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.503140 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "54de7e83e8ea42ef93218b0204c61ec6" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.503248 15114 raft_consensus.cc:2468] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:29.503520 15185 leader_election.cc:304] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.503677 15384 raft_consensus.cc:2804] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.503748 15384 raft_consensus.cc:493] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.503798 15384 raft_consensus.cc:3060] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.503986 16372 ts_tablet_manager.cc:1929] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.504072 16372 log.cc:1199] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/2f1b1d6cc6cf4f9b8aa5c7d121468bf4
I20251025 08:02:29.504268 16372 ts_tablet_manager.cc:1950] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.504668 15384 raft_consensus.cc:515] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.505023 15384 leader_election.cc:290] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:29.505120 15183 leader_election.cc:343] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.505331 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "54de7e83e8ea42ef93218b0204c61ec6" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.505367 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "54de7e83e8ea42ef93218b0204c61ec6" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:29.505441 15114 raft_consensus.cc:3060] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.506255 15114 raft_consensus.cc:2468] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:29.506817 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0769fe05ef364f8e80786bded1ec44cf" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:29.507506 15183 leader_election.cc:343] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:29.507972 15049 leader_election.cc:343] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.508045 15049 leader_election.cc:304] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.508325 15497 consensus_queue.cc:1048] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.508555 15497 raft_consensus.cc:2749] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.508658 15497 consensus_queue.cc:1048] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.509734 16570 raft_consensus.cc:493] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.509817 16570 raft_consensus.cc:515] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.510152 16570 leader_election.cc:290] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:29.510983 15185 leader_election.cc:304] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.511209 16199 raft_consensus.cc:2804] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.511212 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27d1e084fbdf43e2a1cc60fb6dfd194b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.511320 16199 raft_consensus.cc:697] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:29.511428 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27d1e084fbdf43e2a1cc60fb6dfd194b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.511516 15110 raft_consensus.cc:2468] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:29.511471 16199 consensus_queue.cc:237] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.511515 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 3f5cff308fc9448db40b0d4df03c69bb (table default.Table_200a2632d13848d3b5877ca9f7cb8daa [id=723109f028ee44b2aafcce03c05b61d2]) successfully deleted
I20251025 08:02:29.511761 15185 leader_election.cc:304] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
W20251025 08:02:29.512133 14714 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet b04e5c106dd7400aa039dbf6666ad3aa because the tablet was not found. No further retry: Not found: Tablet not found: b04e5c106dd7400aa039dbf6666ad3aa
I20251025 08:02:29.512264 16199 raft_consensus.cc:2804] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.512274 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 (table default.Table_bb8443c590c54dea9dd2e448f2380697 [id=78794c8ceec3479ca3ac3ef55594762f]) successfully deleted
I20251025 08:02:29.512324 16199 raft_consensus.cc:493] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.512373 16199 raft_consensus.cc:3060] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.513386 16199 raft_consensus.cc:515] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.513666 16199 leader_election.cc:290] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:29.514039 15380 raft_consensus.cc:493] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.514117 15380 raft_consensus.cc:515] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.514761 15380 leader_election.cc:290] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.515287 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e106f20977444dd4a49b6e4ae0f45380" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.515524 14974 raft_consensus.cc:3060] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:29.515633 15048 leader_election.cc:343] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:29.515792 15183 leader_election.cc:343] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.516575 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27d1e084fbdf43e2a1cc60fb6dfd194b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.516703 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "27d1e084fbdf43e2a1cc60fb6dfd194b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:29.516788 15114 raft_consensus.cc:3060] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:29.516988 15183 leader_election.cc:343] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.517028 16570 consensus_queue.cc:1048] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.517622 15114 raft_consensus.cc:2468] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:29.517833 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e106f20977444dd4a49b6e4ae0f45380" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:29.518723 15049 leader_election.cc:343] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.518790 15049 leader_election.cc:304] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.519018 15497 raft_consensus.cc:2749] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.520850 14725 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 20a3581bd02143bd8a6bdf8e17072faf
I20251025 08:02:29.522428 14723 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 143b073e21a4456591fa1f96668118b4
I20251025 08:02:29.522679 14723 catalog_manager.cc:6719] ReplaceTablet: tablet 143b073e21a4456591fa1f96668118b4 deleted and replaced by tablet 7dd513b6c7a24dffb91f66c32acc7696
I20251025 08:02:29.522679 15380 raft_consensus.cc:493] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.522746 15380 raft_consensus.cc:515] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.522893 14722 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 6cedb44483cf4f62acf52b90b6708dfb
I20251025 08:02:29.523088 15380 leader_election.cc:290] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.523129 14722 catalog_manager.cc:6719] ReplaceTablet: tablet 6cedb44483cf4f62acf52b90b6708dfb deleted and replaced by tablet 86b1873446154249a80fa67b99496545
I20251025 08:02:29.523422 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2562325ea1c9436a85e1d675574c0a6c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:29.523813 15048 leader_election.cc:343] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.524142 15185 leader_election.cc:304] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.524343 16570 raft_consensus.cc:2804] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.524423 16570 raft_consensus.cc:697] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:29.524541 16570 consensus_queue.cc:237] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.525532 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 20a3581bd02143bd8a6bdf8e17072faf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.525673 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet 143b073e21a4456591fa1f96668118b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 7dd513b6c7a24dffb91f66c32acc7696) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.525775 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 6cedb44483cf4f62acf52b90b6708dfb with delete_type TABLET_DATA_DELETED (replaced by tablet 86b1873446154249a80fa67b99496545) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.525892 16364 tablet_replica.cc:333] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.525950 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2562325ea1c9436a85e1d675574c0a6c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.526018 16364 raft_consensus.cc:2243] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.526104 16364 raft_consensus.cc:2272] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.526494 16364 ts_tablet_manager.cc:1916] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.527201 14726 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet fcc08d74df2d46c58ca27f5d467e060f (table default.Table_55260f898adb4a5e9438ea958a0a28ce [id=8b67aaea93414dcb9b66d5124952bcee]). Expected version 1 got 0
I20251025 08:02:29.527292 14726 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet e87bae31e5e642a5a34a8c170c62fdca (table default.Table_3ad0d85469a7485ba556f83ce20cecdf [id=edf9af4acd364a30814a645d32d35224]). Expected version 1 got 0
I20251025 08:02:29.527372 14726 catalog_manager.cc:5649] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:29.527534 14726 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 2f64072c416f4a77b1c81855d7db8f01 (table default.Table_b9669fd414104dcca80167117a5b0ed7 [id=431195fe6a3847caa5b39d62cb399ffb]). Expected version 1 got 0
I20251025 08:02:29.527652 14726 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 2562325ea1c9436a85e1d675574c0a6c (table default.Table_beff096618394ac1b31db74a94a9f991 [id=8a0e4fe9e4544c539cb23b0279c1deaf]). Expected version 2 got 0
I20251025 08:02:29.527752 14726 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b (table default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064]). Expected version 2 got 0
I20251025 08:02:29.527899 14726 catalog_manager.cc:5649] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:29.528056 14726 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 090117a75882489d84687e41b50616e9 (table default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e]). Expected version 1 got 0
I20251025 08:02:29.528564 16364 ts_tablet_manager.cc:1929] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.528620 16364 log.cc:1199] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/20a3581bd02143bd8a6bdf8e17072faf
I20251025 08:02:29.528859 16364 ts_tablet_manager.cc:1950] T 20a3581bd02143bd8a6bdf8e17072faf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:29.528875 15049 leader_election.cc:343] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.528934 15049 leader_election.cc:304] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.529347 16364 tablet_replica.cc:333] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.529454 16364 raft_consensus.cc:2243] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.529525 15497 raft_consensus.cc:2749] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.529542 16364 raft_consensus.cc:2272] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.529537 14719 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_789c5c7cc2df43f4b7c5c63316f47042 [id=aa46eca7031242f3b4a3144dd521cc6b] alter complete (version 1)
I20251025 08:02:29.530987 14943 tablet_service.cc:1552] Processing DeleteTablet for tablet 20a3581bd02143bd8a6bdf8e17072faf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.531163 14943 tablet_service.cc:1552] Processing DeleteTablet for tablet 143b073e21a4456591fa1f96668118b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 7dd513b6c7a24dffb91f66c32acc7696) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.531353 14943 tablet_service.cc:1552] Processing DeleteTablet for tablet 6cedb44483cf4f62acf52b90b6708dfb with delete_type TABLET_DATA_DELETED (replaced by tablet 86b1873446154249a80fa67b99496545) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.534000 14721 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_017a3857ee554314b8b3da6ceb795262" } new_table_name: "default.Table_67015d2b75d043d3bd2d7f8facd07524" modify_external_catalogs: true
I20251025 08:02:29.534396 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 20a3581bd02143bd8a6bdf8e17072faf (table default.Table_d57dfa9ab2164520aa85ebfdd8a85546 [id=317c0892e78047c4b33e1836c3e1776d]) successfully deleted
I20251025 08:02:29.535802 15380 raft_consensus.cc:493] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.535889 15380 raft_consensus.cc:515] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.536185 15380 leader_election.cc:290] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.536976 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 6cedb44483cf4f62acf52b90b6708dfb with delete_type TABLET_DATA_DELETED (replaced by tablet 86b1873446154249a80fa67b99496545) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.537284 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 143b073e21a4456591fa1f96668118b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 7dd513b6c7a24dffb91f66c32acc7696) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.537413 16372 tablet_replica.cc:333] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.537534 16372 raft_consensus.cc:2243] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.537667 16372 raft_consensus.cc:2272] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.538324 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 20a3581bd02143bd8a6bdf8e17072faf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.538834 16372 ts_tablet_manager.cc:1916] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.539721 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbae08a3a1c34dfda60b1985346e7761" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:29.540005 15048 leader_election.cc:343] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.540071 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbae08a3a1c34dfda60b1985346e7761" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:29.540159 14714 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 6cedb44483cf4f62acf52b90b6708dfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cedb44483cf4f62acf52b90b6708dfb already in progress: creating tablet
W20251025 08:02:29.540386 15049 leader_election.cc:343] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.540442 15049 leader_election.cc:304] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.540736 15497 raft_consensus.cc:2749] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.540987 16372 ts_tablet_manager.cc:1929] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.541059 16372 log.cc:1199] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/143b073e21a4456591fa1f96668118b4
I20251025 08:02:29.541311 16372 ts_tablet_manager.cc:1950] T 143b073e21a4456591fa1f96668118b4 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.540990 16425 tablet.cc:1722] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.541801 16371 ts_tablet_manager.cc:1916] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.542392 16372 tablet_replica.cc:333] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.542418 14727 master_service.cc:954] ReplaceTablet: received request to replace tablet e106f20977444dd4a49b6e4ae0f45380 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:29.542567 16372 raft_consensus.cc:2243] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.542564 16415 tablet.cc:1722] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.542479 14719 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_06d9fbe4ef5e4a59b12abb65af8ce2a0 [id=ce6a220ddfc540dbb17e28bc74b66449] alter complete (version 2)
I20251025 08:02:29.542814 16372 raft_consensus.cc:2272] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.543166 16372 ts_tablet_manager.cc:1916] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.543690 16463 tablet.cc:1722] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.545127 16372 ts_tablet_manager.cc:1929] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.545457 16570 consensus_queue.cc:1048] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.545643 16371 ts_tablet_manager.cc:1929] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.545708 16371 log.cc:1199] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/b04e5c106dd7400aa039dbf6666ad3aa
I20251025 08:02:29.545925 16371 ts_tablet_manager.cc:1950] T b04e5c106dd7400aa039dbf6666ad3aa P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.546908 14943 tablet_service.cc:1505] Processing CreateTablet for tablet 6c582efa6d334a06a48e2f2b94167776 (DEFAULT_TABLE table=default.Table_b1d8db45b7d745a0b4dd9ff09300da89 [id=be37bd4a45da444e83846233c335d445]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.547372 16390 tablet_bootstrap.cc:492] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.547457 16390 ts_tablet_manager.cc:1403] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.136s user 0.002s sys 0.000s
I20251025 08:02:29.548175 16390 raft_consensus.cc:359] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.548291 16390 raft_consensus.cc:385] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.548322 16390 raft_consensus.cc:740] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.548439 16390 consensus_queue.cc:260] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.548686 16390 ts_tablet_manager.cc:1434] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251025 08:02:29.548852 16390 tablet_bootstrap.cc:492] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.549837 16390 tablet_bootstrap.cc:654] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.551052 16372 log.cc:1199] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/20a3581bd02143bd8a6bdf8e17072faf
I20251025 08:02:29.551370 16372 ts_tablet_manager.cc:1950] T 20a3581bd02143bd8a6bdf8e17072faf P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.551497 15225 tablet_service.cc:1505] Processing CreateTablet for tablet b866fc38e3444514b834f7876fb700ed (DEFAULT_TABLE table=default.Table_66c1bf4cbbca4bf086d9409663f762f2 [id=cf8fb3a063d049e5bd23bcfb9cf64b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.551733 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b866fc38e3444514b834f7876fb700ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.552093 14947 tablet_service.cc:1505] Processing CreateTablet for tablet b866fc38e3444514b834f7876fb700ed (DEFAULT_TABLE table=default.Table_66c1bf4cbbca4bf086d9409663f762f2 [id=cf8fb3a063d049e5bd23bcfb9cf64b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.553809 14942 tablet_service.cc:1505] Processing CreateTablet for tablet ce5ae591c86c4455a1dd3704f1c95d1c (DEFAULT_TABLE table=default.Table_9c7e0359120c415cba47b89251b0be94 [id=4510ebbcd6ee43babe7ee133a0ce6ae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.553835 15216 tablet_service.cc:1505] Processing CreateTablet for tablet ce5ae591c86c4455a1dd3704f1c95d1c (DEFAULT_TABLE table=default.Table_9c7e0359120c415cba47b89251b0be94 [id=4510ebbcd6ee43babe7ee133a0ce6ae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.553996 16391 tablet_bootstrap.cc:492] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.554028 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5ae591c86c4455a1dd3704f1c95d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.554070 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c (DEFAULT_TABLE table=default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.554071 16391 ts_tablet_manager.cc:1403] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.195s user 0.001s sys 0.000s
I20251025 08:02:29.554778 16391 raft_consensus.cc:359] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.554877 16391 raft_consensus.cc:385] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.554912 16391 raft_consensus.cc:740] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.555045 16391 consensus_queue.cc:260] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.555416 16391 ts_tablet_manager.cc:1434] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.556676 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c (DEFAULT_TABLE table=default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.556876 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.557085 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 1ab6b9d8278045ae92043ada5ce6dd71 (DEFAULT_TABLE table=default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.557178 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 6c582efa6d334a06a48e2f2b94167776 (DEFAULT_TABLE table=default.Table_b1d8db45b7d745a0b4dd9ff09300da89 [id=be37bd4a45da444e83846233c335d445]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.557406 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c582efa6d334a06a48e2f2b94167776. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.557585 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 143b073e21a4456591fa1f96668118b4 (table default.Table_49bbc2328aab41cda10e05a7fb925cd9 [id=1338885c63014b47bcd512a9ddfaf31d]) successfully deleted
I20251025 08:02:29.557729 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 20a3581bd02143bd8a6bdf8e17072faf (table default.Table_d57dfa9ab2164520aa85ebfdd8a85546 [id=317c0892e78047c4b33e1836c3e1776d]) successfully deleted
I20251025 08:02:29.558298 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c (DEFAULT_TABLE table=default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.558496 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.559722 15089 tablet_service.cc:1505] Processing CreateTablet for tablet ce5ae591c86c4455a1dd3704f1c95d1c (DEFAULT_TABLE table=default.Table_9c7e0359120c415cba47b89251b0be94 [id=4510ebbcd6ee43babe7ee133a0ce6ae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.559924 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5ae591c86c4455a1dd3704f1c95d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.562425 15093 tablet_service.cc:1505] Processing CreateTablet for tablet b866fc38e3444514b834f7876fb700ed (DEFAULT_TABLE table=default.Table_66c1bf4cbbca4bf086d9409663f762f2 [id=cf8fb3a063d049e5bd23bcfb9cf64b59]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.562631 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b866fc38e3444514b834f7876fb700ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.565748 16415 tablet.cc:1722] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:29.565924 16570 consensus_queue.cc:1048] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.566694 16425 tablet.cc:1722] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:29.567831 16658 tablet.cc:1722] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.568590 16463 tablet.cc:1722] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:29.569667 14721 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6d1979a4f43a4659976b0cd6d1b888ef has no consensus state
I20251025 08:02:29.571553 14726 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_754e539219a14fbba92f1f3fe54b0f2e [id=3e1281c3f28346a4a1dd2c4fcc990a2e] alter complete (version 3)
I20251025 08:02:29.572067 14719 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_85b56f9883d74360a81c24c7dbe31f32 [id=03f81977ce8b4edbaf54dceff38426af] alter complete (version 1)
W20251025 08:02:29.573638 14726 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b (table default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064], current schema version=2): Not found: failed to reset TS proxy: No leader found: Tablet 27d1e084fbdf43e2a1cc60fb6dfd194b consensus state has no leader
I20251025 08:02:29.574990 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c582efa6d334a06a48e2f2b94167776. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:29.575791 14712 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet d709ecb9ac9a4525985c7d2bf10719f5 (table default.Table_c6928dca846645b8887db36cc7cb9675 [id=9d1a6ae0121b45cda008d5dda6ea7e35], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet d709ecb9ac9a4525985c7d2bf10719f5 consensus state has no leader
I20251025 08:02:29.576778 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet 3f5cff308fc9448db40b0d4df03c69bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.577095 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet e48ddcfccc1340d39d21ce94bec4bf27 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.577381 16391 tablet_bootstrap.cc:492] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.577625 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b866fc38e3444514b834f7876fb700ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.578474 14948 tablet_service.cc:1552] Processing DeleteTablet for tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.578745 16391 tablet_bootstrap.cc:654] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.579267 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 3f5cff308fc9448db40b0d4df03c69bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.580487 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5ae591c86c4455a1dd3704f1c95d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.581341 16415 tablet.cc:1722] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.582321 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.584012 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ab6b9d8278045ae92043ada5ce6dd71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.584656 16392 tablet_bootstrap.cc:492] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.584662 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 1ab6b9d8278045ae92043ada5ce6dd71 (DEFAULT_TABLE table=default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.584738 16392 ts_tablet_manager.cc:1403] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.088s user 0.002s sys 0.000s
I20251025 08:02:29.584882 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ab6b9d8278045ae92043ada5ce6dd71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.585150 16392 raft_consensus.cc:359] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.585246 16392 raft_consensus.cc:385] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.585275 16392 raft_consensus.cc:740] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.585379 16392 consensus_queue.cc:260] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.585665 16413 raft_consensus.cc:493] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.585673 16392 ts_tablet_manager.cc:1434] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.585727 16413 raft_consensus.cc:515] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.585846 16392 tablet_bootstrap.cc:492] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.585836 14726 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 090117a75882489d84687e41b50616e9 (table default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e]). Expected version 1 got 0
I20251025 08:02:29.586146 16413 leader_election.cc:290] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.586280 16570 consensus_queue.cc:1048] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.586913 16392 tablet_bootstrap.cc:654] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.587605 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7ff0b4596944f38ae9325a95167c287" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.588544 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet b04e5c106dd7400aa039dbf6666ad3aa (table default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]) successfully deleted
I20251025 08:02:29.588722 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7ff0b4596944f38ae9325a95167c287" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.588860 15240 raft_consensus.cc:2393] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:29.589138 14914 leader_election.cc:304] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.589322 16413 raft_consensus.cc:3060] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.590238 16413 raft_consensus.cc:2749] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.591853 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet e106f20977444dd4a49b6e4ae0f45380 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.592006 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet ae3c8e134d164edd8781f27e7bdc3b92 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.592700 16372 tablet_replica.cc:333] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.592860 16372 raft_consensus.cc:2243] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.592978 16372 raft_consensus.cc:2272] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.593075 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet e48ddcfccc1340d39d21ce94bec4bf27 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.593189 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet e762c440cb0947deb7e6a4186deebdc1 with delete_type TABLET_DATA_DELETED (replaced by tablet 14b47bf733754b72b34bd74aa033afa3) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.593806 16372 ts_tablet_manager.cc:1916] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.594552 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 1ab6b9d8278045ae92043ada5ce6dd71 (DEFAULT_TABLE table=default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.594552 15497 consensus_queue.cc:1048] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.594785 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ab6b9d8278045ae92043ada5ce6dd71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.595973 16372 ts_tablet_manager.cc:1929] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.596082 16372 log.cc:1199] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/e106f20977444dd4a49b6e4ae0f45380
I20251025 08:02:29.596331 16372 ts_tablet_manager.cc:1950] T e106f20977444dd4a49b6e4ae0f45380 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.597018 16372 tablet_replica.cc:333] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.597162 16372 raft_consensus.cc:2243] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.597343 16372 pending_rounds.cc:70] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:29.597422 16372 pending_rounds.cc:77] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609815114821632 op_type: NO_OP noop_request { }
I20251025 08:02:29.597522 16372 raft_consensus.cc:2889] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:29.597618 16372 raft_consensus.cc:2272] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.598929 16371 tablet_replica.cc:333] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.599423 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 85c7748077184fdda472821a0826cd77 (DEFAULT_TABLE table=default.Table_e3dddd8db8a64833bd7de5ad2fec599a [id=9b1cfdaffd964fba879de8e58c7ac93c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.599643 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c7748077184fdda472821a0826cd77. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:29.599664 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 2069ab40d30c4b8dab9d37c466522ac1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2069ab40d30c4b8dab9d37c466522ac1 already in progress: creating tablet
W20251025 08:02:29.599790 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a2b8efa8ed634583b7bf7cc91bfc61a3 already in progress: creating tablet
W20251025 08:02:29.599910 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet d709ecb9ac9a4525985c7d2bf10719f5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d709ecb9ac9a4525985c7d2bf10719f5 already in progress: creating tablet
I20251025 08:02:29.599730 16371 raft_consensus.cc:2243] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.600528 14727 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_c3c319cac2594db28f07c7266a5405ed" } new_table_name: "default.Table_155857795087477392a338e28fb60afc" modify_external_catalogs: true
I20251025 08:02:29.601914 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_87199a6b9d0a48909e5a74fb64314424"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.602257 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87199a6b9d0a48909e5a74fb64314424 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.603462 14725 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_329a467cbe4b499c90505c8fd924ddc8" } new_table_name: "default.Table_96ffee6ed67048c5bc78a91d739e8a02" modify_external_catalogs: true
I20251025 08:02:29.600106 16371 raft_consensus.cc:2272] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.604318 16371 ts_tablet_manager.cc:1916] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.604271 14723 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_85a7a7da077848fe960699e536360b41"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.604576 14723 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85a7a7da077848fe960699e536360b41 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.605721 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 212ccfb58f964d7bae31e5af110b4079 (DEFAULT_TABLE table=default.Table_ebce5278d348458e8ab930ddd6088775 [id=2de94631eeee41489ea858ed887de8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.605924 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 212ccfb58f964d7bae31e5af110b4079. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.607508 15225 tablet_service.cc:1505] Processing CreateTablet for tablet e0cc4859d32a4e119b413e1cbbb52834 (DEFAULT_TABLE table=default.Table_acf14806991f4da89dc9bb3361537133 [id=e63210d8c6d148e18496c0bc0d326ab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.607690 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0cc4859d32a4e119b413e1cbbb52834. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.608621 14943 tablet_service.cc:1505] Processing CreateTablet for tablet 85c7748077184fdda472821a0826cd77 (DEFAULT_TABLE table=default.Table_e3dddd8db8a64833bd7de5ad2fec599a [id=9b1cfdaffd964fba879de8e58c7ac93c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.608829 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c7748077184fdda472821a0826cd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.608873 14719 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_85ecb3ae3f1a4810b5abcb29f861e881"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:29.608983 16371 ts_tablet_manager.cc:1929] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.609040 16371 log.cc:1199] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/51fca67cb1b84e44a491b6a788c01062
I20251025 08:02:29.609244 16371 ts_tablet_manager.cc:1950] T 51fca67cb1b84e44a491b6a788c01062 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.609282 15497 raft_consensus.cc:493] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.609356 15497 raft_consensus.cc:515] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.609704 15497 leader_election.cc:290] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.609858 16371 tablet_replica.cc:333] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.610003 16371 raft_consensus.cc:2243] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.610407 14724 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_8001f289cc1341ce83a82f259b0255f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.610778 14724 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8001f289cc1341ce83a82f259b0255f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.611948 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d993e2350f37492bb712d145d03e8afb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.610354 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d993e2350f37492bb712d145d03e8afb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.610514 14944 tablet_service.cc:1505] Processing CreateTablet for tablet e0cc4859d32a4e119b413e1cbbb52834 (DEFAULT_TABLE table=default.Table_acf14806991f4da89dc9bb3361537133 [id=e63210d8c6d148e18496c0bc0d326ab9]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:29.612254 15049 leader_election.cc:343] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.612356 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0cc4859d32a4e119b413e1cbbb52834. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:29.612426 15048 leader_election.cc:343] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.612480 15048 leader_election.cc:304] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.612597 15497 raft_consensus.cc:2749] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.612411 16371 raft_consensus.cc:2272] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.613047 16371 ts_tablet_manager.cc:1916] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.613480 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 51fca67cb1b84e44a491b6a788c01062 (table default.Table_28db4c3dec79421c9ad752690a383ea4 [id=593c3f07bdaa45d49e1c8cf97cf0c2c7]) successfully deleted
W20251025 08:02:29.613598 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet ae3c8e134d164edd8781f27e7bdc3b92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ae3c8e134d164edd8781f27e7bdc3b92 already in progress: creating tablet
I20251025 08:02:29.614074 16199 consensus_queue.cc:1048] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.610723 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 212ccfb58f964d7bae31e5af110b4079 (DEFAULT_TABLE table=default.Table_ebce5278d348458e8ab930ddd6088775 [id=2de94631eeee41489ea858ed887de8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.614511 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 212ccfb58f964d7bae31e5af110b4079. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.618472 16372 ts_tablet_manager.cc:1916] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.619103 16371 ts_tablet_manager.cc:1929] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.619220 16371 log.cc:1199] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/04d3488a6b814223b742f0d5c946362f
I20251025 08:02:29.619467 16371 ts_tablet_manager.cc:1950] T 04d3488a6b814223b742f0d5c946362f P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.620013 16371 tablet_replica.cc:333] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.620114 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 04d3488a6b814223b742f0d5c946362f (table default.Table_32f95976a4704d3fbba9e5c01cb8f9d9 [id=bdcc7cd59c78409fad7b5f687ae81310]) successfully deleted
I20251025 08:02:29.620225 16371 raft_consensus.cc:2243] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.620354 16371 raft_consensus.cc:2272] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.620703 16371 ts_tablet_manager.cc:1916] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:29.621250 14719 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_85ecb3ae3f1a4810b5abcb29f861e881 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:29.625110 14714 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 3f5cff308fc9448db40b0d4df03c69bb because the tablet was not found. No further retry: Not found: Tablet not found: 3f5cff308fc9448db40b0d4df03c69bb
I20251025 08:02:29.625275 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet e106f20977444dd4a49b6e4ae0f45380 (table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]) successfully deleted
W20251025 08:02:29.625396 14714 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet ae3c8e134d164edd8781f27e7bdc3b92 because the tablet was not found. No further retry: Not found: Tablet not found: ae3c8e134d164edd8781f27e7bdc3b92
I20251025 08:02:29.626246 15091 tablet_service.cc:1505] Processing CreateTablet for tablet e0cc4859d32a4e119b413e1cbbb52834 (DEFAULT_TABLE table=default.Table_acf14806991f4da89dc9bb3361537133 [id=e63210d8c6d148e18496c0bc0d326ab9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.626456 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0cc4859d32a4e119b413e1cbbb52834. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.626611 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 212ccfb58f964d7bae31e5af110b4079 (DEFAULT_TABLE table=default.Table_ebce5278d348458e8ab930ddd6088775 [id=2de94631eeee41489ea858ed887de8c1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.626827 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 212ccfb58f964d7bae31e5af110b4079. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.626791 14718 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_13374d55596a48c493e555af032ca1ff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.627079 14718 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_13374d55596a48c493e555af032ca1ff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.626013 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 85c7748077184fdda472821a0826cd77 (DEFAULT_TABLE table=default.Table_e3dddd8db8a64833bd7de5ad2fec599a [id=9b1cfdaffd964fba879de8e58c7ac93c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.628401 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85c7748077184fdda472821a0826cd77. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.632524 16372 ts_tablet_manager.cc:1929] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.632580 16372 log.cc:1199] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/e48ddcfccc1340d39d21ce94bec4bf27
I20251025 08:02:29.632795 16372 ts_tablet_manager.cc:1950] T e48ddcfccc1340d39d21ce94bec4bf27 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.634698 16391 tablet_bootstrap.cc:492] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.634775 16391 ts_tablet_manager.cc:1403] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.057s user 0.002s sys 0.000s
I20251025 08:02:29.635214 16391 raft_consensus.cc:359] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.635313 16391 raft_consensus.cc:385] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.635365 16391 raft_consensus.cc:740] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.635479 16391 consensus_queue.cc:260] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.635740 16391 ts_tablet_manager.cc:1434] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.635911 16391 tablet_bootstrap.cc:492] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.636302 16392 tablet_bootstrap.cc:492] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.636369 16392 ts_tablet_manager.cc:1403] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.000s
I20251025 08:02:29.636793 16392 raft_consensus.cc:359] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.636879 16392 raft_consensus.cc:385] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.636910 16392 raft_consensus.cc:740] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.637025 16392 consensus_queue.cc:260] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.637215 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet e48ddcfccc1340d39d21ce94bec4bf27 (table default.Table_52aa8e04fcc241078c3c06f3157a5e4b [id=c571a9bdb4d14249a27b401b9c02f644]) successfully deleted
I20251025 08:02:29.637293 16392 ts_tablet_manager.cc:1434] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.637447 16392 tablet_bootstrap.cc:492] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.638374 16392 tablet_bootstrap.cc:654] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:29.640255 14727 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a941ba28528d41699390e9db80f25594 consensus state has no leader
W20251025 08:02:29.642356 14725 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0488062b11994f03a1af2e52db492977 consensus state has no leader
I20251025 08:02:29.643421 16372 tablet_replica.cc:333] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.643548 16372 raft_consensus.cc:2243] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.643636 16372 raft_consensus.cc:2272] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.644222 16372 ts_tablet_manager.cc:1916] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.646378 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_37a4fd748a93467eb24cd79ee89df4ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.646699 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37a4fd748a93467eb24cd79ee89df4ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.647089 16372 ts_tablet_manager.cc:1929] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.647145 16372 log.cc:1199] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/e762c440cb0947deb7e6a4186deebdc1
I20251025 08:02:29.647325 16372 ts_tablet_manager.cc:1950] T e762c440cb0947deb7e6a4186deebdc1 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.647549 14725 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_8436de66616b479fa1982a64ba3579d0" } modify_external_catalogs: true
I20251025 08:02:29.647634 14725 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_8436de66616b479fa1982a64ba3579d0" } modify_external_catalogs: true
I20251025 08:02:29.648519 14723 master_service.cc:954] ReplaceTablet: received request to replace tablet 4d84ee63450243f8910ad4bd1ec6459e from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:29.649256 14724 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_51c8e80718644971942377f115aee6ea" } modify_external_catalogs: true
I20251025 08:02:29.649345 14724 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_51c8e80718644971942377f115aee6ea" } modify_external_catalogs: true
I20251025 08:02:29.650091 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_599c0d46a95d45b4aa9bab3b54b52470"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.650440 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_599c0d46a95d45b4aa9bab3b54b52470 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.652196 14718 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_0517aaafe6e64827b84bb99171d2ad75"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.652472 14718 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0517aaafe6e64827b84bb99171d2ad75 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.657768 14726 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_56b69a1e3b4d4e7dbaa6a4697a940880 [id=cb9294ed7c474aae989ac13159ec3166] alter complete (version 2)
I20251025 08:02:29.658411 14719 master_service.cc:954] ReplaceTablet: received request to replace tablet 4edf680e8d4a4b898fd6e64f8ec6f75d from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:29.666102 16371 ts_tablet_manager.cc:1929] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.667126 15384 consensus_queue.cc:1048] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.670135 16371 log.cc:1199] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/221f4c5432bc45e18728f5ed1453ad0f
I20251025 08:02:29.670470 16371 ts_tablet_manager.cc:1950] T 221f4c5432bc45e18728f5ed1453ad0f P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.671096 16371 tablet_replica.cc:333] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.671754 16392 tablet_bootstrap.cc:492] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.671845 16392 ts_tablet_manager.cc:1403] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
I20251025 08:02:29.672283 16392 raft_consensus.cc:359] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.672379 16392 raft_consensus.cc:385] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.672410 16392 raft_consensus.cc:740] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.672519 16392 consensus_queue.cc:260] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.672680 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 221f4c5432bc45e18728f5ed1453ad0f (table default.Table_4a9fc326b302473f86d8d3f7e7b8040f [id=15a38bbafe4045e9991cb846ec9e452c]) successfully deleted
I20251025 08:02:29.672789 16392 ts_tablet_manager.cc:1434] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.672971 16392 tablet_bootstrap.cc:492] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.672986 14719 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8" } modify_external_catalogs: true
I20251025 08:02:29.673326 14719 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8" } modify_external_catalogs: true
I20251025 08:02:29.673595 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet e762c440cb0947deb7e6a4186deebdc1 (table default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]) successfully deleted
I20251025 08:02:29.673828 16392 tablet_bootstrap.cc:654] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.674016 15642 raft_consensus.cc:493] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.674084 15642 raft_consensus.cc:515] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.674460 15642 leader_election.cc:290] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.671442 16391 tablet_bootstrap.cc:654] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.675832 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd5a31508964130828ee0367a3317ed" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.674772 14974 raft_consensus.cc:3060] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:29.676605 15049 leader_election.cc:343] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.676743 14978 raft_consensus.cc:1275] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:29.677104 16582 consensus_queue.cc:1048] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.675047 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd5a31508964130828ee0367a3317ed" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:29.677711 15048 leader_election.cc:343] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.677776 15048 leader_election.cc:304] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.677814 15240 raft_consensus.cc:1275] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:29.678166 15642 raft_consensus.cc:2749] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.678285 15642 consensus_queue.cc:1048] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.678937 15909 consensus_queue.cc:1048] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.681557 16371 raft_consensus.cc:2243] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.681671 16371 raft_consensus.cc:2272] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.681994 16371 ts_tablet_manager.cc:1916] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.685003 16425 tablet.cc:1722] T b7ff0b4596944f38ae9325a95167c287 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.685227 16690 mvcc.cc:204] Tried to move back new op lower bound from 7214609816270696448 to 7214609814026141696. Current Snapshot: MvccSnapshot[applied={T|T < 7214609816270696448}]
I20251025 08:02:29.685389 16415 tablet.cc:1722] T b7ff0b4596944f38ae9325a95167c287 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.692232 16371 ts_tablet_manager.cc:1929] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.692299 16371 log.cc:1199] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/20a3581bd02143bd8a6bdf8e17072faf
I20251025 08:02:29.692539 16371 ts_tablet_manager.cc:1950] T 20a3581bd02143bd8a6bdf8e17072faf P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.693027 16371 tablet_replica.cc:333] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.693176 16371 raft_consensus.cc:2243] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.693324 16371 raft_consensus.cc:2272] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.693420 14725 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet c20947edc1f24e338cabf72b18282d24
I20251025 08:02:29.693877 16371 ts_tablet_manager.cc:1916] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.694928 16391 tablet_bootstrap.cc:492] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.695015 16391 ts_tablet_manager.cc:1403] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.000s
I20251025 08:02:29.695432 16391 raft_consensus.cc:359] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.695525 14723 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 4d84ee63450243f8910ad4bd1ec6459e
I20251025 08:02:29.695540 16391 raft_consensus.cc:385] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.695576 16391 raft_consensus.cc:740] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.695681 16391 consensus_queue.cc:260] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.695780 14723 catalog_manager.cc:6719] ReplaceTablet: tablet 4d84ee63450243f8910ad4bd1ec6459e deleted and replaced by tablet c84d6bed24444dcfab1920efad849932
I20251025 08:02:29.695951 16391 ts_tablet_manager.cc:1434] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.696156 16391 tablet_bootstrap.cc:492] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.696256 14724 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet a25116c3ecda411bb480cc47a3ca6bf5
I20251025 08:02:29.696383 16371 ts_tablet_manager.cc:1929] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.696477 16371 log.cc:1199] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/143b073e21a4456591fa1f96668118b4
I20251025 08:02:29.696760 16371 ts_tablet_manager.cc:1950] T 143b073e21a4456591fa1f96668118b4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.696970 16391 tablet_bootstrap.cc:654] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.697410 16371 tablet_replica.cc:333] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.697552 16371 raft_consensus.cc:2243] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.697664 16371 raft_consensus.cc:2272] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.698068 16371 ts_tablet_manager.cc:1916] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.699043 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet c20947edc1f24e338cabf72b18282d24 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.699165 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 4d84ee63450243f8910ad4bd1ec6459e with delete_type TABLET_DATA_DELETED (replaced by tablet c84d6bed24444dcfab1920efad849932) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.699252 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet a25116c3ecda411bb480cc47a3ca6bf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.699759 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet c20947edc1f24e338cabf72b18282d24 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.699900 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 4d84ee63450243f8910ad4bd1ec6459e with delete_type TABLET_DATA_DELETED (replaced by tablet c84d6bed24444dcfab1920efad849932) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.700030 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet a25116c3ecda411bb480cc47a3ca6bf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.700038 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 20a3581bd02143bd8a6bdf8e17072faf (table default.Table_d57dfa9ab2164520aa85ebfdd8a85546 [id=317c0892e78047c4b33e1836c3e1776d]) successfully deleted
I20251025 08:02:29.700146 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 143b073e21a4456591fa1f96668118b4 (table default.Table_49bbc2328aab41cda10e05a7fb925cd9 [id=1338885c63014b47bcd512a9ddfaf31d]) successfully deleted
W20251025 08:02:29.700243 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 6cedb44483cf4f62acf52b90b6708dfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cedb44483cf4f62acf52b90b6708dfb already in progress: creating tablet
I20251025 08:02:29.700604 16371 ts_tablet_manager.cc:1929] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.700668 15642 raft_consensus.cc:493] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.700765 16371 log.cc:1199] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/2f1b1d6cc6cf4f9b8aa5c7d121468bf4
I20251025 08:02:29.700747 15642 raft_consensus.cc:515] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.701048 16371 ts_tablet_manager.cc:1950] T 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.701058 15642 leader_election.cc:290] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.701437 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "399d6b0459864b1586aa99948c56baea" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.701546 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "399d6b0459864b1586aa99948c56baea" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.701799 14718 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_55260f898adb4a5e9438ea958a0a28ce" } modify_external_catalogs: true
I20251025 08:02:29.701936 14718 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_55260f898adb4a5e9438ea958a0a28ce" } modify_external_catalogs: true
I20251025 08:02:29.702417 16371 tablet_replica.cc:333] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.702564 16371 raft_consensus.cc:2243] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.702790 16371 raft_consensus.cc:2272] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:29.702977 15048 leader_election.cc:343] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.703263 16371 ts_tablet_manager.cc:1916] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.703426 14722 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_f197d92f8dea445c807047cbd1086229" } new_table_name: "default.Table_05bac665c2114dacac7804da6adfc06e" modify_external_catalogs: true
I20251025 08:02:29.705080 16371 ts_tablet_manager.cc:1929] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.705207 16371 log.cc:1199] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/c20947edc1f24e338cabf72b18282d24
I20251025 08:02:29.705492 16371 ts_tablet_manager.cc:1950] T c20947edc1f24e338cabf72b18282d24 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
W20251025 08:02:29.705896 15049 leader_election.cc:343] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.705984 15049 leader_election.cc:304] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.706069 16371 tablet_replica.cc:333] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.706149 15642 raft_consensus.cc:2749] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.706282 16371 raft_consensus.cc:2243] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
W20251025 08:02:29.706420 15183 consensus_peers.cc:597] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:29.706540 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 2f1b1d6cc6cf4f9b8aa5c7d121468bf4 (table default.Table_bb8443c590c54dea9dd2e448f2380697 [id=78794c8ceec3479ca3ac3ef55594762f]) successfully deleted
I20251025 08:02:29.706425 16371 raft_consensus.cc:2272] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.706660 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet c20947edc1f24e338cabf72b18282d24 (table default.Table_8436de66616b479fa1982a64ba3579d0 [id=cb6856b315084424836559dacbe12c28]) successfully deleted
I20251025 08:02:29.707218 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet c20947edc1f24e338cabf72b18282d24 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.707379 16372 tablet_replica.cc:333] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.707494 16372 raft_consensus.cc:2243] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.707594 16372 raft_consensus.cc:2272] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.707856 16371 ts_tablet_manager.cc:1916] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.707912 16372 ts_tablet_manager.cc:1916] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.708174 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet a25116c3ecda411bb480cc47a3ca6bf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.709807 16371 ts_tablet_manager.cc:1929] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.709966 16371 log.cc:1199] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/4d84ee63450243f8910ad4bd1ec6459e
I20251025 08:02:29.710050 16372 ts_tablet_manager.cc:1929] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.710119 16372 log.cc:1199] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/c20947edc1f24e338cabf72b18282d24
I20251025 08:02:29.710400 16372 ts_tablet_manager.cc:1950] T c20947edc1f24e338cabf72b18282d24 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.710413 16371 ts_tablet_manager.cc:1950] T 4d84ee63450243f8910ad4bd1ec6459e P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.710898 16372 tablet_replica.cc:333] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.711023 16372 raft_consensus.cc:2243] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.711066 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 4d84ee63450243f8910ad4bd1ec6459e (table default.Table_67238f79fb2446bd9c19c32182814dd0 [id=3c97ef2101a945cd900b30a00a1c8459]) successfully deleted
I20251025 08:02:29.711226 16372 raft_consensus.cc:2272] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.711396 16371 tablet_replica.cc:333] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.711380 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 4d84ee63450243f8910ad4bd1ec6459e with delete_type TABLET_DATA_DELETED (replaced by tablet c84d6bed24444dcfab1920efad849932) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.711692 16371 raft_consensus.cc:2243] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.711716 16372 ts_tablet_manager.cc:1916] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.711840 16371 raft_consensus.cc:2272] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.712342 16371 ts_tablet_manager.cc:1916] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.713538 16372 ts_tablet_manager.cc:1929] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.713608 16372 log.cc:1199] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/a25116c3ecda411bb480cc47a3ca6bf5
I20251025 08:02:29.713821 16372 ts_tablet_manager.cc:1950] T a25116c3ecda411bb480cc47a3ca6bf5 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.714354 16371 ts_tablet_manager.cc:1929] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.714659 16371 log.cc:1199] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/a25116c3ecda411bb480cc47a3ca6bf5
I20251025 08:02:29.715420 16372 tablet_replica.cc:333] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.715538 16372 raft_consensus.cc:2243] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.715628 16372 raft_consensus.cc:2272] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.715742 16463 tablet.cc:1722] T b7ff0b4596944f38ae9325a95167c287 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:29.714924 16371 ts_tablet_manager.cc:1950] T a25116c3ecda411bb480cc47a3ca6bf5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.716586 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet a25116c3ecda411bb480cc47a3ca6bf5 (table default.Table_51c8e80718644971942377f115aee6ea [id=74592e2000d243869f94a1c513fc04e9]) successfully deleted
I20251025 08:02:29.717092 16372 ts_tablet_manager.cc:1916] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.717845 16392 tablet_bootstrap.cc:492] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.717913 16392 ts_tablet_manager.cc:1403] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.000s
I20251025 08:02:29.718353 16392 raft_consensus.cc:359] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.718444 16392 raft_consensus.cc:385] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.718470 16392 raft_consensus.cc:740] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.718569 16392 consensus_queue.cc:260] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.718779 16392 ts_tablet_manager.cc:1434] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.718930 16392 tablet_bootstrap.cc:492] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.719098 16372 ts_tablet_manager.cc:1929] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.719157 16372 log.cc:1199] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/4d84ee63450243f8910ad4bd1ec6459e
I20251025 08:02:29.719399 16372 ts_tablet_manager.cc:1950] T 4d84ee63450243f8910ad4bd1ec6459e P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.719897 16392 tablet_bootstrap.cc:654] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.720405 16391 tablet_bootstrap.cc:492] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.720484 16391 ts_tablet_manager.cc:1403] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20251025 08:02:29.720852 16391 raft_consensus.cc:359] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.720937 16391 raft_consensus.cc:385] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.720970 16391 raft_consensus.cc:740] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.721048 16392 tablet_bootstrap.cc:492] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.721112 16392 ts_tablet_manager.cc:1403] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:29.721077 16391 consensus_queue.cc:260] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.721254 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet c20947edc1f24e338cabf72b18282d24 (table default.Table_8436de66616b479fa1982a64ba3579d0 [id=cb6856b315084424836559dacbe12c28]) successfully deleted
I20251025 08:02:29.721339 16391 ts_tablet_manager.cc:1434] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.721366 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet a25116c3ecda411bb480cc47a3ca6bf5 (table default.Table_51c8e80718644971942377f115aee6ea [id=74592e2000d243869f94a1c513fc04e9]) successfully deleted
I20251025 08:02:29.721465 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 4d84ee63450243f8910ad4bd1ec6459e (table default.Table_67238f79fb2446bd9c19c32182814dd0 [id=3c97ef2101a945cd900b30a00a1c8459]) successfully deleted
I20251025 08:02:29.721499 16391 tablet_bootstrap.cc:492] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.721489 16392 raft_consensus.cc:359] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.721570 16392 raft_consensus.cc:385] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.721596 16392 raft_consensus.cc:740] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.721690 16392 consensus_queue.cc:260] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.721944 16392 ts_tablet_manager.cc:1434] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.722097 16392 tablet_bootstrap.cc:492] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.722249 16391 tablet_bootstrap.cc:654] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.722509 14724 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_5a29e7dba4ba43dfbd0c27981080a1ac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.722862 14724 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5a29e7dba4ba43dfbd0c27981080a1ac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.723155 16392 tablet_bootstrap.cc:654] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.723675 14723 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_0f884fc2a3c74502aa6bad6c3a9b49a8" } modify_external_catalogs: true
I20251025 08:02:29.723758 14723 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_0f884fc2a3c74502aa6bad6c3a9b49a8" } modify_external_catalogs: true
I20251025 08:02:29.724510 16392 tablet_bootstrap.cc:492] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.724573 16392 ts_tablet_manager.cc:1403] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:29.724922 16392 raft_consensus.cc:359] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.725018 16392 raft_consensus.cc:385] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.725049 16392 raft_consensus.cc:740] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.725162 16392 consensus_queue.cc:260] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.725169 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_21b4f92893424716afe86f9c67b6a691"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:29.725397 16392 ts_tablet_manager.cc:1434] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20251025 08:02:29.725461 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21b4f92893424716afe86f9c67b6a691 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.725545 16392 tablet_bootstrap.cc:492] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.725859 14725 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_28c1103af6dc4e96a63ed0c2a0c2cbde" } new_table_name: "default.Table_9d8c68374942454a8e7c869e8cef206f" modify_external_catalogs: true
I20251025 08:02:29.726507 16392 tablet_bootstrap.cc:654] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.727422 16392 tablet_bootstrap.cc:492] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.727479 16392 ts_tablet_manager.cc:1403] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:29.727804 16392 raft_consensus.cc:359] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.727874 16392 raft_consensus.cc:385] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.727898 16392 raft_consensus.cc:740] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.727993 16392 consensus_queue.cc:260] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.728206 16392 ts_tablet_manager.cc:1434] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.728327 16392 tablet_bootstrap.cc:492] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:29.728403 16681 consensus_queue.cc:1175] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20251025 08:02:29.729096 16392 tablet_bootstrap.cc:654] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.731289 16570 consensus_queue.cc:1048] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.731940 16392 tablet_bootstrap.cc:492] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.732002 16392 ts_tablet_manager.cc:1403] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:29.732336 16392 raft_consensus.cc:359] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.732424 16392 raft_consensus.cc:385] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.732446 16392 raft_consensus.cc:740] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.732529 16392 consensus_queue.cc:260] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.732717 16392 ts_tablet_manager.cc:1434] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.732838 16392 tablet_bootstrap.cc:492] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.733582 16392 tablet_bootstrap.cc:654] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.733695 16413 consensus_queue.cc:1048] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.734153 16390 tablet_bootstrap.cc:492] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.734244 16390 ts_tablet_manager.cc:1403] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.185s user 0.000s sys 0.002s
I20251025 08:02:29.734978 16390 raft_consensus.cc:359] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.735075 16390 raft_consensus.cc:385] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.735105 16390 raft_consensus.cc:740] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.735214 16390 consensus_queue.cc:260] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.735481 16390 ts_tablet_manager.cc:1434] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.735623 16390 tablet_bootstrap.cc:492] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.736546 16390 tablet_bootstrap.cc:654] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.738078 16463 tablet.cc:1722] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:29.738533 16392 tablet_bootstrap.cc:492] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.738607 16392 ts_tablet_manager.cc:1403] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:29.738984 16392 raft_consensus.cc:359] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.739055 16392 raft_consensus.cc:385] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.739077 16392 raft_consensus.cc:740] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.739158 16392 consensus_queue.cc:260] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.739353 16392 ts_tablet_manager.cc:1434] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.739476 16392 tablet_bootstrap.cc:492] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.740254 16392 tablet_bootstrap.cc:654] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.742000 16364 ts_tablet_manager.cc:1916] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.743957 16364 ts_tablet_manager.cc:1929] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.744011 16364 log.cc:1199] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/143b073e21a4456591fa1f96668118b4
I20251025 08:02:29.744233 16364 ts_tablet_manager.cc:1950] T 143b073e21a4456591fa1f96668118b4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.744761 16364 tablet_replica.cc:333] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.744868 16364 raft_consensus.cc:2243] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.744952 16364 raft_consensus.cc:2272] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.745061 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 143b073e21a4456591fa1f96668118b4 (table default.Table_49bbc2328aab41cda10e05a7fb925cd9 [id=1338885c63014b47bcd512a9ddfaf31d]) successfully deleted
W20251025 08:02:29.745326 14713 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 6cedb44483cf4f62acf52b90b6708dfb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6cedb44483cf4f62acf52b90b6708dfb already in progress: creating tablet
I20251025 08:02:29.746380 15212 tablet_service.cc:1505] Processing CreateTablet for tablet f426e93af38e4e17b30cd01eea12dcac (DEFAULT_TABLE table=default.Table_6ae9d9f6f9b942e689eecb0548fdf715 [id=a1ed1a0c27ef42c69acd197420340d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.746580 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f426e93af38e4e17b30cd01eea12dcac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.748013 15089 tablet_service.cc:1505] Processing CreateTablet for tablet f426e93af38e4e17b30cd01eea12dcac (DEFAULT_TABLE table=default.Table_6ae9d9f6f9b942e689eecb0548fdf715 [id=a1ed1a0c27ef42c69acd197420340d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.748203 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 2d16499315044408ad4bc1dca6341ed5 (DEFAULT_TABLE table=default.Table_401f8def453c48a19fc90b04a3294a16 [id=db8975b3e7bf43ffbd8b23ba666ffdd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.748417 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 89eda91ab00245418389e614550f20c1 (DEFAULT_TABLE table=default.Table_7c6a96cbfd864aa9842d67953f6853d4 [id=6f74f5eecc0b48a48a191ee958d7a651]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.748783 14952 tablet_service.cc:1505] Processing CreateTablet for tablet f426e93af38e4e17b30cd01eea12dcac (DEFAULT_TABLE table=default.Table_6ae9d9f6f9b942e689eecb0548fdf715 [id=a1ed1a0c27ef42c69acd197420340d7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.748783 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 2d16499315044408ad4bc1dca6341ed5 (DEFAULT_TABLE table=default.Table_401f8def453c48a19fc90b04a3294a16 [id=db8975b3e7bf43ffbd8b23ba666ffdd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.748854 15088 tablet_service.cc:1505] Processing CreateTablet for tablet f9ccba7de6874245bc0e1cdb8e8acfb1 (DEFAULT_TABLE table=default.Table_cac23e61bde0461d9772761aba8b3abb [id=8f399d7e1e774ee79ae9b9892dbc2d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.748993 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f426e93af38e4e17b30cd01eea12dcac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.749017 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d16499315044408ad4bc1dca6341ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.750383 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 2d16499315044408ad4bc1dca6341ed5 (DEFAULT_TABLE table=default.Table_401f8def453c48a19fc90b04a3294a16 [id=db8975b3e7bf43ffbd8b23ba666ffdd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.750586 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d16499315044408ad4bc1dca6341ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.751488 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 89eda91ab00245418389e614550f20c1 (DEFAULT_TABLE table=default.Table_7c6a96cbfd864aa9842d67953f6853d4 [id=6f74f5eecc0b48a48a191ee958d7a651]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.751717 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89eda91ab00245418389e614550f20c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.748250 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f426e93af38e4e17b30cd01eea12dcac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.752808 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ccba7de6874245bc0e1cdb8e8acfb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.753147 14721 catalog_manager.cc:5649] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:29.753327 14721 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b (table default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064]). Expected version 2 got 0
I20251025 08:02:29.753432 14721 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]). Expected version 1 got 0
I20251025 08:02:29.753516 14721 catalog_manager.cc:5649] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:29.753726 15222 tablet_service.cc:1505] Processing CreateTablet for tablet f9ccba7de6874245bc0e1cdb8e8acfb1 (DEFAULT_TABLE table=default.Table_cac23e61bde0461d9772761aba8b3abb [id=8f399d7e1e774ee79ae9b9892dbc2d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.753912 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ccba7de6874245bc0e1cdb8e8acfb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.754160 14718 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet fcc08d74df2d46c58ca27f5d467e060f
I20251025 08:02:29.754458 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89eda91ab00245418389e614550f20c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.754508 14718 master_service.cc:954] ReplaceTablet: received request to replace tablet 93d383e3e2f4493d9cc8a71a4284e107 from {username='slave'} at 127.0.0.1:35702
W20251025 08:02:29.754781 14722 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 consensus state has no leader
I20251025 08:02:29.754806 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d16499315044408ad4bc1dca6341ed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.757040 16413 raft_consensus.cc:493] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.757113 16413 raft_consensus.cc:515] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.757213 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 89eda91ab00245418389e614550f20c1 (DEFAULT_TABLE table=default.Table_7c6a96cbfd864aa9842d67953f6853d4 [id=6f74f5eecc0b48a48a191ee958d7a651]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.757411 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89eda91ab00245418389e614550f20c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.757459 16413 leader_election.cc:290] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.758248 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090117a75882489d84687e41b50616e9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.758366 15239 raft_consensus.cc:2393] T 090117a75882489d84687e41b50616e9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:29.758340 14943 tablet_service.cc:1505] Processing CreateTablet for tablet 55db2958c76e4886b807fdb237f9b2a9 (DEFAULT_TABLE table=default.Table_215d6056104143a2a5c44b771c493865 [id=9926090b33ae4c169603cb1673d71c87]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.758419 14944 tablet_service.cc:1505] Processing CreateTablet for tablet f9ccba7de6874245bc0e1cdb8e8acfb1 (DEFAULT_TABLE table=default.Table_cac23e61bde0461d9772761aba8b3abb [id=8f399d7e1e774ee79ae9b9892dbc2d18]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.758545 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55db2958c76e4886b807fdb237f9b2a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.758661 16364 ts_tablet_manager.cc:1916] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.758909 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ccba7de6874245bc0e1cdb8e8acfb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.759763 14722 master_service.cc:954] ReplaceTablet: received request to replace tablet 6dd0f695a2904df5b750b45782a21ce2 from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:29.760347 14942 tablet_service.cc:1552] Processing DeleteTablet for tablet fcc08d74df2d46c58ca27f5d467e060f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.760586 16371 tablet_replica.cc:333] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.760629 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 55db2958c76e4886b807fdb237f9b2a9 (DEFAULT_TABLE table=default.Table_215d6056104143a2a5c44b771c493865 [id=9926090b33ae4c169603cb1673d71c87]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.760718 16371 raft_consensus.cc:2243] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.760841 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55db2958c76e4886b807fdb237f9b2a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.760833 16371 raft_consensus.cc:2272] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.760987 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "090117a75882489d84687e41b50616e9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.761394 16371 ts_tablet_manager.cc:1916] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.762079 14915 leader_election.cc:304] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.762977 14720 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_a9afe52cc64243a295d043eb385ef7d9 [id=46383e9b028a4d2bb7b39e04f147491e] alter complete (version 1)
I20251025 08:02:29.763052 15497 consensus_queue.cc:1048] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.763477 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet fcc08d74df2d46c58ca27f5d467e060f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.763521 16371 ts_tablet_manager.cc:1929] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:29.763588 16371 log.cc:1199] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/fcc08d74df2d46c58ca27f5d467e060f
I20251025 08:02:29.764954 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 143b073e21a4456591fa1f96668118b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 7dd513b6c7a24dffb91f66c32acc7696) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.765276 16371 ts_tablet_manager.cc:1950] T fcc08d74df2d46c58ca27f5d467e060f P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.766168 16413 raft_consensus.cc:3060] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.767041 16413 raft_consensus.cc:2749] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.767446 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet fcc08d74df2d46c58ca27f5d467e060f (table default.Table_55260f898adb4a5e9438ea958a0a28ce [id=8b67aaea93414dcb9b66d5124952bcee]) successfully deleted
W20251025 08:02:29.767594 14712 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 143b073e21a4456591fa1f96668118b4 because the tablet was not found. No further retry: Not found: Tablet not found: 143b073e21a4456591fa1f96668118b4
I20251025 08:02:29.767907 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet fcc08d74df2d46c58ca27f5d467e060f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.768764 16372 tablet_replica.cc:333] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.770961 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 4ff32cab636840bc86a54aa6c91e9456 (DEFAULT_TABLE table=default.Table_3447d48d82304580af188ed3290be5af [id=b80518faef5b4348a9247367008e0992]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.771173 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff32cab636840bc86a54aa6c91e9456. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.772109 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 47c5c768eafa494db9a0110bf5625451 (DEFAULT_TABLE table=default.Table_89fbe6e89c5b4265a3becdf00dc8a9e2 [id=229b4804d467428f8028c82314a3c3fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.772346 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c5c768eafa494db9a0110bf5625451. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.775024 16391 tablet_bootstrap.cc:492] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.775148 16391 ts_tablet_manager.cc:1403] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.054s user 0.000s sys 0.002s
I20251025 08:02:29.775658 16391 raft_consensus.cc:359] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.775803 16391 raft_consensus.cc:385] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.775875 16391 raft_consensus.cc:740] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.776084 16391 consensus_queue.cc:260] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.776417 16391 ts_tablet_manager.cc:1434] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.778151 15222 tablet_service.cc:1505] Processing CreateTablet for tablet 4ff32cab636840bc86a54aa6c91e9456 (DEFAULT_TABLE table=default.Table_3447d48d82304580af188ed3290be5af [id=b80518faef5b4348a9247367008e0992]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.778424 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff32cab636840bc86a54aa6c91e9456. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.778862 16391 tablet_bootstrap.cc:492] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.779242 14942 tablet_service.cc:1505] Processing CreateTablet for tablet 174daf21bc41408d825ebe926af39c1b (DEFAULT_TABLE table=default.Table_d69575be86d241a797b7167bbe70fa79 [id=c3b6a46013fd4221a273b1842765f917]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.779462 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174daf21bc41408d825ebe926af39c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.779714 15214 tablet_service.cc:1505] Processing CreateTablet for tablet 174daf21bc41408d825ebe926af39c1b (DEFAULT_TABLE table=default.Table_d69575be86d241a797b7167bbe70fa79 [id=c3b6a46013fd4221a273b1842765f917]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.779912 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174daf21bc41408d825ebe926af39c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.780862 15224 tablet_service.cc:1505] Processing CreateTablet for tablet e967a52212164b8cb6f9c39f207024a1 (DEFAULT_TABLE table=default.Table_cc90154d79cc47bd82be7afaff1b0186 [id=0a4629613477421ba329364dbb42a8b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.781102 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e967a52212164b8cb6f9c39f207024a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.781464 14943 tablet_service.cc:1505] Processing CreateTablet for tablet e967a52212164b8cb6f9c39f207024a1 (DEFAULT_TABLE table=default.Table_cc90154d79cc47bd82be7afaff1b0186 [id=0a4629613477421ba329364dbb42a8b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.781670 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e967a52212164b8cb6f9c39f207024a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.782966 16391 tablet_bootstrap.cc:654] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.776573 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 (DEFAULT_TABLE table=default.Table_05bac665c2114dacac7804da6adfc06e [id=9aee333b5b9f4e1daba6449f643ea43a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.777807 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 6d1979a4f43a4659976b0cd6d1b888ef (DEFAULT_TABLE table=default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.783738 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1979a4f43a4659976b0cd6d1b888ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.783773 16570 consensus_queue.cc:1048] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.784515 16390 tablet_bootstrap.cc:492] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.784590 16390 ts_tablet_manager.cc:1403] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.049s user 0.000s sys 0.002s
I20251025 08:02:29.784895 15497 raft_consensus.cc:493] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.784963 15497 raft_consensus.cc:515] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.785002 16390 raft_consensus.cc:359] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.785084 16390 raft_consensus.cc:385] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.785118 16390 raft_consensus.cc:740] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.785218 16390 consensus_queue.cc:260] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.785264 15497 leader_election.cc:290] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.778290 14979 raft_consensus.cc:3060] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.785494 16390 ts_tablet_manager.cc:1434] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.785663 16390 tablet_bootstrap.cc:492] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.785670 14942 tablet_service.cc:1505] Processing CreateTablet for tablet 454a76de5e2c421ab035e6cf1a958c11 (DEFAULT_TABLE table=default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.785857 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 454a76de5e2c421ab035e6cf1a958c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.783748 14947 tablet_service.cc:1505] Processing CreateTablet for tablet d81b65e094a34703ac47897d9bfa4c7c (DEFAULT_TABLE table=default.Table_e0041c8cf73f46c5b49515b6f328f500 [id=768625af4c474964ad2b502cf0b03fa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.786577 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d81b65e094a34703ac47897d9bfa4c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.786773 16390 tablet_bootstrap.cc:654] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.787528 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 (DEFAULT_TABLE table=default.Table_05bac665c2114dacac7804da6adfc06e [id=9aee333b5b9f4e1daba6449f643ea43a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.787736 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.788137 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 47c5c768eafa494db9a0110bf5625451 (DEFAULT_TABLE table=default.Table_89fbe6e89c5b4265a3becdf00dc8a9e2 [id=229b4804d467428f8028c82314a3c3fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.788329 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c5c768eafa494db9a0110bf5625451. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.788499 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb3569ec2cdd4736b264b00abf1fa36a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.789654 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb3569ec2cdd4736b264b00abf1fa36a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.789968 15224 tablet_service.cc:1505] Processing CreateTablet for tablet d81b65e094a34703ac47897d9bfa4c7c (DEFAULT_TABLE table=default.Table_e0041c8cf73f46c5b49515b6f328f500 [id=768625af4c474964ad2b502cf0b03fa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.790154 15222 tablet_service.cc:1505] Processing CreateTablet for tablet 454a76de5e2c421ab035e6cf1a958c11 (DEFAULT_TABLE table=default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:29.790292 15049 leader_election.cc:343] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.790343 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.790159 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d81b65e094a34703ac47897d9bfa4c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.791435 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 6d1979a4f43a4659976b0cd6d1b888ef (DEFAULT_TABLE table=default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.791630 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1979a4f43a4659976b0cd6d1b888ef. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:29.792874 15048 leader_election.cc:343] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.792943 15048 leader_election.cc:304] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.793016 16364 ts_tablet_manager.cc:1929] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.793076 16364 log.cc:1199] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/3f5cff308fc9448db40b0d4df03c69bb
I20251025 08:02:29.793123 16582 consensus_queue.cc:1048] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.793273 16364 ts_tablet_manager.cc:1950] T 3f5cff308fc9448db40b0d4df03c69bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.793356 16582 raft_consensus.cc:2749] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.795616 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 454a76de5e2c421ab035e6cf1a958c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.797399 15864 consensus_queue.cc:1048] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.801286 16372 raft_consensus.cc:2243] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.801450 16372 raft_consensus.cc:2272] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.804096 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 55db2958c76e4886b807fdb237f9b2a9 (DEFAULT_TABLE table=default.Table_215d6056104143a2a5c44b771c493865 [id=9926090b33ae4c169603cb1673d71c87]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.804201 14721 master_service.cc:954] ReplaceTablet: received request to replace tablet 6e0ce41dddc54e8d90a7f84d924d200b from {username='slave'} at 127.0.0.1:35702
I20251025 08:02:29.804232 14724 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_987c3335f4514378a8db45a9f45e3c4d" } new_table_name: "default.Table_08073379da334076bcc5503770a32982" modify_external_catalogs: true
I20251025 08:02:29.804343 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55db2958c76e4886b807fdb237f9b2a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.804468 15085 tablet_service.cc:1505] Processing CreateTablet for tablet 6d1979a4f43a4659976b0cd6d1b888ef (DEFAULT_TABLE table=default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.804672 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d1979a4f43a4659976b0cd6d1b888ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.804852 14718 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 93d383e3e2f4493d9cc8a71a4284e107
I20251025 08:02:29.804986 14723 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 93779f31ade9494f9056cc15665efb0d
I20251025 08:02:29.805064 14718 catalog_manager.cc:6719] ReplaceTablet: tablet 93d383e3e2f4493d9cc8a71a4284e107 deleted and replaced by tablet 82b93b7537c047aea430658ae2c2654b
I20251025 08:02:29.805246 14722 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 6dd0f695a2904df5b750b45782a21ce2
W20251025 08:02:29.805502 14725 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 17e61bb1e9c94b949361b2ca152eb3d4 consensus state has no leader
I20251025 08:02:29.805688 15082 tablet_service.cc:1505] Processing CreateTablet for tablet e967a52212164b8cb6f9c39f207024a1 (DEFAULT_TABLE table=default.Table_cc90154d79cc47bd82be7afaff1b0186 [id=0a4629613477421ba329364dbb42a8b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.805884 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 4ff32cab636840bc86a54aa6c91e9456 (DEFAULT_TABLE table=default.Table_3447d48d82304580af188ed3290be5af [id=b80518faef5b4348a9247367008e0992]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.806252 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 (DEFAULT_TABLE table=default.Table_05bac665c2114dacac7804da6adfc06e [id=9aee333b5b9f4e1daba6449f643ea43a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.806371 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 47c5c768eafa494db9a0110bf5625451 (DEFAULT_TABLE table=default.Table_89fbe6e89c5b4265a3becdf00dc8a9e2 [id=229b4804d467428f8028c82314a3c3fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.806483 15090 tablet_service.cc:1505] Processing CreateTablet for tablet 454a76de5e2c421ab035e6cf1a958c11 (DEFAULT_TABLE table=default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.806557 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 174daf21bc41408d825ebe926af39c1b (DEFAULT_TABLE table=default.Table_d69575be86d241a797b7167bbe70fa79 [id=c3b6a46013fd4221a273b1842765f917]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.805500 14722 catalog_manager.cc:6719] ReplaceTablet: tablet 6dd0f695a2904df5b750b45782a21ce2 deleted and replaced by tablet f3f42babc0b2421fa80b265997effe36
I20251025 08:02:29.805872 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e967a52212164b8cb6f9c39f207024a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.807261 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 454a76de5e2c421ab035e6cf1a958c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.807672 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff32cab636840bc86a54aa6c91e9456. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.809125 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.809547 14719 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 14b47bf733754b72b34bd74aa033afa3
I20251025 08:02:29.809865 14947 tablet_service.cc:1552] Processing DeleteTablet for tablet 93779f31ade9494f9056cc15665efb0d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.810009 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 14b47bf733754b72b34bd74aa033afa3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.810390 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47c5c768eafa494db9a0110bf5625451. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.809872 14942 tablet_service.cc:1552] Processing DeleteTablet for tablet 6dd0f695a2904df5b750b45782a21ce2 with delete_type TABLET_DATA_DELETED (replaced by tablet f3f42babc0b2421fa80b265997effe36) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.811234 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 93d383e3e2f4493d9cc8a71a4284e107 with delete_type TABLET_DATA_DELETED (replaced by tablet 82b93b7537c047aea430658ae2c2654b) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.811515 14726 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]). Expected version 1 got 0
I20251025 08:02:29.813592 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174daf21bc41408d825ebe926af39c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.814085 16371 tablet_replica.cc:333] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.814232 16371 raft_consensus.cc:2243] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.814328 16371 raft_consensus.cc:2272] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.814478 14726 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet cc676245d2984363b4af1e817b444c3d (table default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8]). Expected version 1 got 0
I20251025 08:02:29.814568 14726 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet cb3569ec2cdd4736b264b00abf1fa36a (table default.Table_987c3335f4514378a8db45a9f45e3c4d [id=1ee33ee129d749d0bd7f26dc49fca0fe]). Expected version 3 got 0
I20251025 08:02:29.814666 14726 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 42e8a5ee7d6a42aaaf95c33617abff3f (table default.Table_5d847a37cb0c456294cb5137046f80bb [id=1f6784494d0b4b98b46077a0af6c2ea8]). Expected version 1 got 0
I20251025 08:02:29.814879 16371 ts_tablet_manager.cc:1916] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:29.815344 14724 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cb3569ec2cdd4736b264b00abf1fa36a consensus state has no leader
I20251025 08:02:29.815683 14721 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Sending DeleteTablet for 3 replicas of tablet 6e0ce41dddc54e8d90a7f84d924d200b
I20251025 08:02:29.815941 14721 catalog_manager.cc:6719] ReplaceTablet: tablet 6e0ce41dddc54e8d90a7f84d924d200b deleted and replaced by tablet f6082b299bb44d31b567f70d8da7f0ac
I20251025 08:02:29.816603 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 6e0ce41dddc54e8d90a7f84d924d200b with delete_type TABLET_DATA_DELETED (replaced by tablet f6082b299bb44d31b567f70d8da7f0ac) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.817135 16371 ts_tablet_manager.cc:1929] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.817265 16371 log.cc:1199] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/93779f31ade9494f9056cc15665efb0d
I20251025 08:02:29.817569 16371 ts_tablet_manager.cc:1950] T 93779f31ade9494f9056cc15665efb0d P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.817968 14720 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet cc676245d2984363b4af1e817b444c3d (table default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8]). Expected version 1 got 0
I20251025 08:02:29.818140 14720 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]). Expected version 1 got 0
I20251025 08:02:29.818208 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 93779f31ade9494f9056cc15665efb0d (table default.Table_0f884fc2a3c74502aa6bad6c3a9b49a8 [id=ae530558880e4fa4b18c3f87e21c0fd0]) successfully deleted
W20251025 08:02:29.818631 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 14b47bf733754b72b34bd74aa033afa3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14b47bf733754b72b34bd74aa033afa3 already in progress: creating tablet
I20251025 08:02:29.818765 15087 tablet_service.cc:1552] Processing DeleteTablet for tablet 93779f31ade9494f9056cc15665efb0d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.818737 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 6e0ce41dddc54e8d90a7f84d924d200b with delete_type TABLET_DATA_DELETED (replaced by tablet f6082b299bb44d31b567f70d8da7f0ac) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.818737 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet 93d383e3e2f4493d9cc8a71a4284e107 with delete_type TABLET_DATA_DELETED (replaced by tablet 82b93b7537c047aea430658ae2c2654b) from {username='slave'} at 127.0.0.1:47274
W20251025 08:02:29.819018 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 6dd0f695a2904df5b750b45782a21ce2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6dd0f695a2904df5b750b45782a21ce2 already in progress: creating tablet
I20251025 08:02:29.819106 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 6dd0f695a2904df5b750b45782a21ce2 with delete_type TABLET_DATA_DELETED (replaced by tablet f3f42babc0b2421fa80b265997effe36) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.819258 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 14b47bf733754b72b34bd74aa033afa3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47274
W20251025 08:02:29.819418 14712 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 93d383e3e2f4493d9cc8a71a4284e107 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 93d383e3e2f4493d9cc8a71a4284e107 already in progress: creating tablet
I20251025 08:02:29.819625 16371 tablet_replica.cc:333] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.819774 16371 raft_consensus.cc:2243] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.819913 16371 raft_consensus.cc:2272] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.820700 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 93d383e3e2f4493d9cc8a71a4284e107 with delete_type TABLET_DATA_DELETED (replaced by tablet 82b93b7537c047aea430658ae2c2654b) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.820791 16371 ts_tablet_manager.cc:1916] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.820900 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 93779f31ade9494f9056cc15665efb0d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.821053 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 143b073e21a4456591fa1f96668118b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 7dd513b6c7a24dffb91f66c32acc7696) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.821803 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 6e0ce41dddc54e8d90a7f84d924d200b with delete_type TABLET_DATA_DELETED (replaced by tablet f6082b299bb44d31b567f70d8da7f0ac) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.822021 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 14b47bf733754b72b34bd74aa033afa3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.822204 15114 raft_consensus.cc:1275] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Refusing update from remote peer f0f2f8ce3e9f4d9ba3f3f02813397c31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20251025 08:02:29.822611 16199 consensus_queue.cc:1048] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.822755 16392 tablet_bootstrap.cc:492] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.822790 16371 ts_tablet_manager.cc:1929] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.822824 16392 ts_tablet_manager.cc:1403] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.083s user 0.001s sys 0.000s
I20251025 08:02:29.822842 16371 log.cc:1199] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/6e0ce41dddc54e8d90a7f84d924d200b
I20251025 08:02:29.823057 16371 ts_tablet_manager.cc:1950] T 6e0ce41dddc54e8d90a7f84d924d200b P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.823220 16392 raft_consensus.cc:359] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.823323 16392 raft_consensus.cc:385] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.823369 16392 raft_consensus.cc:740] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.823473 16392 consensus_queue.cc:260] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.823559 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 6e0ce41dddc54e8d90a7f84d924d200b (table default.Table_e19c72b5fee34ad6803d4f2eb019c071 [id=ebfa83131bd946d0897b32ef3c188c19]) successfully deleted
I20251025 08:02:29.823859 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet 6dd0f695a2904df5b750b45782a21ce2 with delete_type TABLET_DATA_DELETED (replaced by tablet f3f42babc0b2421fa80b265997effe36) from {username='slave'} at 127.0.0.1:42694
I20251025 08:02:29.823974 16392 ts_tablet_manager.cc:1434] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.824148 16392 tablet_bootstrap.cc:492] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.824247 14975 raft_consensus.cc:3060] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.824695 16372 ts_tablet_manager.cc:1916] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.824891 16392 tablet_bootstrap.cc:654] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.826856 14726 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: default.Table_f2e0f883fa4646a0aa3e785a7de7f152 [id=ea0a64fc70c84a7eb2b7c8e8e4a933fe] alter complete (version 1)
I20251025 08:02:29.827824 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet fcc08d74df2d46c58ca27f5d467e060f with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.829700 16372 ts_tablet_manager.cc:1929] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:29.829803 16392 tablet_bootstrap.cc:492] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.829881 16392 ts_tablet_manager.cc:1403] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:29.830292 16392 raft_consensus.cc:359] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.830375 16392 raft_consensus.cc:385] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.830404 16392 raft_consensus.cc:740] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.830493 16392 consensus_queue.cc:260] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.830745 16392 ts_tablet_manager.cc:1434] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:29.830883 16392 tablet_bootstrap.cc:492] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.830964 14720 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 2f64072c416f4a77b1c81855d7db8f01 (table default.Table_b9669fd414104dcca80167117a5b0ed7 [id=431195fe6a3847caa5b39d62cb399ffb]). Expected version 1 got 0
I20251025 08:02:29.832367 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet d709ecb9ac9a4525985c7d2bf10719f5 with delete_type TABLET_DATA_DELETED (replaced by tablet b7bb3d7d89674b7e825868c17495bbb3) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.832474 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d with delete_type TABLET_DATA_DELETED (replaced by tablet 1ab6b9d8278045ae92043ada5ce6dd71) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.832549 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 7e90c358ef454760b8317d78724ee377 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.832621 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet cfe9add2f8bf450bb6f49ad57be2caae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47274
I20251025 08:02:29.833093 16392 tablet_bootstrap.cc:654] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:29.833323 14712 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet fcc08d74df2d46c58ca27f5d467e060f because the tablet was not found. No further retry: Not found: Tablet not found: fcc08d74df2d46c58ca27f5d467e060f
I20251025 08:02:29.829813 16372 log.cc:1199] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/fcc08d74df2d46c58ca27f5d467e060f
I20251025 08:02:29.833912 16372 ts_tablet_manager.cc:1950] T fcc08d74df2d46c58ca27f5d467e060f P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.834134 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 1019d033e1f24ab596309462cbeb9c73 (DEFAULT_TABLE table=default.Table_ec7c18f36d434e0b9d294354387082e6 [id=4644ba57f12f4ad4bf7e89f80c4cd161]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.834417 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1019d033e1f24ab596309462cbeb9c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.835760 16372 tablet_replica.cc:333] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.836016 14942 tablet_service.cc:1505] Processing CreateTablet for tablet b7bb3d7d89674b7e825868c17495bbb3 (DEFAULT_TABLE table=default.Table_c6928dca846645b8887db36cc7cb9675 [id=9d1a6ae0121b45cda008d5dda6ea7e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.836210 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7bb3d7d89674b7e825868c17495bbb3. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:29.836277 15183 consensus_peers.cc:597] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:29.836292 16199 consensus_queue.cc:1048] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.836534 15222 tablet_service.cc:1505] Processing CreateTablet for tablet b7bb3d7d89674b7e825868c17495bbb3 (DEFAULT_TABLE table=default.Table_c6928dca846645b8887db36cc7cb9675 [id=9d1a6ae0121b45cda008d5dda6ea7e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.836735 15214 tablet_service.cc:1505] Processing CreateTablet for tablet 1019d033e1f24ab596309462cbeb9c73 (DEFAULT_TABLE table=default.Table_ec7c18f36d434e0b9d294354387082e6 [id=4644ba57f12f4ad4bf7e89f80c4cd161]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.836843 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7bb3d7d89674b7e825868c17495bbb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.838503 16582 consensus_queue.cc:1048] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.839643 16372 raft_consensus.cc:2243] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.839751 16372 raft_consensus.cc:2272] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.840379 14714 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet fcc08d74df2d46c58ca27f5d467e060f (table default.Table_55260f898adb4a5e9438ea958a0a28ce [id=8b67aaea93414dcb9b66d5124952bcee]) successfully deleted
I20251025 08:02:29.840553 16392 tablet_bootstrap.cc:492] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.840624 16392 ts_tablet_manager.cc:1403] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:29.841058 16392 raft_consensus.cc:359] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.841152 16392 raft_consensus.cc:385] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.841187 16392 raft_consensus.cc:740] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.841295 16392 consensus_queue.cc:260] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.841567 15497 raft_consensus.cc:493] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.841650 15497 raft_consensus.cc:515] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.841933 15497 leader_election.cc:290] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.842026 16452 mvcc.cc:204] Tried to move back new op lower bound from 7214609816867102720 to 7214609815653867520. Current Snapshot: MvccSnapshot[applied={T|T < 7214609816867102720}]
I20251025 08:02:29.841593 16392 ts_tablet_manager.cc:1434] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.842134 16463 tablet.cc:1722] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:29.842407 16392 tablet_bootstrap.cc:492] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.842810 14724 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_eaf82018b440497e86dbf2cfdd3785e5" } new_table_name: "default.Table_a6c6f65ea3444858aa562a65d71c4e77" modify_external_catalogs: true
I20251025 08:02:29.843346 16392 tablet_bootstrap.cc:654] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.844673 14719 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_fe4cbb31d8584609ab3669f24baa8c27"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.844981 14719 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe4cbb31d8584609ab3669f24baa8c27 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.844971 16425 tablet.cc:1722] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:29.845306 16423 mvcc.cc:204] Tried to move back new op lower bound from 7214609816867102720 to 7214609815653867520. Current Snapshot: MvccSnapshot[applied={T|T < 7214609816867102720}]
I20251025 08:02:29.845598 14722 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_d77beb2fdfdd42e5b1a16072888cfcac"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.845872 14722 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d77beb2fdfdd42e5b1a16072888cfcac in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.846765 14725 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_911ed9daff7b411c80d61a5a6ca9c623"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:29.847054 15085 tablet_service.cc:1505] Processing CreateTablet for tablet b7bb3d7d89674b7e825868c17495bbb3 (DEFAULT_TABLE table=default.Table_c6928dca846645b8887db36cc7cb9675 [id=9d1a6ae0121b45cda008d5dda6ea7e35]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.847270 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7bb3d7d89674b7e825868c17495bbb3. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:29.847829 14725 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_911ed9daff7b411c80d61a5a6ca9c623 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.848994 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 17339d7c0a4b40a78b3252d17481c192 (DEFAULT_TABLE table=default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.849296 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 1019d033e1f24ab596309462cbeb9c73 (DEFAULT_TABLE table=default.Table_ec7c18f36d434e0b9d294354387082e6 [id=4644ba57f12f4ad4bf7e89f80c4cd161]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.849493 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1019d033e1f24ab596309462cbeb9c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.849538 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 7dd513b6c7a24dffb91f66c32acc7696 (DEFAULT_TABLE table=default.Table_49bbc2328aab41cda10e05a7fb925cd9 [id=1338885c63014b47bcd512a9ddfaf31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.849730 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd513b6c7a24dffb91f66c32acc7696. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.850230 14721 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_e19c72b5fee34ad6803d4f2eb019c071" } new_table_name: "default.Table_c5c036d7c66344eba94e15be432088bc" modify_external_catalogs: true
I20251025 08:02:29.850540 15088 tablet_service.cc:1505] Processing CreateTablet for tablet d81b65e094a34703ac47897d9bfa4c7c (DEFAULT_TABLE table=default.Table_e0041c8cf73f46c5b49515b6f328f500 [id=768625af4c474964ad2b502cf0b03fa7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.850729 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d81b65e094a34703ac47897d9bfa4c7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.853490 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1019d033e1f24ab596309462cbeb9c73. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.854341 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_25e0298aad614dba82f598191e458567"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.854622 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_25e0298aad614dba82f598191e458567 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.855455 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4edf680e8d4a4b898fd6e64f8ec6f75d" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.855756 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 7dd513b6c7a24dffb91f66c32acc7696 (DEFAULT_TABLE table=default.Table_49bbc2328aab41cda10e05a7fb925cd9 [id=1338885c63014b47bcd512a9ddfaf31d]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:29.856144 15049 leader_election.cc:343] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.857731 16582 raft_consensus.cc:493] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.857810 16582 raft_consensus.cc:515] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.858116 16582 leader_election.cc:290] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.858192 16391 tablet_bootstrap.cc:492] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.858273 16391 ts_tablet_manager.cc:1403] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.079s user 0.000s sys 0.001s
I20251025 08:02:29.858397 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4edf680e8d4a4b898fd6e64f8ec6f75d" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.858496 16390 tablet_bootstrap.cc:492] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.858564 16390 ts_tablet_manager.cc:1403] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.073s user 0.000s sys 0.002s
I20251025 08:02:29.858741 16391 raft_consensus.cc:359] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.858831 16391 raft_consensus.cc:385] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.858860 16391 raft_consensus.cc:740] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.858973 16391 consensus_queue.cc:260] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.858973 16390 raft_consensus.cc:359] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.859047 16390 raft_consensus.cc:385] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.859077 16390 raft_consensus.cc:740] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.859169 16390 consensus_queue.cc:260] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.859229 16391 ts_tablet_manager.cc:1434] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.859383 16391 tablet_bootstrap.cc:492] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.859429 16390 ts_tablet_manager.cc:1434] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.859546 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e90c358ef454760b8317d78724ee377" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.860320 16391 tablet_bootstrap.cc:654] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.861488 14718 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_aa5c70a86540451b8a07688d25edc3b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.861785 14718 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa5c70a86540451b8a07688d25edc3b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.861845 16390 tablet_bootstrap.cc:492] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.862788 16390 tablet_bootstrap.cc:654] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.863365 14942 tablet_service.cc:1505] Processing CreateTablet for tablet 17339d7c0a4b40a78b3252d17481c192 (DEFAULT_TABLE table=default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.864153 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17339d7c0a4b40a78b3252d17481c192. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.864902 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e90c358ef454760b8317d78724ee377" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:29.866888 15049 leader_election.cc:343] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.867486 16390 tablet_bootstrap.cc:492] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.867610 16390 ts_tablet_manager.cc:1403] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20251025 08:02:29.868571 16390 raft_consensus.cc:359] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.868777 16390 raft_consensus.cc:385] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.868852 16390 raft_consensus.cc:740] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.869174 16390 consensus_queue.cc:260] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.869720 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 7dd513b6c7a24dffb91f66c32acc7696 (DEFAULT_TABLE table=default.Table_49bbc2328aab41cda10e05a7fb925cd9 [id=1338885c63014b47bcd512a9ddfaf31d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.869956 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd513b6c7a24dffb91f66c32acc7696. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.869988 16390 ts_tablet_manager.cc:1434] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20251025 08:02:29.870409 16390 tablet_bootstrap.cc:492] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.872022 16390 tablet_bootstrap.cc:654] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.873903 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 86b1873446154249a80fa67b99496545 (DEFAULT_TABLE table=default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.874297 15384 raft_consensus.cc:493] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.874369 15384 raft_consensus.cc:515] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.874387 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b1873446154249a80fa67b99496545. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.874696 15384 leader_election.cc:290] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:29.875245 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0769fe05ef364f8e80786bded1ec44cf" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.875348 15111 raft_consensus.cc:2468] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:29.875885 15185 leader_election.cc:304] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:29.876083 15384 raft_consensus.cc:2804] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:29.876143 15384 raft_consensus.cc:493] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:29.876180 15384 raft_consensus.cc:3060] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:29.876271 15048 leader_election.cc:343] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.876340 15048 leader_election.cc:304] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.876475 15497 raft_consensus.cc:2749] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.876595 16582 consensus_queue.cc:1048] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.877112 15384 raft_consensus.cc:515] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.877297 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0769fe05ef364f8e80786bded1ec44cf" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.877457 15384 leader_election.cc:290] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:29.878000 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0769fe05ef364f8e80786bded1ec44cf" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:29.878054 16392 tablet_bootstrap.cc:492] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
W20251025 08:02:29.878290 15183 leader_election.cc:343] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:29.878476 15183 leader_election.cc:343] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.878582 16392 ts_tablet_manager.cc:1403] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20251025 08:02:29.878849 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0769fe05ef364f8e80786bded1ec44cf" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:29.878960 15111 raft_consensus.cc:3060] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.879891 15111 raft_consensus.cc:2468] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:29.880336 15185 leader_election.cc:304] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:29.880517 15384 raft_consensus.cc:2804] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:29.880606 15384 raft_consensus.cc:697] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:29.880718 15384 consensus_queue.cc:237] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:29.876595 15048 leader_election.cc:343] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.881081 15048 leader_election.cc:304] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.881204 16582 raft_consensus.cc:2749] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.881052 16392 raft_consensus.cc:359] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.881434 16392 raft_consensus.cc:385] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.881956 16392 raft_consensus.cc:740] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.882323 16392 consensus_queue.cc:260] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.885157 14719 master_service.cc:954] ReplaceTablet: received request to replace tablet 4edf680e8d4a4b898fd6e64f8ec6f75d from {username='slave'} at 127.0.0.1:35702
W20251025 08:02:29.886305 14724 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d162f3ee21bd40ce9a9c74b7863a3878 consensus state has no leader
W20251025 08:02:29.889187 15183 consensus_peers.cc:597] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e0ce41dddc54e8d90a7f84d924d200b. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:29.889566 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7dd513b6c7a24dffb91f66c32acc7696. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:29.889653 14721 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f6082b299bb44d31b567f70d8da7f0ac has no consensus state
I20251025 08:02:29.890307 16392 ts_tablet_manager.cc:1434] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s
I20251025 08:02:29.891564 16392 tablet_bootstrap.cc:492] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.891733 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17339d7c0a4b40a78b3252d17481c192. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.892083 16364 tablet_replica.cc:333] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.892191 16364 raft_consensus.cc:2243] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.892274 16364 raft_consensus.cc:2272] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.892812 16364 ts_tablet_manager.cc:1916] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.894272 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 3f5cff308fc9448db40b0d4df03c69bb (table default.Table_200a2632d13848d3b5877ca9f7cb8daa [id=723109f028ee44b2aafcce03c05b61d2]) successfully deleted
I20251025 08:02:29.894594 14721 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 090117a75882489d84687e41b50616e9 (table default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e]). Expected version 1 got 0
I20251025 08:02:29.894867 16364 ts_tablet_manager.cc:1929] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.894923 16364 log.cc:1199] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/e48ddcfccc1340d39d21ce94bec4bf27
I20251025 08:02:29.895112 16364 ts_tablet_manager.cc:1950] T e48ddcfccc1340d39d21ce94bec4bf27 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.895576 16364 tablet_replica.cc:333] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.895690 16364 raft_consensus.cc:2243] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.895848 16364 raft_consensus.cc:2272] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.895843 14713 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet e48ddcfccc1340d39d21ce94bec4bf27 (table default.Table_52aa8e04fcc241078c3c06f3157a5e4b [id=c571a9bdb4d14249a27b401b9c02f644]) successfully deleted
I20251025 08:02:29.896163 16364 ts_tablet_manager.cc:1916] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.897693 14718 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_401f8def453c48a19fc90b04a3294a16" } modify_external_catalogs: true
I20251025 08:02:29.897779 14718 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_401f8def453c48a19fc90b04a3294a16" } modify_external_catalogs: true
I20251025 08:02:29.898049 14721 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_1294a307080744bd964b420814ae843f" } modify_external_catalogs: true
I20251025 08:02:29.898131 14721 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35702:
table { table_name: "default.Table_1294a307080744bd964b420814ae843f" } modify_external_catalogs: true
I20251025 08:02:29.898376 14723 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_ddaa9d9bb575414e95d302ba39e4df09"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:29.898466 14727 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_3d5f1adc46e8481386de4051dd453445"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.898681 14723 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ddaa9d9bb575414e95d302ba39e4df09 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:29.898746 14727 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3d5f1adc46e8481386de4051dd453445 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.899191 14724 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35702:
name: "default.Table_75b0519af19a461d8dd5bdfd0c7a50c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:29.899466 14724 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_75b0519af19a461d8dd5bdfd0c7a50c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:29.899667 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 3f5cff308fc9448db40b0d4df03c69bb with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41754
I20251025 08:02:29.899828 16371 tablet_replica.cc:333] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:29.899945 16371 raft_consensus.cc:2243] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.900044 16371 raft_consensus.cc:2272] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.900503 16371 ts_tablet_manager.cc:1916] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.896247 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 86b1873446154249a80fa67b99496545 (DEFAULT_TABLE table=default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.901247 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b1873446154249a80fa67b99496545. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.902588 16371 ts_tablet_manager.cc:1929] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.902658 16371 log.cc:1199] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/3f5cff308fc9448db40b0d4df03c69bb
I20251025 08:02:29.902855 16371 ts_tablet_manager.cc:1950] T 3f5cff308fc9448db40b0d4df03c69bb P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:29.897905 16364 ts_tablet_manager.cc:1929] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.904002 16364 log.cc:1199] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/c20947edc1f24e338cabf72b18282d24
I20251025 08:02:29.904682 14712 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 3f5cff308fc9448db40b0d4df03c69bb (table default.Table_200a2632d13848d3b5877ca9f7cb8daa [id=723109f028ee44b2aafcce03c05b61d2]) successfully deleted
I20251025 08:02:29.905416 16364 ts_tablet_manager.cc:1950] T c20947edc1f24e338cabf72b18282d24 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.905470 14726 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet cc676245d2984363b4af1e817b444c3d (table default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8]). Expected version 1 got 0
I20251025 08:02:29.895179 15085 tablet_service.cc:1505] Processing CreateTablet for tablet 17339d7c0a4b40a78b3252d17481c192 (DEFAULT_TABLE table=default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:29.905725 14726 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 2f64072c416f4a77b1c81855d7db8f01 (table default.Table_b9669fd414104dcca80167117a5b0ed7 [id=431195fe6a3847caa5b39d62cb399ffb]). Expected version 1 got 0
I20251025 08:02:29.905761 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17339d7c0a4b40a78b3252d17481c192. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.905881 14726 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet e87bae31e5e642a5a34a8c170c62fdca (table default.Table_3ad0d85469a7485ba556f83ce20cecdf [id=edf9af4acd364a30814a645d32d35224]). Expected version 1 got 0
I20251025 08:02:29.906262 15642 raft_consensus.cc:493] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.906335 15642 raft_consensus.cc:515] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.906466 16392 tablet_bootstrap.cc:654] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.907845 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfe9add2f8bf450bb6f49ad57be2caae" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.907065 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfe9add2f8bf450bb6f49ad57be2caae" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.910154 14724 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 090117a75882489d84687e41b50616e9 (table default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e]). Expected version 1 got 0
I20251025 08:02:29.911302 14616 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu with pid 14693
I20251025 08:02:29.912308 16364 tablet_replica.cc:333] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.912456 16364 raft_consensus.cc:2243] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.912631 16364 raft_consensus.cc:2272] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.904240 15380 raft_consensus.cc:493] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.913492 15380 raft_consensus.cc:515] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.913789 15380 leader_election.cc:290] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.914857 16364 ts_tablet_manager.cc:1916] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.914996 16392 tablet_bootstrap.cc:492] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.915125 16392 ts_tablet_manager.cc:1403] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.001s
I20251025 08:02:29.904995 16372 ts_tablet_manager.cc:1916] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.906677 15642 leader_election.cc:290] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.895426 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 86b1873446154249a80fa67b99496545 (DEFAULT_TABLE table=default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:29.908622 15049 leader_election.cc:343] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:29.915668 15048 leader_election.cc:343] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.915697 16392 raft_consensus.cc:359] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.915782 16392 raft_consensus.cc:385] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.915846 16392 raft_consensus.cc:740] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.915784 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86b1873446154249a80fa67b99496545. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:29.915931 15048 leader_election.cc:304] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.915997 16392 consensus_queue.cc:260] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.916043 15642 raft_consensus.cc:2749] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.916419 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bb463fc8b104a87b5503bfc2467a23e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:29.916697 15048 leader_election.cc:343] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.916711 16392 ts_tablet_manager.cc:1434] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.916971 16392 tablet_bootstrap.cc:492] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.916865 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bb463fc8b104a87b5503bfc2467a23e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:29.917177 15049 leader_election.cc:343] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.917258 15049 leader_election.cc:304] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.917387 15380 raft_consensus.cc:2749] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.918170 16391 tablet_bootstrap.cc:492] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.918278 16391 ts_tablet_manager.cc:1403] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.000s
I20251025 08:02:29.918686 16391 raft_consensus.cc:359] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.918773 16391 raft_consensus.cc:385] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.918802 16391 raft_consensus.cc:740] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.918898 16391 consensus_queue.cc:260] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.919137 16392 tablet_bootstrap.cc:654] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.919960 16392 tablet_bootstrap.cc:492] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.920022 16392 ts_tablet_manager.cc:1403] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20251025 08:02:29.920377 16392 raft_consensus.cc:359] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.920464 16392 raft_consensus.cc:385] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.920493 16392 raft_consensus.cc:740] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.920595 16392 consensus_queue.cc:260] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.920845 16392 ts_tablet_manager.cc:1434] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.920994 16392 tablet_bootstrap.cc:492] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.921296 16364 ts_tablet_manager.cc:1929] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.921358 16364 log.cc:1199] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/4d84ee63450243f8910ad4bd1ec6459e
I20251025 08:02:29.921602 16364 ts_tablet_manager.cc:1950] T 4d84ee63450243f8910ad4bd1ec6459e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.921870 16392 tablet_bootstrap.cc:654] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.922158 16364 tablet_replica.cc:333] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.922322 16364 raft_consensus.cc:2243] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.922407 16364 raft_consensus.cc:2272] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.923405 16391 ts_tablet_manager.cc:1434] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:29.923557 16391 tablet_bootstrap.cc:492] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.924409 16392 tablet_bootstrap.cc:492] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.924482 16392 ts_tablet_manager.cc:1403] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20251025 08:02:29.924841 16392 raft_consensus.cc:359] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.924917 16392 raft_consensus.cc:385] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.924943 16392 raft_consensus.cc:740] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.925037 16392 consensus_queue.cc:260] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.925268 16392 ts_tablet_manager.cc:1434] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.925407 16392 tablet_bootstrap.cc:492] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.925812 16391 tablet_bootstrap.cc:654] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.926287 16392 tablet_bootstrap.cc:654] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.927206 16392 tablet_bootstrap.cc:492] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.927284 16392 ts_tablet_manager.cc:1403] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251025 08:02:29.927949 14979 raft_consensus.cc:3060] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:29.927649 16392 raft_consensus.cc:359] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.928167 16392 raft_consensus.cc:385] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.928207 16392 raft_consensus.cc:740] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.929419 16392 consensus_queue.cc:260] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.929757 16392 ts_tablet_manager.cc:1434] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:29.929912 16392 tablet_bootstrap.cc:492] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.930048 16415 tablet.cc:1722] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:29.930425 15380 raft_consensus.cc:493] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.930493 15380 raft_consensus.cc:515] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.930781 15380 leader_election.cc:290] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.930999 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62b2769c6ffc48f980ce7ed2bfa1dd75" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:29.931342 15048 leader_election.cc:343] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.932211 16392 tablet_bootstrap.cc:654] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.934888 16364 ts_tablet_manager.cc:1916] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.935343 16372 ts_tablet_manager.cc:1929] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.935802 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62b2769c6ffc48f980ce7ed2bfa1dd75" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.937639 16390 tablet_bootstrap.cc:492] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.937716 16390 ts_tablet_manager.cc:1403] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.067s user 0.000s sys 0.002s
I20251025 08:02:29.938103 16390 raft_consensus.cc:359] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.938174 16390 raft_consensus.cc:385] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.938221 16390 raft_consensus.cc:740] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.936940 16392 tablet_bootstrap.cc:492] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.938328 16199 consensus_queue.cc:1048] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.938345 16390 consensus_queue.cc:260] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.938397 16392 ts_tablet_manager.cc:1403] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20251025 08:02:29.938588 16390 ts_tablet_manager.cc:1434] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.938724 16390 tablet_bootstrap.cc:492] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.938786 16392 raft_consensus.cc:359] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.938868 16392 raft_consensus.cc:385] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.938895 16392 raft_consensus.cc:740] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
W20251025 08:02:29.937188 15049 leader_election.cc:343] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.938977 16392 consensus_queue.cc:260] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.939044 15049 leader_election.cc:304] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.939257 16392 ts_tablet_manager.cc:1434] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:29.939282 15380 raft_consensus.cc:2749] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.939405 16392 tablet_bootstrap.cc:492] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.939585 16390 tablet_bootstrap.cc:654] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.940236 16392 tablet_bootstrap.cc:654] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.940424 16390 tablet_bootstrap.cc:492] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.940485 16390 ts_tablet_manager.cc:1403] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251025 08:02:29.940861 16390 raft_consensus.cc:359] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.940961 16390 raft_consensus.cc:385] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.940994 16390 raft_consensus.cc:740] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.941094 16390 consensus_queue.cc:260] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.941339 16390 ts_tablet_manager.cc:1434] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.941502 16390 tablet_bootstrap.cc:492] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.941198 16372 log.cc:1199] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/93779f31ade9494f9056cc15665efb0d
I20251025 08:02:29.941988 16372 ts_tablet_manager.cc:1950] T 93779f31ade9494f9056cc15665efb0d P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.942317 16372 tablet_replica.cc:333] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.942430 16372 raft_consensus.cc:2243] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.942505 16390 tablet_bootstrap.cc:654] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.942526 16372 raft_consensus.cc:2272] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.943517 16391 tablet_bootstrap.cc:492] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.943588 16391 ts_tablet_manager.cc:1403] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20251025 08:02:29.944021 16391 raft_consensus.cc:359] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.944118 16391 raft_consensus.cc:385] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.944147 16391 raft_consensus.cc:740] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.944244 16391 consensus_queue.cc:260] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.944494 16391 ts_tablet_manager.cc:1434] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.944511 16372 ts_tablet_manager.cc:1916] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.944628 16391 tablet_bootstrap.cc:492] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.945571 16391 tablet_bootstrap.cc:654] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.946593 16364 ts_tablet_manager.cc:1929] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.946648 16364 log.cc:1199] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/a25116c3ecda411bb480cc47a3ca6bf5
I20251025 08:02:29.946878 16364 ts_tablet_manager.cc:1950] T a25116c3ecda411bb480cc47a3ca6bf5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.947355 16364 tablet_replica.cc:333] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.947463 16364 raft_consensus.cc:2243] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.947556 16364 raft_consensus.cc:2272] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.948045 16372 ts_tablet_manager.cc:1929] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.948113 16372 log.cc:1199] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/6e0ce41dddc54e8d90a7f84d924d200b
I20251025 08:02:29.948381 16372 ts_tablet_manager.cc:1950] T 6e0ce41dddc54e8d90a7f84d924d200b P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.949075 16372 tablet_replica.cc:333] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.949196 16372 raft_consensus.cc:2243] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.949285 16372 raft_consensus.cc:2272] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.949837 16364 ts_tablet_manager.cc:1916] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.952572 16364 ts_tablet_manager.cc:1929] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:29.952697 16364 log.cc:1199] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/fcc08d74df2d46c58ca27f5d467e060f
I20251025 08:02:29.953341 15642 raft_consensus.cc:493] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.953423 15642 raft_consensus.cc:515] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.953714 15642 leader_election.cc:290] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.954478 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a941ba28528d41699390e9db80f25594" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.955449 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a941ba28528d41699390e9db80f25594" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:29.955574 15049 leader_election.cc:343] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:29.955808 15048 leader_election.cc:343] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.955866 15048 leader_election.cc:304] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.955969 15642 raft_consensus.cc:2749] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.956291 16420 raft_consensus.cc:493] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.956365 16420 raft_consensus.cc:515] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.956684 16420 leader_election.cc:290] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:29.957052 15183 connection.cc:537] server connection from 127.0.0.1:42694 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251025 08:02:29.957201 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "54de7e83e8ea42ef93218b0204c61ec6" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:29.957602 14913 connection.cc:537] client connection to 127.14.70.61:44347 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20251025 08:02:29.957733 15303 connection.cc:537] client connection to 127.14.70.61:44347 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251025 08:02:29.957911 15642 raft_consensus.cc:493] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.958005 15642 raft_consensus.cc:515] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:29.958062 15303 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.14.70.61:44347)
W20251025 08:02:29.958171 15303 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.14.70.61:44347)
W20251025 08:02:29.958294 15303 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.14.70.61:44347)
I20251025 08:02:29.958353 15642 leader_election.cc:290] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.958770 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "54de7e83e8ea42ef93218b0204c61ec6" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:29.959059 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed5ed91e953d42afa9ebf9ab8b89d0e6" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:29.959386 15049 leader_election.cc:343] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.959779 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed5ed91e953d42afa9ebf9ab8b89d0e6" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.959903 16372 ts_tablet_manager.cc:1916] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:29.960268 15048 leader_election.cc:343] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.960325 15048 leader_election.cc:304] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.960563 14915 leader_election.cc:304] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.960693 16391 tablet_bootstrap.cc:492] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.960759 16391 ts_tablet_manager.cc:1403] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.000s
I20251025 08:02:29.960801 16420 raft_consensus.cc:2749] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.961292 16391 raft_consensus.cc:359] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.961339 16364 ts_tablet_manager.cc:1950] T fcc08d74df2d46c58ca27f5d467e060f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.961391 16391 raft_consensus.cc:385] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.961418 16391 raft_consensus.cc:740] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.961513 16391 consensus_queue.cc:260] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.961571 15642 raft_consensus.cc:2749] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:29.961697 15049 connection.cc:537] server connection from 127.0.0.1:47274 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20251025 08:02:29.961743 16391 ts_tablet_manager.cc:1434] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.961884 16391 tablet_bootstrap.cc:492] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.962769 16391 tablet_bootstrap.cc:654] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:29.964174 15183 connection.cc:441] server connection from 127.0.0.1:42694 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42694 (request call id 226) could send its response
W20251025 08:02:29.964295 15183 connection.cc:441] server connection from 127.0.0.1:42694 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42694 (request call id 236) could send its response
I20251025 08:02:29.964337 16364 tablet_replica.cc:333] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.964447 16364 raft_consensus.cc:2243] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.964623 16364 raft_consensus.cc:2272] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:29.965415 14974 raft_consensus.cc:3060] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:29.965824 16752 negotiation.cc:337] Failed RPC negotiation. Trace:
1025 08:02:29.958645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.70.61:44347 (local address 127.0.0.1:35994)
1025 08:02:29.965662 (+ 7017us) negotiation.cc:107] Waiting for socket to connect
1025 08:02:29.965715 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.70.61:44347: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":6917,"thread_start_us":77,"threads_started":1}
I20251025 08:02:29.966284 16390 tablet_bootstrap.cc:492] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.966353 16390 ts_tablet_manager.cc:1403] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.001s
I20251025 08:02:29.966485 16391 tablet_bootstrap.cc:492] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.966542 16391 ts_tablet_manager.cc:1403] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:29.966759 16390 raft_consensus.cc:359] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.966856 16390 raft_consensus.cc:385] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.966910 16390 raft_consensus.cc:740] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.967037 16390 consensus_queue.cc:260] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.967234 15909 consensus_queue.cc:1048] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:29.967296 16390 ts_tablet_manager.cc:1434] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:29.967505 16391 raft_consensus.cc:359] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.967650 16391 raft_consensus.cc:385] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.967720 16391 raft_consensus.cc:740] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.967885 16391 consensus_queue.cc:260] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.968333 16391 ts_tablet_manager.cc:1434] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:29.968547 16391 tablet_bootstrap.cc:492] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.968900 16392 tablet_bootstrap.cc:492] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.968982 16392 ts_tablet_manager.cc:1403] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20251025 08:02:29.969332 16392 raft_consensus.cc:359] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.969409 16392 raft_consensus.cc:385] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.969436 16392 raft_consensus.cc:740] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.969539 16392 consensus_queue.cc:260] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.969805 16392 ts_tablet_manager.cc:1434] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.968984 16364 ts_tablet_manager.cc:1916] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.969974 16392 tablet_bootstrap.cc:492] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.970227 16391 tablet_bootstrap.cc:654] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.970958 16392 tablet_bootstrap.cc:654] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:29.971861 16753 negotiation.cc:337] Failed RPC negotiation. Trace:
1025 08:02:29.959434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.70.61:44347 (local address 127.14.70.1:41909)
1025 08:02:29.971627 (+ 12193us) negotiation.cc:107] Waiting for socket to connect
1025 08:02:29.971760 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.70.61:44347: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":12118,"thread_start_us":54,"threads_started":1}
I20251025 08:02:29.973059 16390 tablet_bootstrap.cc:492] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:29.973995 16390 tablet_bootstrap.cc:654] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.974601 16364 ts_tablet_manager.cc:1929] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.974660 16364 log.cc:1199] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/93779f31ade9494f9056cc15665efb0d
I20251025 08:02:29.974897 16364 ts_tablet_manager.cc:1950] T 93779f31ade9494f9056cc15665efb0d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:29.975368 15183 connection.cc:441] server connection from 127.0.0.1:42694 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42694 (request call id 237) could send its response
W20251025 08:02:29.975466 15183 connection.cc:441] server connection from 127.0.0.1:42694 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42694 (request call id 235) could send its response
I20251025 08:02:29.975497 16364 tablet_replica.cc:333] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:29.975593 16364 raft_consensus.cc:2243] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:29.975739 16364 raft_consensus.cc:2272] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:29.976133 16751 negotiation.cc:337] Failed RPC negotiation. Trace:
1025 08:02:29.958400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.70.61:44347 (local address 127.14.70.2:39969)
1025 08:02:29.975965 (+ 17565us) negotiation.cc:107] Waiting for socket to connect
1025 08:02:29.976021 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.70.61:44347: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":17487,"thread_start_us":53,"threads_started":1}
I20251025 08:02:29.977828 16364 ts_tablet_manager.cc:1916] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:29.979693 16392 tablet_bootstrap.cc:492] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.979763 16392 ts_tablet_manager.cc:1403] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:29.980134 16392 raft_consensus.cc:359] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.980214 16392 raft_consensus.cc:385] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.980252 16392 raft_consensus.cc:740] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.980357 16392 consensus_queue.cc:260] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.980576 16392 ts_tablet_manager.cc:1434] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.980739 16392 tablet_bootstrap.cc:492] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.981583 16392 tablet_bootstrap.cc:654] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.982590 16391 tablet_bootstrap.cc:492] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.982669 16391 ts_tablet_manager.cc:1403] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20251025 08:02:29.983111 16391 raft_consensus.cc:359] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.983204 16391 raft_consensus.cc:385] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.983232 16391 raft_consensus.cc:740] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.983330 16391 consensus_queue.cc:260] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.983580 16391 ts_tablet_manager.cc:1434] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:29.983752 16391 tablet_bootstrap.cc:492] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:29.984169 16750 negotiation.cc:337] Failed RPC negotiation. Trace:
1025 08:02:29.957593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.14.70.61:44347 (local address 127.14.70.3:33293)
1025 08:02:29.983986 (+ 26393us) negotiation.cc:107] Waiting for socket to connect
1025 08:02:29.984051 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.14.70.61:44347: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":26312,"thread_start_us":52,"threads_started":1}
I20251025 08:02:29.983795 16372 ts_tablet_manager.cc:1929] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:29.984383 16372 log.cc:1199] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/d709ecb9ac9a4525985c7d2bf10719f5
I20251025 08:02:29.986948 16391 tablet_bootstrap.cc:654] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.988489 16364 ts_tablet_manager.cc:1929] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:29.988561 16364 log.cc:1199] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/6e0ce41dddc54e8d90a7f84d924d200b
I20251025 08:02:29.988793 16364 ts_tablet_manager.cc:1950] T 6e0ce41dddc54e8d90a7f84d924d200b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:29.989248 16391 tablet_bootstrap.cc:492] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:29.989322 16391 ts_tablet_manager.cc:1403] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:29.989805 15642 raft_consensus.cc:493] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.989883 15642 raft_consensus.cc:515] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.990268 15642 leader_election.cc:290] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:29.990249 16372 ts_tablet_manager.cc:1950] T d709ecb9ac9a4525985c7d2bf10719f5 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:29.990550 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23eedc2695db43afbd6f5dbebb0ea2be" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:29.990792 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23eedc2695db43afbd6f5dbebb0ea2be" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:29.991127 15049 leader_election.cc:343] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:29.991215 15048 leader_election.cc:343] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:29.991317 15048 leader_election.cc:304] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:29.991292 16391 raft_consensus.cc:359] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.991371 16391 raft_consensus.cc:385] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.991436 15642 raft_consensus.cc:2749] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:29.991547 16391 raft_consensus.cc:740] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.991725 16391 consensus_queue.cc:260] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.992612 16390 tablet_bootstrap.cc:492] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:29.992690 16390 ts_tablet_manager.cc:1403] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
W20251025 08:02:29.992709 15183 connection.cc:441] server connection from 127.0.0.1:42694 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42694 (request call id 241) could send its response
W20251025 08:02:29.992792 15183 connection.cc:441] server connection from 127.0.0.1:42694 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42694 (request call id 240) could send its response
W20251025 08:02:29.992834 15183 connection.cc:441] server connection from 127.0.0.1:42694 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42694 (request call id 238) could send its response
I20251025 08:02:29.993096 16391 ts_tablet_manager.cc:1434] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:29.993063 16390 raft_consensus.cc:359] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.993144 16390 raft_consensus.cc:385] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.993178 16390 raft_consensus.cc:740] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.993342 16391 tablet_bootstrap.cc:492] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:29.993305 16390 consensus_queue.cc:260] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.993552 16390 ts_tablet_manager.cc:1434] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.993765 16390 tablet_bootstrap.cc:492] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
W20251025 08:02:29.994098 15049 connection.cc:441] server connection from 127.0.0.1:47274 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47274 (request call id 245) could send its response
I20251025 08:02:29.994416 16372 tablet_replica.cc:333] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:29.994536 16372 raft_consensus.cc:2243] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:29.994623 16390 tablet_bootstrap.cc:654] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.994746 16392 tablet_bootstrap.cc:492] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:29.996053 16392 ts_tablet_manager.cc:1403] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251025 08:02:29.996428 16392 raft_consensus.cc:359] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.996491 16392 raft_consensus.cc:385] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:29.996510 16392 raft_consensus.cc:740] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:29.996592 16392 consensus_queue.cc:260] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:29.996850 16392 ts_tablet_manager.cc:1434] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:29.997021 16392 tablet_bootstrap.cc:492] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:29.997377 16391 tablet_bootstrap.cc:654] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.997812 16420 raft_consensus.cc:493] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.997848 16392 tablet_bootstrap.cc:654] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:29.997874 16420 raft_consensus.cc:515] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.998224 16420 leader_election.cc:290] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.998406 15380 raft_consensus.cc:493] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:29.998489 15380 raft_consensus.cc:515] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:29.998764 15380 leader_election.cc:290] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:29.999171 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e106f20977444dd4a49b6e4ae0f45380" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.999289 15240 raft_consensus.cc:2468] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:29.999305 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af5a5d2903ff4142b1f1e70dd2a7d173" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:29.999372 15239 raft_consensus.cc:2468] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:29.999465 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af5a5d2903ff4142b1f1e70dd2a7d173" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:29.999718 14915 leader_election.cc:343] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: e106f20977444dd4a49b6e4ae0f45380
W20251025 08:02:29.999830 15048 leader_election.cc:343] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.000237 14914 leader_election.cc:304] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:29.994616 16372 raft_consensus.cc:2272] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:30.000514 16420 raft_consensus.cc:2804] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.000564 16420 raft_consensus.cc:493] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.000602 16420 raft_consensus.cc:3060] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.000649 16372 ts_tablet_manager.cc:1916] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:30.001545 16420 raft_consensus.cc:515] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.001816 16420 leader_election.cc:290] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.002264 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e106f20977444dd4a49b6e4ae0f45380" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.002271 15049 leader_election.cc:304] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:30.002357 15239 raft_consensus.cc:3060] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.002454 15642 raft_consensus.cc:2804] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.002496 15642 raft_consensus.cc:493] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.002527 15642 raft_consensus.cc:3060] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.003331 15239 raft_consensus.cc:2468] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.003326 15642 raft_consensus.cc:515] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.003587 15642 leader_election.cc:290] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.003834 14914 leader_election.cc:304] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.003862 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af5a5d2903ff4142b1f1e70dd2a7d173" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:30.003998 14915 leader_election.cc:343] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: e106f20977444dd4a49b6e4ae0f45380
W20251025 08:02:30.004225 15048 leader_election.cc:343] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.004426 16420 raft_consensus.cc:2804] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.004750 16390 tablet_bootstrap.cc:492] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.004807 16390 ts_tablet_manager.cc:1403] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251025 08:02:30.005009 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af5a5d2903ff4142b1f1e70dd2a7d173" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.005091 15239 raft_consensus.cc:3060] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.005220 16390 raft_consensus.cc:359] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.005304 16390 raft_consensus.cc:385] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.005332 16390 raft_consensus.cc:740] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.005421 16390 consensus_queue.cc:260] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.004531 16420 raft_consensus.cc:697] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.005591 16420 consensus_queue.cc:237] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.005683 16390 ts_tablet_manager.cc:1434] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.005702 16392 tablet_bootstrap.cc:492] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.005792 16392 ts_tablet_manager.cc:1403] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251025 08:02:30.005844 16390 tablet_bootstrap.cc:492] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.005900 15239 raft_consensus.cc:2468] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.006281 16392 raft_consensus.cc:359] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.006371 16392 raft_consensus.cc:385] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.006407 16392 raft_consensus.cc:740] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.006512 16392 consensus_queue.cc:260] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.006743 16390 tablet_bootstrap.cc:654] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.006753 16392 ts_tablet_manager.cc:1434] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.006901 16392 tablet_bootstrap.cc:492] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.007508 15049 leader_election.cc:304] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:30.007741 15380 raft_consensus.cc:2804] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.007767 16392 tablet_bootstrap.cc:654] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.007814 15380 raft_consensus.cc:697] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:30.007920 15380 consensus_queue.cc:237] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.008841 16372 ts_tablet_manager.cc:1929] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:30.009012 16372 log.cc:1199] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/4edf680e8d4a4b898fd6e64f8ec6f75d
W20251025 08:02:30.010998 15303 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.14.70.61:44347)
I20251025 08:02:30.012949 16372 ts_tablet_manager.cc:1950] T 4edf680e8d4a4b898fd6e64f8ec6f75d P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
W20251025 08:02:30.013233 15049 connection.cc:441] server connection from 127.0.0.1:47274 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47274 (request call id 244) could send its response
I20251025 08:02:30.013437 16372 tablet_replica.cc:333] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:30.013585 16372 raft_consensus.cc:2243] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:30.014647 16372 raft_consensus.cc:2272] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:30.014991 16392 tablet_bootstrap.cc:492] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.015074 16392 ts_tablet_manager.cc:1403] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251025 08:02:30.015447 16392 raft_consensus.cc:359] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.015540 16392 raft_consensus.cc:385] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.015580 16392 raft_consensus.cc:740] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.015686 16392 consensus_queue.cc:260] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.016140 16392 ts_tablet_manager.cc:1434] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.016289 16392 tablet_bootstrap.cc:492] T 75d0c5e694734b37848c4127c4e97085 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.017074 16392 tablet_bootstrap.cc:654] T 75d0c5e694734b37848c4127c4e97085 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.018261 16392 tablet_bootstrap.cc:492] T 75d0c5e694734b37848c4127c4e97085 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.018343 16392 ts_tablet_manager.cc:1403] T 75d0c5e694734b37848c4127c4e97085 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:30.018875 16392 raft_consensus.cc:359] T 75d0c5e694734b37848c4127c4e97085 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.018989 16392 raft_consensus.cc:385] T 75d0c5e694734b37848c4127c4e97085 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.019027 16392 raft_consensus.cc:740] T 75d0c5e694734b37848c4127c4e97085 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.019127 16392 consensus_queue.cc:260] T 75d0c5e694734b37848c4127c4e97085 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.019403 16392 ts_tablet_manager.cc:1434] T 75d0c5e694734b37848c4127c4e97085 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.019548 16392 tablet_bootstrap.cc:492] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.020452 16390 tablet_bootstrap.cc:492] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.020536 16390 ts_tablet_manager.cc:1403] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:30.020670 16392 tablet_bootstrap.cc:654] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.020999 16390 raft_consensus.cc:359] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.021113 16390 raft_consensus.cc:385] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.021153 16390 raft_consensus.cc:740] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.021273 16390 consensus_queue.cc:260] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.022356 16390 ts_tablet_manager.cc:1434] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.022521 16390 tablet_bootstrap.cc:492] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.023554 16390 tablet_bootstrap.cc:654] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.023681 15642 raft_consensus.cc:493] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.023756 15642 raft_consensus.cc:515] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.024073 15642 leader_election.cc:290] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.024276 15642 raft_consensus.cc:493] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.024341 15642 raft_consensus.cc:515] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.024473 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42e8a5ee7d6a42aaaf95c33617abff3f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.024590 15642 leader_election.cc:290] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
W20251025 08:02:30.024890 15049 leader_election.cc:343] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.024899 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5cd481a98514f16bed3fb0bf5003526" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.025271 15049 leader_election.cc:343] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.025791 16390 tablet_bootstrap.cc:492] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.025911 16390 ts_tablet_manager.cc:1403] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:30.026510 16390 raft_consensus.cc:359] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.026654 16390 raft_consensus.cc:385] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.026731 16390 raft_consensus.cc:740] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.026887 16390 consensus_queue.cc:260] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.027444 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42e8a5ee7d6a42aaaf95c33617abff3f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:30.028091 15048 leader_election.cc:343] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.028127 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5cd481a98514f16bed3fb0bf5003526" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.028153 15048 leader_election.cc:304] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.028394 15642 raft_consensus.cc:2749] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.028461 16390 ts_tablet_manager.cc:1434] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.028626 16390 tablet_bootstrap.cc:492] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
W20251025 08:02:30.029256 15048 leader_election.cc:343] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.029317 15048 leader_election.cc:304] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.029534 15380 raft_consensus.cc:2749] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.030220 16390 tablet_bootstrap.cc:654] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.031136 16420 raft_consensus.cc:493] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.031247 16390 tablet_bootstrap.cc:492] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.031226 16420 raft_consensus.cc:515] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.031311 16390 ts_tablet_manager.cc:1403] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:30.031509 16420 leader_election.cc:290] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.032014 16390 raft_consensus.cc:359] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.032061 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae3c8e134d164edd8781f27e7bdc3b92" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.032402 14915 leader_election.cc:343] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: ae3c8e134d164edd8781f27e7bdc3b92
I20251025 08:02:30.032166 16390 raft_consensus.cc:385] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.032742 16372 ts_tablet_manager.cc:1916] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:30.032864 16390 raft_consensus.cc:740] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.033001 16390 consensus_queue.cc:260] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.032287 15239 raft_consensus.cc:2468] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.034370 16582 raft_consensus.cc:493] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.034443 16582 raft_consensus.cc:515] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.034580 14914 leader_election.cc:304] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:30.034698 16390 ts_tablet_manager.cc:1434] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:30.034734 16582 leader_election.cc:290] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.034756 16420 raft_consensus.cc:2804] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.034794 16420 raft_consensus.cc:493] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.034832 16420 raft_consensus.cc:3060] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.034873 16390 tablet_bootstrap.cc:492] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.035666 16392 tablet_bootstrap.cc:492] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.035758 16392 ts_tablet_manager.cc:1403] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20251025 08:02:30.035740 16420 raft_consensus.cc:515] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.035805 16390 tablet_bootstrap.cc:654] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.036099 16420 leader_election.cc:290] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.036418 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ae3c8e134d164edd8781f27e7bdc3b92" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.036510 15240 raft_consensus.cc:3060] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.036572 16392 raft_consensus.cc:359] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.036653 16392 raft_consensus.cc:385] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.036689 16392 raft_consensus.cc:740] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.036775 16392 consensus_queue.cc:260] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.037607 15240 raft_consensus.cc:2468] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.038928 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c119ac81d35496cad2630c19f15ea21" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.039080 16372 ts_tablet_manager.cc:1929] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:30.039224 14914 leader_election.cc:304] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.036514 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c119ac81d35496cad2630c19f15ea21" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.039605 16420 raft_consensus.cc:2804] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.039680 16420 raft_consensus.cc:697] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.039778 16420 consensus_queue.cc:237] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.041177 16390 tablet_bootstrap.cc:492] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.041254 16390 ts_tablet_manager.cc:1403] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:30.041640 16390 raft_consensus.cc:359] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.041707 16372 log.cc:1199] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/7e90c358ef454760b8317d78724ee377
I20251025 08:02:30.041721 16390 raft_consensus.cc:385] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.041749 16390 raft_consensus.cc:740] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.041926 16372 ts_tablet_manager.cc:1950] T 7e90c358ef454760b8317d78724ee377 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:30.041882 16390 consensus_queue.cc:260] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.042155 16390 ts_tablet_manager.cc:1434] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.042339 16390 tablet_bootstrap.cc:492] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
W20251025 08:02:30.043224 14915 leader_election.cc:343] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: ae3c8e134d164edd8781f27e7bdc3b92
I20251025 08:02:30.043311 16390 tablet_bootstrap.cc:654] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:30.039628 15049 leader_election.cc:343] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.044255 16390 tablet_bootstrap.cc:492] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.044541 16390 ts_tablet_manager.cc:1403] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
W20251025 08:02:30.044737 15048 leader_election.cc:343] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.044920 15048 leader_election.cc:304] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.045037 16582 raft_consensus.cc:2749] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.045125 16582 raft_consensus.cc:493] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.045181 16582 raft_consensus.cc:515] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.045399 16391 tablet_bootstrap.cc:492] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.045482 16391 ts_tablet_manager.cc:1403] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.052s user 0.001s sys 0.000s
I20251025 08:02:30.045485 16582 leader_election.cc:290] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.045975 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a547fb54ddbf4053b5be20ee6c4fc6b0" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.045989 16391 raft_consensus.cc:359] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.046088 16391 raft_consensus.cc:385] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.046128 16391 raft_consensus.cc:740] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
W20251025 08:02:30.046291 15049 leader_election.cc:343] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.046268 16391 consensus_queue.cc:260] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.046370 16392 ts_tablet_manager.cc:1434] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.011s user 0.001s sys 0.000s
I20251025 08:02:30.046573 16391 ts_tablet_manager.cc:1434] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.046630 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a547fb54ddbf4053b5be20ee6c4fc6b0" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:30.046885 15048 leader_election.cc:343] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.046937 15048 leader_election.cc:304] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.047247 15380 raft_consensus.cc:2749] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:30.047274 15049 connection.cc:441] server connection from 127.0.0.1:47274 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47274 (request call id 243) could send its response
I20251025 08:02:30.047670 16392 tablet_bootstrap.cc:492] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.047730 16390 raft_consensus.cc:359] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.047806 16390 raft_consensus.cc:385] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.047833 16390 raft_consensus.cc:740] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.047973 16390 consensus_queue.cc:260] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.048197 16390 ts_tablet_manager.cc:1434] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s
I20251025 08:02:30.048712 16392 tablet_bootstrap.cc:654] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.049630 16391 tablet_bootstrap.cc:492] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.049739 16372 tablet_replica.cc:333] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:30.049896 16372 raft_consensus.cc:2243] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:30.050143 16372 raft_consensus.cc:2272] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:30.050627 16391 tablet_bootstrap.cc:654] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.050629 16372 ts_tablet_manager.cc:1916] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:30.051383 16390 tablet_bootstrap.cc:492] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.053364 16390 tablet_bootstrap.cc:654] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.054518 16391 tablet_bootstrap.cc:492] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.054658 16391 ts_tablet_manager.cc:1403] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20251025 08:02:30.055102 16391 raft_consensus.cc:359] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.055259 16391 raft_consensus.cc:385] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.055333 16391 raft_consensus.cc:740] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.055742 16391 consensus_queue.cc:260] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.056185 16391 ts_tablet_manager.cc:1434] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.056396 16391 tablet_bootstrap.cc:492] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.057355 16391 tablet_bootstrap.cc:654] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.058511 16392 tablet_bootstrap.cc:492] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.058640 16392 ts_tablet_manager.cc:1403] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251025 08:02:30.059152 16392 raft_consensus.cc:359] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.059247 16392 raft_consensus.cc:385] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.059281 16392 raft_consensus.cc:740] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.059407 16392 consensus_queue.cc:260] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.059653 16392 ts_tablet_manager.cc:1434] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.060194 16392 tablet_bootstrap.cc:492] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.061421 16392 tablet_bootstrap.cc:654] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.064553 16392 tablet_bootstrap.cc:492] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.064677 16392 ts_tablet_manager.cc:1403] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20251025 08:02:30.065095 16392 raft_consensus.cc:359] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.065253 16392 raft_consensus.cc:385] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.065325 16392 raft_consensus.cc:740] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.065481 16392 consensus_queue.cc:260] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.066583 16392 ts_tablet_manager.cc:1434] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:30.066751 16392 tablet_bootstrap.cc:492] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.067610 16392 tablet_bootstrap.cc:654] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.068125 16372 ts_tablet_manager.cc:1929] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:30.068259 16372 log.cc:1199] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/cfe9add2f8bf450bb6f49ad57be2caae
I20251025 08:02:30.068516 16372 ts_tablet_manager.cc:1950] T cfe9add2f8bf450bb6f49ad57be2caae P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:30.068658 16392 tablet_bootstrap.cc:492] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.068738 16392 ts_tablet_manager.cc:1403] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:30.069135 16392 raft_consensus.cc:359] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.069228 16392 raft_consensus.cc:385] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.069267 16392 raft_consensus.cc:740] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.069392 16392 consensus_queue.cc:260] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.069841 16392 ts_tablet_manager.cc:1434] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.070070 16392 tablet_bootstrap.cc:492] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.071125 16392 tablet_bootstrap.cc:654] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:30.071264 15049 connection.cc:441] server connection from 127.0.0.1:47274 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47274 (request call id 242) could send its response
I20251025 08:02:30.071979 16392 tablet_bootstrap.cc:492] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.072053 16392 ts_tablet_manager.cc:1403] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.072454 16392 raft_consensus.cc:359] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.072543 16392 raft_consensus.cc:385] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.072577 16392 raft_consensus.cc:740] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.072675 16392 consensus_queue.cc:260] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.072909 16392 ts_tablet_manager.cc:1434] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.073083 16392 tablet_bootstrap.cc:492] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.073652 16390 tablet_bootstrap.cc:492] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.073720 16390 ts_tablet_manager.cc:1403] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.001s
I20251025 08:02:30.073982 16392 tablet_bootstrap.cc:654] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.074110 16390 raft_consensus.cc:359] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.074223 16390 raft_consensus.cc:385] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.074259 16390 raft_consensus.cc:740] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.074359 16390 consensus_queue.cc:260] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.074595 16390 ts_tablet_manager.cc:1434] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.074739 16390 tablet_bootstrap.cc:492] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.075548 16390 tablet_bootstrap.cc:654] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.075971 16392 tablet_bootstrap.cc:492] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.076037 16392 ts_tablet_manager.cc:1403] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:30.076464 16390 tablet_bootstrap.cc:492] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.076471 16392 raft_consensus.cc:359] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.076534 16390 ts_tablet_manager.cc:1403] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.076550 16392 raft_consensus.cc:385] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.076581 16392 raft_consensus.cc:740] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.076696 16392 consensus_queue.cc:260] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.076934 16392 ts_tablet_manager.cc:1434] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.077090 16392 tablet_bootstrap.cc:492] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.077662 16391 tablet_bootstrap.cc:492] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.077729 16391 ts_tablet_manager.cc:1403] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.002s
I20251025 08:02:30.077947 16392 tablet_bootstrap.cc:654] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.078095 16391 raft_consensus.cc:359] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.078111 16390 raft_consensus.cc:359] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.078168 16391 raft_consensus.cc:385] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.078217 16391 raft_consensus.cc:740] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.078305 16391 consensus_queue.cc:260] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.078508 16391 ts_tablet_manager.cc:1434] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.078665 16391 tablet_bootstrap.cc:492] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.079607 16391 tablet_bootstrap.cc:654] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.079704 16390 raft_consensus.cc:385] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.079753 16390 raft_consensus.cc:740] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.079845 16390 consensus_queue.cc:260] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.080076 16390 ts_tablet_manager.cc:1434] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:30.080217 16390 tablet_bootstrap.cc:492] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.081041 16390 tablet_bootstrap.cc:654] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.082438 16390 tablet_bootstrap.cc:492] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.082505 16390 ts_tablet_manager.cc:1403] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:30.083191 16390 raft_consensus.cc:359] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.083278 16390 raft_consensus.cc:385] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.083307 16390 raft_consensus.cc:740] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.083420 16390 consensus_queue.cc:260] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.085644 16390 ts_tablet_manager.cc:1434] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:30.085808 16390 tablet_bootstrap.cc:492] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.087067 16390 tablet_bootstrap.cc:654] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.093163 16392 tablet_bootstrap.cc:492] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.093246 16392 ts_tablet_manager.cc:1403] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20251025 08:02:30.093389 16391 tablet_bootstrap.cc:492] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.093447 16391 ts_tablet_manager.cc:1403] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:30.093521 16390 tablet_bootstrap.cc:492] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.093600 16390 ts_tablet_manager.cc:1403] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251025 08:02:30.093632 16392 raft_consensus.cc:359] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.093713 16392 raft_consensus.cc:385] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.093742 16392 raft_consensus.cc:740] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.093847 16392 consensus_queue.cc:260] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.094105 16392 ts_tablet_manager.cc:1434] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.094734 16391 raft_consensus.cc:359] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.095279 16392 tablet_bootstrap.cc:492] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.095885 16390 raft_consensus.cc:359] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.095985 16390 raft_consensus.cc:385] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.096010 16390 raft_consensus.cc:740] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.096122 16392 tablet_bootstrap.cc:654] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.096117 16390 consensus_queue.cc:260] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.096539 16391 raft_consensus.cc:385] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.096630 16391 raft_consensus.cc:740] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.099285 16391 consensus_queue.cc:260] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.099475 16391 ts_tablet_manager.cc:1434] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:30.099615 16391 tablet_bootstrap.cc:492] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.100581 16390 ts_tablet_manager.cc:1434] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20251025 08:02:30.100759 16390 tablet_bootstrap.cc:492] T 3c119ac81d35496cad2630c19f15ea21 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.101613 16391 tablet_bootstrap.cc:654] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.102725 16392 tablet_bootstrap.cc:492] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.102795 16392 ts_tablet_manager.cc:1403] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251025 08:02:30.103171 16392 raft_consensus.cc:359] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.103262 16392 raft_consensus.cc:385] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.103291 16392 raft_consensus.cc:740] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.103384 16392 consensus_queue.cc:260] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.103641 16392 ts_tablet_manager.cc:1434] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.103781 16392 tablet_bootstrap.cc:492] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.104091 16390 tablet_bootstrap.cc:654] T 3c119ac81d35496cad2630c19f15ea21 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.104678 16392 tablet_bootstrap.cc:654] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.109202 16391 tablet_bootstrap.cc:492] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.109275 16391 ts_tablet_manager.cc:1403] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:30.109611 16391 raft_consensus.cc:359] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.109699 16391 raft_consensus.cc:385] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.109732 16391 raft_consensus.cc:740] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.109838 16391 consensus_queue.cc:260] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.110116 16391 ts_tablet_manager.cc:1434] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.110123 15642 raft_consensus.cc:493] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.110213 15642 raft_consensus.cc:515] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.110283 16392 tablet_bootstrap.cc:492] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.110343 16392 ts_tablet_manager.cc:1403] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251025 08:02:30.110512 15642 leader_election.cc:290] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.110731 16392 raft_consensus.cc:359] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.110812 16392 raft_consensus.cc:385] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.110841 16392 raft_consensus.cc:740] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.110900 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3379087113041beba7ddbc6596c3b0a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.111148 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3379087113041beba7ddbc6596c3b0a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.111164 16392 consensus_queue.cc:260] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:30.111227 15049 leader_election.cc:343] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:30.111922 15048 leader_election.cc:343] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.111975 15048 leader_election.cc:304] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.112843 15642 raft_consensus.cc:2749] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.114202 16391 tablet_bootstrap.cc:492] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.114259 16392 ts_tablet_manager.cc:1434] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:30.114405 16392 tablet_bootstrap.cc:492] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.115235 16392 tablet_bootstrap.cc:654] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.116159 16392 tablet_bootstrap.cc:492] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.116241 16392 ts_tablet_manager.cc:1403] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.117044 16392 raft_consensus.cc:359] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.117141 16392 raft_consensus.cc:385] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.117172 16392 raft_consensus.cc:740] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.117280 16392 consensus_queue.cc:260] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.117672 16392 ts_tablet_manager.cc:1434] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.118932 16392 tablet_bootstrap.cc:492] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.119042 16391 tablet_bootstrap.cc:654] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.119671 15642 raft_consensus.cc:493] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.119750 15642 raft_consensus.cc:515] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.119892 16392 tablet_bootstrap.cc:654] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.120061 15642 leader_election.cc:290] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.120273 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "077ed236d1064a4d9a855bafabe0cdd7" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.120361 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "077ed236d1064a4d9a855bafabe0cdd7" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.120558 15048 leader_election.cc:343] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:30.120635 15049 leader_election.cc:343] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.120702 15049 leader_election.cc:304] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.120850 15642 raft_consensus.cc:2749] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.121160 16392 tablet_bootstrap.cc:492] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.121225 16392 ts_tablet_manager.cc:1403] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.121838 16392 raft_consensus.cc:359] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.121922 16392 raft_consensus.cc:385] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.121956 16392 raft_consensus.cc:740] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.122059 16392 consensus_queue.cc:260] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.122504 16392 ts_tablet_manager.cc:1434] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.122781 16392 tablet_bootstrap.cc:492] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.123608 16392 tablet_bootstrap.cc:654] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.124334 16391 tablet_bootstrap.cc:492] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.124395 16391 ts_tablet_manager.cc:1403] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20251025 08:02:30.124660 16391 raft_consensus.cc:359] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.124715 16391 raft_consensus.cc:385] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.124733 16391 raft_consensus.cc:740] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.124828 16391 consensus_queue.cc:260] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.125036 16391 ts_tablet_manager.cc:1434] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.125188 16391 tablet_bootstrap.cc:492] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.125955 15909 raft_consensus.cc:493] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.126044 15909 raft_consensus.cc:515] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.126134 16391 tablet_bootstrap.cc:654] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.126374 15909 leader_election.cc:290] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:30.126791 16390 tablet_bootstrap.cc:492] T 3c119ac81d35496cad2630c19f15ea21 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.126861 16390 ts_tablet_manager.cc:1403] T 3c119ac81d35496cad2630c19f15ea21 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20251025 08:02:30.127367 16390 raft_consensus.cc:359] T 3c119ac81d35496cad2630c19f15ea21 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.127436 16390 raft_consensus.cc:385] T 3c119ac81d35496cad2630c19f15ea21 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.127467 16390 raft_consensus.cc:740] T 3c119ac81d35496cad2630c19f15ea21 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.127559 16390 consensus_queue.cc:260] T 3c119ac81d35496cad2630c19f15ea21 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.127825 16390 ts_tablet_manager.cc:1434] T 3c119ac81d35496cad2630c19f15ea21 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.127967 16390 tablet_bootstrap.cc:492] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.128839 16390 tablet_bootstrap.cc:654] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.129374 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e762c440cb0947deb7e6a4186deebdc1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.129473 14974 raft_consensus.cc:2468] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.129737 15183 leader_election.cc:304] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.130136 15909 raft_consensus.cc:2804] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.130208 15909 raft_consensus.cc:493] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.130245 15909 raft_consensus.cc:3060] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:30.130874 15185 leader_election.cc:343] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: e762c440cb0947deb7e6a4186deebdc1
I20251025 08:02:30.131201 15909 raft_consensus.cc:515] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.131484 15909 leader_election.cc:290] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:30.131737 16391 tablet_bootstrap.cc:492] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.131728 15642 raft_consensus.cc:493] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.131796 16391 ts_tablet_manager.cc:1403] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20251025 08:02:30.131793 15642 raft_consensus.cc:515] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.132079 15642 leader_election.cc:290] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.132503 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e762c440cb0947deb7e6a4186deebdc1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.132592 14979 raft_consensus.cc:3060] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.132581 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb4faadd4fc146a5af032ce815bd6cc4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.132844 15049 leader_election.cc:343] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.133320 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb4faadd4fc146a5af032ce815bd6cc4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.133462 14979 raft_consensus.cc:2468] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
W20251025 08:02:30.133590 15048 leader_election.cc:343] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.133648 15048 leader_election.cc:304] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.133755 15497 raft_consensus.cc:493] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.133795 15642 raft_consensus.cc:2749] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.133836 15497 raft_consensus.cc:515] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.134130 15497 leader_election.cc:290] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.134366 15183 leader_election.cc:304] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.134415 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d162f3ee21bd40ce9a9c74b7863a3878" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:30.134450 15185 leader_election.cc:343] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: e762c440cb0947deb7e6a4186deebdc1
I20251025 08:02:30.134481 16390 tablet_bootstrap.cc:492] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.134544 16390 ts_tablet_manager.cc:1403] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20251025 08:02:30.132153 16391 raft_consensus.cc:359] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.134624 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d162f3ee21bd40ce9a9c74b7863a3878" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.134671 16391 raft_consensus.cc:385] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.134706 16391 raft_consensus.cc:740] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.134805 16391 consensus_queue.cc:260] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:30.134909 15048 leader_election.cc:343] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.134953 16390 raft_consensus.cc:359] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.135040 15909 raft_consensus.cc:2804] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.135040 16390 raft_consensus.cc:385] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.135131 16390 raft_consensus.cc:740] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.135142 15909 raft_consensus.cc:697] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.135232 16390 consensus_queue.cc:260] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.135252 15909 consensus_queue.cc:237] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.135504 16390 ts_tablet_manager.cc:1434] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.135648 16390 tablet_bootstrap.cc:492] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
W20251025 08:02:30.135771 15049 leader_election.cc:343] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.135823 15049 leader_election.cc:304] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.136195 15497 raft_consensus.cc:2749] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.136454 16391 ts_tablet_manager.cc:1434] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s
I20251025 08:02:30.136629 16390 tablet_bootstrap.cc:654] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.136788 16391 tablet_bootstrap.cc:492] T 1dd5a31508964130828ee0367a3317ed P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.137826 16391 tablet_bootstrap.cc:654] T 1dd5a31508964130828ee0367a3317ed P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.141865 16392 tablet_bootstrap.cc:492] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.141942 16392 ts_tablet_manager.cc:1403] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.000s
I20251025 08:02:30.142433 16392 raft_consensus.cc:359] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.142536 16392 raft_consensus.cc:385] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.142572 16392 raft_consensus.cc:740] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.142686 16392 consensus_queue.cc:260] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.142902 16392 ts_tablet_manager.cc:1434] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.143622 16390 tablet_bootstrap.cc:492] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.143698 16390 ts_tablet_manager.cc:1403] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251025 08:02:30.144119 16390 raft_consensus.cc:359] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.144208 16390 raft_consensus.cc:385] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.144238 16390 raft_consensus.cc:740] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.144344 16390 consensus_queue.cc:260] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.144631 16390 ts_tablet_manager.cc:1434] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.145084 16390 tablet_bootstrap.cc:492] T 077ed236d1064a4d9a855bafabe0cdd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.145548 15864 raft_consensus.cc:493] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.145622 15864 raft_consensus.cc:515] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.145912 16390 tablet_bootstrap.cc:654] T 077ed236d1064a4d9a855bafabe0cdd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.145931 15864 leader_election.cc:290] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.146586 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbae08a3a1c34dfda60b1985346e7761" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.146677 15111 raft_consensus.cc:2468] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.146883 16392 tablet_bootstrap.cc:492] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.146958 14915 leader_election.cc:304] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:30.148089 15864 raft_consensus.cc:2804] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.148146 15864 raft_consensus.cc:493] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.148183 15864 raft_consensus.cc:3060] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.148648 16391 tablet_bootstrap.cc:492] T 1dd5a31508964130828ee0367a3317ed P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.148715 16391 ts_tablet_manager.cc:1403] T 1dd5a31508964130828ee0367a3317ed P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20251025 08:02:30.149113 15864 raft_consensus.cc:515] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.149128 16391 raft_consensus.cc:359] T 1dd5a31508964130828ee0367a3317ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.149214 16391 raft_consensus.cc:385] T 1dd5a31508964130828ee0367a3317ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.149241 16391 raft_consensus.cc:740] T 1dd5a31508964130828ee0367a3317ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.149335 16391 consensus_queue.cc:260] T 1dd5a31508964130828ee0367a3317ed P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.149431 15864 leader_election.cc:290] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.149577 16391 ts_tablet_manager.cc:1434] T 1dd5a31508964130828ee0367a3317ed P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.149742 16391 tablet_bootstrap.cc:492] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.150444 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbae08a3a1c34dfda60b1985346e7761" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.150552 15239 raft_consensus.cc:2468] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.150717 16391 tablet_bootstrap.cc:654] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.150907 16390 tablet_bootstrap.cc:492] T 077ed236d1064a4d9a855bafabe0cdd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.150980 16390 ts_tablet_manager.cc:1403] T 077ed236d1064a4d9a855bafabe0cdd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20251025 08:02:30.151458 16390 raft_consensus.cc:359] T 077ed236d1064a4d9a855bafabe0cdd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.151543 16390 raft_consensus.cc:385] T 077ed236d1064a4d9a855bafabe0cdd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.151568 16390 raft_consensus.cc:740] T 077ed236d1064a4d9a855bafabe0cdd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.151650 16390 consensus_queue.cc:260] T 077ed236d1064a4d9a855bafabe0cdd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.151872 16390 ts_tablet_manager.cc:1434] T 077ed236d1064a4d9a855bafabe0cdd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.152005 16390 tablet_bootstrap.cc:492] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.152719 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbae08a3a1c34dfda60b1985346e7761" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.152809 15239 raft_consensus.cc:3060] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.153698 15239 raft_consensus.cc:2468] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.154635 16390 tablet_bootstrap.cc:654] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.154970 14914 leader_election.cc:304] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.155117 15864 raft_consensus.cc:2804] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.155182 15864 raft_consensus.cc:697] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.155299 15864 consensus_queue.cc:237] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.156131 16391 tablet_bootstrap.cc:492] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.156208 16391 ts_tablet_manager.cc:1403] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20251025 08:02:30.156543 16391 raft_consensus.cc:359] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.156612 16391 raft_consensus.cc:385] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.156636 16391 raft_consensus.cc:740] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.156728 16391 consensus_queue.cc:260] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.156936 16391 ts_tablet_manager.cc:1434] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.157068 16391 tablet_bootstrap.cc:492] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.157214 16392 tablet_bootstrap.cc:654] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.157331 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fbae08a3a1c34dfda60b1985346e7761" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.157426 15111 raft_consensus.cc:3060] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.158066 16391 tablet_bootstrap.cc:654] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.158491 15111 raft_consensus.cc:2468] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.159286 15497 raft_consensus.cc:493] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.159358 15497 raft_consensus.cc:515] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.159617 15497 leader_election.cc:290] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.160024 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09fccf0770604812940dd63106f7d993" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.160406 15049 leader_election.cc:343] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.161497 16390 tablet_bootstrap.cc:492] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.161581 16390 ts_tablet_manager.cc:1403] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:30.161942 16390 raft_consensus.cc:359] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.162029 16390 raft_consensus.cc:385] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.162065 16390 raft_consensus.cc:740] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.162204 16390 consensus_queue.cc:260] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.162436 16390 ts_tablet_manager.cc:1434] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.162597 16390 tablet_bootstrap.cc:492] T fb4faadd4fc146a5af032ce815bd6cc4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.163403 16390 tablet_bootstrap.cc:654] T fb4faadd4fc146a5af032ce815bd6cc4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.164088 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09fccf0770604812940dd63106f7d993" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:30.164392 15048 leader_election.cc:343] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.164454 15048 leader_election.cc:304] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.164700 15497 raft_consensus.cc:2749] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.166853 16391 tablet_bootstrap.cc:492] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.166944 16391 ts_tablet_manager.cc:1403] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20251025 08:02:30.167344 16391 raft_consensus.cc:359] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.167433 16391 raft_consensus.cc:385] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.167465 16391 raft_consensus.cc:740] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.167551 16391 consensus_queue.cc:260] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.167760 16391 ts_tablet_manager.cc:1434] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.168402 16391 tablet_bootstrap.cc:492] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.169234 16391 tablet_bootstrap.cc:654] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.171182 16390 tablet_bootstrap.cc:492] T fb4faadd4fc146a5af032ce815bd6cc4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.171267 16390 ts_tablet_manager.cc:1403] T fb4faadd4fc146a5af032ce815bd6cc4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:30.171705 16390 raft_consensus.cc:359] T fb4faadd4fc146a5af032ce815bd6cc4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.171787 16390 raft_consensus.cc:385] T fb4faadd4fc146a5af032ce815bd6cc4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.171811 16390 raft_consensus.cc:740] T fb4faadd4fc146a5af032ce815bd6cc4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.171900 16390 consensus_queue.cc:260] T fb4faadd4fc146a5af032ce815bd6cc4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.172106 16390 ts_tablet_manager.cc:1434] T fb4faadd4fc146a5af032ce815bd6cc4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.172248 16390 tablet_bootstrap.cc:492] T 0488062b11994f03a1af2e52db492977 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.173002 16390 tablet_bootstrap.cc:654] T 0488062b11994f03a1af2e52db492977 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.176262 15374 raft_consensus.cc:493] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.176337 15374 raft_consensus.cc:515] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.176667 15374 leader_election.cc:290] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.176898 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cc676245d2984363b4af1e817b444c3d" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.177018 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cc676245d2984363b4af1e817b444c3d" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.177392 14914 leader_election.cc:304] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.177697 15374 raft_consensus.cc:2749] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.178753 16392 tablet_bootstrap.cc:492] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.178833 16392 ts_tablet_manager.cc:1403] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.000s
I20251025 08:02:30.179208 16392 raft_consensus.cc:359] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.179365 16392 raft_consensus.cc:385] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.179404 16392 raft_consensus.cc:740] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.179553 16392 consensus_queue.cc:260] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.181178 16390 tablet_bootstrap.cc:492] T 0488062b11994f03a1af2e52db492977 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.181257 16390 ts_tablet_manager.cc:1403] T 0488062b11994f03a1af2e52db492977 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:30.181597 16390 raft_consensus.cc:359] T 0488062b11994f03a1af2e52db492977 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.181669 16390 raft_consensus.cc:385] T 0488062b11994f03a1af2e52db492977 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.181694 16390 raft_consensus.cc:740] T 0488062b11994f03a1af2e52db492977 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.181780 16390 consensus_queue.cc:260] T 0488062b11994f03a1af2e52db492977 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.181988 16390 ts_tablet_manager.cc:1434] T 0488062b11994f03a1af2e52db492977 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.182123 16390 tablet_bootstrap.cc:492] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.184306 16391 tablet_bootstrap.cc:492] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.184374 16391 ts_tablet_manager.cc:1403] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.002s
I20251025 08:02:30.184717 16391 raft_consensus.cc:359] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.184794 16391 raft_consensus.cc:385] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.184818 16391 raft_consensus.cc:740] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.185014 16391 consensus_queue.cc:260] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.185249 16391 ts_tablet_manager.cc:1434] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.185453 16392 ts_tablet_manager.cc:1434] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20251025 08:02:30.186546 16391 tablet_bootstrap.cc:492] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.187422 16391 tablet_bootstrap.cc:654] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.188704 16390 tablet_bootstrap.cc:654] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.189718 16391 tablet_bootstrap.cc:492] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.189806 16391 ts_tablet_manager.cc:1403] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:30.190301 16391 raft_consensus.cc:359] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.190395 16391 raft_consensus.cc:385] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.190433 16391 raft_consensus.cc:740] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.190575 16391 consensus_queue.cc:260] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.190889 15909 raft_consensus.cc:493] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.190984 15909 raft_consensus.cc:515] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.191051 16391 ts_tablet_manager.cc:1434] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.191220 16391 tablet_bootstrap.cc:492] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.191308 15909 leader_election.cc:290] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.191540 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "399d6b0459864b1586aa99948c56baea" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.191644 15111 raft_consensus.cc:2468] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.191903 15909 raft_consensus.cc:493] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.191936 16572 raft_consensus.cc:493] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.191989 15909 raft_consensus.cc:515] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.192023 16572 raft_consensus.cc:515] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.192318 15909 leader_election.cc:290] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.192363 16572 leader_election.cc:290] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.192476 15185 leader_election.cc:304] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.192601 16572 raft_consensus.cc:2804] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.192662 16572 raft_consensus.cc:493] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.192706 16572 raft_consensus.cc:3060] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.192755 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42e8a5ee7d6a42aaaf95c33617abff3f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.192845 15111 raft_consensus.cc:2468] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.193018 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bb463fc8b104a87b5503bfc2467a23e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.193079 15185 leader_election.cc:304] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.193100 15110 raft_consensus.cc:2468] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.193212 15909 raft_consensus.cc:2804] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.193255 15909 raft_consensus.cc:493] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.193301 15909 raft_consensus.cc:3060] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.193332 15185 leader_election.cc:304] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.193665 16572 raft_consensus.cc:515] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.193804 16391 tablet_bootstrap.cc:654] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.193989 16572 leader_election.cc:290] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.194108 16572 raft_consensus.cc:2804] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.194092 15909 raft_consensus.cc:515] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.194154 16572 raft_consensus.cc:493] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.194226 16572 raft_consensus.cc:3060] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.194378 15909 leader_election.cc:290] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.194706 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "399d6b0459864b1586aa99948c56baea" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.194798 15110 raft_consensus.cc:3060] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.194972 16572 raft_consensus.cc:515] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.195251 16572 leader_election.cc:290] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.195676 15110 raft_consensus.cc:2468] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.195833 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bb463fc8b104a87b5503bfc2467a23e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.195833 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42e8a5ee7d6a42aaaf95c33617abff3f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.195884 15185 leader_election.cc:304] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.195931 15114 raft_consensus.cc:3060] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.195931 15111 raft_consensus.cc:3060] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.196739 15111 raft_consensus.cc:2468] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.196802 15114 raft_consensus.cc:2468] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.196962 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "399d6b0459864b1586aa99948c56baea" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.197072 14974 raft_consensus.cc:2468] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.197084 15185 leader_election.cc:304] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.197167 16570 raft_consensus.cc:2804] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.197230 15185 leader_election.cc:304] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.197268 16570 raft_consensus.cc:697] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.197333 16199 raft_consensus.cc:2804] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.197402 16199 raft_consensus.cc:697] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.197381 16570 consensus_queue.cc:237] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.197500 16199 consensus_queue.cc:237] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.198021 16570 raft_consensus.cc:2804] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.198067 16391 tablet_bootstrap.cc:492] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.198105 16570 raft_consensus.cc:697] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.198134 16391 ts_tablet_manager.cc:1403] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251025 08:02:30.198238 16570 consensus_queue.cc:237] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.198570 16391 raft_consensus.cc:359] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.198659 16391 raft_consensus.cc:385] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.198700 16391 raft_consensus.cc:740] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.198804 16391 consensus_queue.cc:260] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.199241 16391 ts_tablet_manager.cc:1434] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.199923 16390 tablet_bootstrap.cc:492] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.200006 16390 ts_tablet_manager.cc:1403] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20251025 08:02:30.200371 16390 raft_consensus.cc:359] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.200444 16390 raft_consensus.cc:385] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.200471 16390 raft_consensus.cc:740] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.200564 16390 consensus_queue.cc:260] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.200814 16391 tablet_bootstrap.cc:492] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.200970 16390 ts_tablet_manager.cc:1434] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.201107 16390 tablet_bootstrap.cc:492] T 327c7f7679dd469cb6f5a9b346c40671 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.201661 16391 tablet_bootstrap.cc:654] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.202082 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42e8a5ee7d6a42aaaf95c33617abff3f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.202278 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "399d6b0459864b1586aa99948c56baea" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.202348 14978 raft_consensus.cc:3060] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.203003 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42e8a5ee7d6a42aaaf95c33617abff3f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.203258 14978 raft_consensus.cc:2468] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.203313 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bb463fc8b104a87b5503bfc2467a23e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.203239 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4bb463fc8b104a87b5503bfc2467a23e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.203401 14975 raft_consensus.cc:3060] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.203898 16390 tablet_bootstrap.cc:654] T 327c7f7679dd469cb6f5a9b346c40671 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.204267 14975 raft_consensus.cc:2468] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.205020 16391 tablet_bootstrap.cc:492] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.205145 16391 ts_tablet_manager.cc:1403] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:30.205612 16391 raft_consensus.cc:359] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.205775 16391 raft_consensus.cc:385] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.205850 16391 raft_consensus.cc:740] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.206053 16391 consensus_queue.cc:260] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.206565 16391 ts_tablet_manager.cc:1434] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.206774 16391 tablet_bootstrap.cc:492] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.207511 16391 tablet_bootstrap.cc:654] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.208678 16390 tablet_bootstrap.cc:492] T 327c7f7679dd469cb6f5a9b346c40671 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.208747 16390 ts_tablet_manager.cc:1403] T 327c7f7679dd469cb6f5a9b346c40671 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251025 08:02:30.209102 16390 raft_consensus.cc:359] T 327c7f7679dd469cb6f5a9b346c40671 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.209177 16390 raft_consensus.cc:385] T 327c7f7679dd469cb6f5a9b346c40671 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.209204 16390 raft_consensus.cc:740] T 327c7f7679dd469cb6f5a9b346c40671 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.209306 16390 consensus_queue.cc:260] T 327c7f7679dd469cb6f5a9b346c40671 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.209548 16390 ts_tablet_manager.cc:1434] T 327c7f7679dd469cb6f5a9b346c40671 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.209684 16390 tablet_bootstrap.cc:492] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.210614 16390 tablet_bootstrap.cc:654] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:30.210804 15183 leader_election.cc:343] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:30.211056 15183 leader_election.cc:343] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.212492 14973 raft_consensus.cc:3060] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.213099 16391 tablet_bootstrap.cc:492] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.213176 16391 ts_tablet_manager.cc:1403] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:30.214684 16572 raft_consensus.cc:493] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.214761 16572 raft_consensus.cc:515] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.215049 16572 leader_election.cc:290] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.216238 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd5a31508964130828ee0367a3317ed" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.216339 15114 raft_consensus.cc:2468] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.216760 16391 raft_consensus.cc:359] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.216760 15185 leader_election.cc:304] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.216956 16572 raft_consensus.cc:2804] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.217006 16572 raft_consensus.cc:493] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.217052 16572 raft_consensus.cc:3060] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.217861 16572 raft_consensus.cc:515] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.218168 16572 leader_election.cc:290] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.218977 16392 tablet_bootstrap.cc:492] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.219660 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd5a31508964130828ee0367a3317ed" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.219755 15114 raft_consensus.cc:3060] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.220383 15114 raft_consensus.cc:2468] T 1dd5a31508964130828ee0367a3317ed P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.220633 15185 leader_election.cc:304] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.221359 16199 raft_consensus.cc:493] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.221433 16199 raft_consensus.cc:515] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.221509 16392 tablet_bootstrap.cc:654] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.221740 16199 leader_election.cc:290] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.221812 16199 raft_consensus.cc:2804] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.221865 16199 raft_consensus.cc:697] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.221961 16199 consensus_queue.cc:237] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.222594 16582 raft_consensus.cc:493] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.222659 16582 raft_consensus.cc:515] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.222992 16582 leader_election.cc:290] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.223266 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6cedb44483cf4f62acf52b90b6708dfb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.223522 15049 leader_election.cc:343] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.224231 16392 tablet_bootstrap.cc:492] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.224300 16392 ts_tablet_manager.cc:1403] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:30.224694 16392 raft_consensus.cc:359] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.224781 16392 raft_consensus.cc:385] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.224807 16392 raft_consensus.cc:740] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.224895 16392 consensus_queue.cc:260] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.225812 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5cd481a98514f16bed3fb0bf5003526" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.225907 15114 raft_consensus.cc:2468] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.218267 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd5a31508964130828ee0367a3317ed" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.218986 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dd5a31508964130828ee0367a3317ed" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.226500 15185 leader_election.cc:304] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.222518 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5cd481a98514f16bed3fb0bf5003526" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.223389 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6cedb44483cf4f62acf52b90b6708dfb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.226722 16572 raft_consensus.cc:2804] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.226774 16572 raft_consensus.cc:493] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.226810 16572 raft_consensus.cc:3060] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.226819 16392 ts_tablet_manager.cc:1434] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.226997 16392 tablet_bootstrap.cc:492] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.227653 16572 raft_consensus.cc:515] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.227955 16572 leader_election.cc:290] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.227994 16392 tablet_bootstrap.cc:654] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.228699 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5cd481a98514f16bed3fb0bf5003526" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.228782 15114 raft_consensus.cc:3060] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:30.228822 15183 leader_election.cc:343] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:30.229383 15048 leader_election.cc:343] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.229439 15048 leader_election.cc:304] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.229545 15114 raft_consensus.cc:2468] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.226445 16391 raft_consensus.cc:385] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.226491 14975 raft_consensus.cc:2468] T 1dd5a31508964130828ee0367a3317ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.229620 16391 raft_consensus.cc:740] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.229107 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5cd481a98514f16bed3fb0bf5003526" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.229897 16582 raft_consensus.cc:2749] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:30.230052 15183 leader_election.cc:343] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.230185 16391 consensus_queue.cc:260] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.230350 15185 leader_election.cc:304] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:30.230454 16391 ts_tablet_manager.cc:1434] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.017s user 0.000s sys 0.001s
I20251025 08:02:30.230515 16572 raft_consensus.cc:2804] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.230600 16391 tablet_bootstrap.cc:492] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.231408 16391 tablet_bootstrap.cc:654] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.232048 16572 raft_consensus.cc:697] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.232167 16572 consensus_queue.cc:237] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.236238 16392 tablet_bootstrap.cc:492] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.236316 16392 ts_tablet_manager.cc:1403] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251025 08:02:30.236758 16392 raft_consensus.cc:359] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.236850 16392 raft_consensus.cc:385] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.236882 16392 raft_consensus.cc:740] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.236980 16392 consensus_queue.cc:260] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.237145 15374 raft_consensus.cc:493] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.237219 15374 raft_consensus.cc:515] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.237538 15374 leader_election.cc:290] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.237877 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0769fe05ef364f8e80786bded1ec44cf" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.237988 15114 raft_consensus.cc:2393] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:30.238494 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0769fe05ef364f8e80786bded1ec44cf" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.238843 15374 raft_consensus.cc:493] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.238888 14914 leader_election.cc:304] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.238938 16391 tablet_bootstrap.cc:492] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.238914 15374 raft_consensus.cc:515] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.239012 15864 raft_consensus.cc:3060] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.239267 15374 leader_election.cc:290] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.239347 16392 ts_tablet_manager.cc:1434] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:30.239511 16392 tablet_bootstrap.cc:492] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.239598 16390 tablet_bootstrap.cc:492] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.239670 16390 ts_tablet_manager.cc:1403] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.000s
I20251025 08:02:30.239876 15864 raft_consensus.cc:2749] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.240135 16390 raft_consensus.cc:359] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.240213 16390 raft_consensus.cc:385] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.240250 16390 raft_consensus.cc:740] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.240350 16390 consensus_queue.cc:260] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.240520 16391 ts_tablet_manager.cc:1403] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:30.240587 16390 ts_tablet_manager.cc:1434] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.240968 16391 raft_consensus.cc:359] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.241061 16391 raft_consensus.cc:385] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.241096 16391 raft_consensus.cc:740] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.241205 16391 consensus_queue.cc:260] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.241511 16391 ts_tablet_manager.cc:1434] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.241768 16390 tablet_bootstrap.cc:492] T a547fb54ddbf4053b5be20ee6c4fc6b0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.242012 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "077ed236d1064a4d9a855bafabe0cdd7" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.242103 15239 raft_consensus.cc:2468] T 077ed236d1064a4d9a855bafabe0cdd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.242633 16390 tablet_bootstrap.cc:654] T a547fb54ddbf4053b5be20ee6c4fc6b0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.243080 14914 leader_election.cc:304] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.243278 15864 raft_consensus.cc:2804] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.243330 15864 raft_consensus.cc:493] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.243366 15864 raft_consensus.cc:3060] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.244226 15864 raft_consensus.cc:515] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.244529 15864 leader_election.cc:290] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.246115 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "077ed236d1064a4d9a855bafabe0cdd7" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.246234 15239 raft_consensus.cc:3060] T 077ed236d1064a4d9a855bafabe0cdd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.247059 15239 raft_consensus.cc:2468] T 077ed236d1064a4d9a855bafabe0cdd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.240442 16392 tablet_bootstrap.cc:654] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.240815 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "077ed236d1064a4d9a855bafabe0cdd7" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.248181 15114 raft_consensus.cc:2468] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.247347 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "077ed236d1064a4d9a855bafabe0cdd7" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.248420 15111 raft_consensus.cc:3060] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.249290 15111 raft_consensus.cc:2468] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.249454 15380 raft_consensus.cc:493] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.249523 15380 raft_consensus.cc:515] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.249835 15380 leader_election.cc:290] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.250006 15380 raft_consensus.cc:493] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.250083 15380 raft_consensus.cc:515] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.250437 15380 leader_election.cc:290] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.250564 16390 tablet_bootstrap.cc:492] T a547fb54ddbf4053b5be20ee6c4fc6b0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.250645 16390 ts_tablet_manager.cc:1403] T a547fb54ddbf4053b5be20ee6c4fc6b0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:30.250629 14914 leader_election.cc:304] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.250865 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf34039d909949af9357299bf8204891" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.251001 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f814b8ab1c9747e4b7da69f0ef4f2eb4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.251055 16390 raft_consensus.cc:359] T a547fb54ddbf4053b5be20ee6c4fc6b0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.251149 16390 raft_consensus.cc:385] T a547fb54ddbf4053b5be20ee6c4fc6b0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.251188 16390 raft_consensus.cc:740] T a547fb54ddbf4053b5be20ee6c4fc6b0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
W20251025 08:02:30.251299 15049 leader_election.cc:343] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.251312 16390 consensus_queue.cc:260] T a547fb54ddbf4053b5be20ee6c4fc6b0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:30.251420 15049 leader_election.cc:343] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.251550 16390 ts_tablet_manager.cc:1434] T a547fb54ddbf4053b5be20ee6c4fc6b0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.251706 16390 tablet_bootstrap.cc:492] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.252605 16390 tablet_bootstrap.cc:654] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.253284 15864 raft_consensus.cc:2804] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.253386 15864 raft_consensus.cc:697] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.253497 15864 consensus_queue.cc:237] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.254333 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf34039d909949af9357299bf8204891" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.254500 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f814b8ab1c9747e4b7da69f0ef4f2eb4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.254515 16391 tablet_bootstrap.cc:492] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.255811 16391 tablet_bootstrap.cc:654] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.256119 16392 tablet_bootstrap.cc:492] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.256258 16392 ts_tablet_manager.cc:1403] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20251025 08:02:30.256780 16392 raft_consensus.cc:359] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.256937 16392 raft_consensus.cc:385] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.257015 16392 raft_consensus.cc:740] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.257134 16391 tablet_bootstrap.cc:492] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
W20251025 08:02:30.256261 15048 leader_election.cc:343] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.257223 16391 ts_tablet_manager.cc:1403] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:30.257234 15048 leader_election.cc:304] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:30.257416 15048 leader_election.cc:343] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.257462 15048 leader_election.cc:304] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.257608 16391 raft_consensus.cc:359] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.257695 16391 raft_consensus.cc:385] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.257683 16582 raft_consensus.cc:2749] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.257740 16391 raft_consensus.cc:740] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.257791 16582 raft_consensus.cc:2749] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.257830 16391 consensus_queue.cc:260] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.257988 16392 consensus_queue.cc:260] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.258080 16391 ts_tablet_manager.cc:1434] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.258450 16391 tablet_bootstrap.cc:492] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.259574 16391 tablet_bootstrap.cc:654] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.259750 15380 raft_consensus.cc:493] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.259824 15380 raft_consensus.cc:515] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.260118 15380 leader_election.cc:290] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.260512 16392 ts_tablet_manager.cc:1434] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:30.260723 16392 tablet_bootstrap.cc:492] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.260856 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfdc6022cc5747439edcb8aa865b9437" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.260979 15240 raft_consensus.cc:2468] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.261288 15049 leader_election.cc:304] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.261512 15380 raft_consensus.cc:2804] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.261569 15380 raft_consensus.cc:493] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.261610 15380 raft_consensus.cc:3060] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.262553 15380 raft_consensus.cc:515] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.262831 16392 tablet_bootstrap.cc:654] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.262866 15380 leader_election.cc:290] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.263278 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfdc6022cc5747439edcb8aa865b9437" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.263368 15240 raft_consensus.cc:3060] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.264240 15240 raft_consensus.cc:2468] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.264561 15049 leader_election.cc:304] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.264755 15380 raft_consensus.cc:2804] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.264837 15380 raft_consensus.cc:697] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:30.264961 15380 consensus_queue.cc:237] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.266835 16390 tablet_bootstrap.cc:492] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.266904 16390 ts_tablet_manager.cc:1403] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:30.267159 16391 tablet_bootstrap.cc:492] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.267202 16582 raft_consensus.cc:493] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.267242 16391 ts_tablet_manager.cc:1403] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251025 08:02:30.267261 16582 raft_consensus.cc:515] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.267361 16390 raft_consensus.cc:359] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.267457 16390 raft_consensus.cc:385] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.267481 16390 raft_consensus.cc:740] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.267561 16582 leader_election.cc:290] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.267570 16390 consensus_queue.cc:260] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.267656 16391 raft_consensus.cc:359] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.267761 16391 raft_consensus.cc:385] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.267803 16390 ts_tablet_manager.cc:1434] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.267802 16391 raft_consensus.cc:740] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.267963 16390 tablet_bootstrap.cc:492] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.267926 16391 consensus_queue.cc:260] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.268210 16391 ts_tablet_manager.cc:1434] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.268260 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bb5b825be9a44d489151239947d471e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.268373 16391 tablet_bootstrap.cc:492] T 0488062b11994f03a1af2e52db492977 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:30.268594 15049 leader_election.cc:343] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.268759 16390 tablet_bootstrap.cc:654] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.269304 16391 tablet_bootstrap.cc:654] T 0488062b11994f03a1af2e52db492977 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.269639 16392 tablet_bootstrap.cc:492] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.269724 16392 ts_tablet_manager.cc:1403] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:30.270130 16392 raft_consensus.cc:359] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.270244 16392 raft_consensus.cc:385] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.270279 16392 raft_consensus.cc:740] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.270502 16392 consensus_queue.cc:260] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.270757 16392 ts_tablet_manager.cc:1434] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.270908 16392 tablet_bootstrap.cc:492] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.271145 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfdc6022cc5747439edcb8aa865b9437" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.271251 14978 raft_consensus.cc:2468] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.271392 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bfdc6022cc5747439edcb8aa865b9437" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.271467 14975 raft_consensus.cc:3060] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.272359 14975 raft_consensus.cc:2468] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.273805 16572 consensus_queue.cc:1048] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.274852 16392 tablet_bootstrap.cc:654] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.274992 16572 raft_consensus.cc:493] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.275063 16572 raft_consensus.cc:515] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.275375 16572 leader_election.cc:290] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.275873 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb3569ec2cdd4736b264b00abf1fa36a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.275964 15114 raft_consensus.cc:2468] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.276418 15185 leader_election.cc:304] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.276605 16391 tablet_bootstrap.cc:492] T 0488062b11994f03a1af2e52db492977 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.276676 16391 ts_tablet_manager.cc:1403] T 0488062b11994f03a1af2e52db492977 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251025 08:02:30.277040 16391 raft_consensus.cc:359] T 0488062b11994f03a1af2e52db492977 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.277112 16391 raft_consensus.cc:385] T 0488062b11994f03a1af2e52db492977 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.277135 16391 raft_consensus.cc:740] T 0488062b11994f03a1af2e52db492977 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.277233 16391 consensus_queue.cc:260] T 0488062b11994f03a1af2e52db492977 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.277559 16391 ts_tablet_manager.cc:1434] T 0488062b11994f03a1af2e52db492977 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.277685 16391 tablet_bootstrap.cc:492] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.278283 16572 raft_consensus.cc:2804] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.278335 16572 raft_consensus.cc:493] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.278373 16572 raft_consensus.cc:3060] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.278805 16391 tablet_bootstrap.cc:654] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.279245 16572 raft_consensus.cc:515] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.279515 16572 leader_election.cc:290] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.279846 16392 tablet_bootstrap.cc:492] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.279913 16392 ts_tablet_manager.cc:1403] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20251025 08:02:30.279984 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb3569ec2cdd4736b264b00abf1fa36a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.280093 15114 raft_consensus.cc:3060] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.280292 16392 raft_consensus.cc:359] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.280370 16392 raft_consensus.cc:385] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.280397 16392 raft_consensus.cc:740] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.280493 16392 consensus_queue.cc:260] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.280942 16390 tablet_bootstrap.cc:492] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.280987 16392 ts_tablet_manager.cc:1434] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.281013 16390 ts_tablet_manager.cc:1403] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
I20251025 08:02:30.281159 16392 tablet_bootstrap.cc:492] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.280973 15114 raft_consensus.cc:2468] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.281404 16390 raft_consensus.cc:359] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.281495 16390 raft_consensus.cc:385] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.281531 16390 raft_consensus.cc:740] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.281648 16390 consensus_queue.cc:260] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.281672 15185 leader_election.cc:304] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.281877 15384 raft_consensus.cc:2804] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.281898 16390 ts_tablet_manager.cc:1434] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.281950 15384 raft_consensus.cc:697] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.282050 16392 tablet_bootstrap.cc:654] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.282068 16390 tablet_bootstrap.cc:492] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.282065 15384 consensus_queue.cc:237] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.284224 16391 tablet_bootstrap.cc:492] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.284289 16391 ts_tablet_manager.cc:1403] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20251025 08:02:30.284484 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb3569ec2cdd4736b264b00abf1fa36a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.284584 14975 raft_consensus.cc:2468] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.284644 15374 raft_consensus.cc:493] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.284693 16391 raft_consensus.cc:359] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.284714 15374 raft_consensus.cc:515] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.284765 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb3569ec2cdd4736b264b00abf1fa36a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.284770 16391 raft_consensus.cc:385] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.284842 16391 raft_consensus.cc:740] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.284845 14978 raft_consensus.cc:3060] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.284970 16391 consensus_queue.cc:260] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.285012 15374 leader_election.cc:290] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.285732 14978 raft_consensus.cc:2468] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.286947 16390 tablet_bootstrap.cc:654] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.287227 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d993e2350f37492bb712d145d03e8afb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.287328 15240 raft_consensus.cc:2468] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.287645 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bb5b825be9a44d489151239947d471e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.287703 14914 leader_election.cc:304] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.287842 15864 raft_consensus.cc:2804] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.287881 15864 raft_consensus.cc:493] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.287917 15864 raft_consensus.cc:3060] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.288703 16391 ts_tablet_manager.cc:1434] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20251025 08:02:30.288743 15864 raft_consensus.cc:515] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.289024 15864 leader_election.cc:290] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.289098 16392 tablet_bootstrap.cc:492] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.289162 16392 ts_tablet_manager.cc:1403] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20251025 08:02:30.289361 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d993e2350f37492bb712d145d03e8afb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.289449 15240 raft_consensus.cc:3060] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.289556 16392 raft_consensus.cc:359] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.289641 16392 raft_consensus.cc:385] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.289669 16392 raft_consensus.cc:740] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.289757 16392 consensus_queue.cc:260] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.290114 16392 ts_tablet_manager.cc:1434] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.290294 16392 tablet_bootstrap.cc:492] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.290328 15240 raft_consensus.cc:2468] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.290593 14914 leader_election.cc:304] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.290804 15642 raft_consensus.cc:493] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.290875 15642 raft_consensus.cc:515] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.291172 15642 leader_election.cc:290] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.291677 16390 tablet_bootstrap.cc:492] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.291671 15864 raft_consensus.cc:2804] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.291749 16390 ts_tablet_manager.cc:1403] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.002s
I20251025 08:02:30.291751 15864 raft_consensus.cc:697] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.291864 15864 consensus_queue.cc:237] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.292122 16390 raft_consensus.cc:359] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.292233 16390 raft_consensus.cc:385] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.292268 16390 raft_consensus.cc:740] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.292380 16390 consensus_queue.cc:260] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.292459 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31c9e3906dac487e8585daa13d3fe4b1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.292557 15240 raft_consensus.cc:2468] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.292639 16390 ts_tablet_manager.cc:1434] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.292801 16390 tablet_bootstrap.cc:492] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.293506 16390 tablet_bootstrap.cc:654] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.291182 16392 tablet_bootstrap.cc:654] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.294377 15049 leader_election.cc:304] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.294719 15642 raft_consensus.cc:2804] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.294771 15642 raft_consensus.cc:493] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.294806 15642 raft_consensus.cc:3060] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.295703 15642 raft_consensus.cc:515] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.295990 15642 leader_election.cc:290] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.296816 16391 tablet_bootstrap.cc:492] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.296917 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31c9e3906dac487e8585daa13d3fe4b1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.297016 15240 raft_consensus.cc:3060] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:30.297555 15048 leader_election.cc:343] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.297626 15048 leader_election.cc:304] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.297792 16391 tablet_bootstrap.cc:654] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.297849 15240 raft_consensus.cc:2468] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.297909 16582 raft_consensus.cc:2749] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.298050 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d993e2350f37492bb712d145d03e8afb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.298135 15110 raft_consensus.cc:3060] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.298138 15049 leader_election.cc:304] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.298416 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31c9e3906dac487e8585daa13d3fe4b1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.298434 16582 raft_consensus.cc:2804] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.298503 16582 raft_consensus.cc:697] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:30.298499 14978 raft_consensus.cc:2468] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.298607 16582 consensus_queue.cc:237] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.298643 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "31c9e3906dac487e8585daa13d3fe4b1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.298717 14975 raft_consensus.cc:3060] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.299058 15110 raft_consensus.cc:2468] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.299270 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d993e2350f37492bb712d145d03e8afb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.299360 15114 raft_consensus.cc:2376] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1. Re-sending same reply.
I20251025 08:02:30.299435 16391 tablet_bootstrap.cc:492] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.299507 16391 ts_tablet_manager.cc:1403] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:30.299593 14975 raft_consensus.cc:2468] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.299918 16391 raft_consensus.cc:359] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.300010 16391 raft_consensus.cc:385] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.300033 16391 raft_consensus.cc:740] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.300102 16391 consensus_queue.cc:260] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.300320 16391 ts_tablet_manager.cc:1434] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.301612 16391 tablet_bootstrap.cc:492] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.302381 16391 tablet_bootstrap.cc:654] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.303373 16390 tablet_bootstrap.cc:492] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.303478 16390 ts_tablet_manager.cc:1403] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20251025 08:02:30.304435 16392 tablet_bootstrap.cc:492] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.304505 16392 ts_tablet_manager.cc:1403] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20251025 08:02:30.304845 16392 raft_consensus.cc:359] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.304929 16392 raft_consensus.cc:385] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.304968 16392 raft_consensus.cc:740] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.305080 16392 consensus_queue.cc:260] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.305322 16392 ts_tablet_manager.cc:1434] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.305461 16392 tablet_bootstrap.cc:492] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.305804 16391 tablet_bootstrap.cc:492] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.305882 16391 ts_tablet_manager.cc:1403] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:30.306392 16391 raft_consensus.cc:359] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.306475 16391 raft_consensus.cc:385] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.306504 16391 raft_consensus.cc:740] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.306607 16391 consensus_queue.cc:260] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.306891 16391 ts_tablet_manager.cc:1434] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.307158 16391 tablet_bootstrap.cc:492] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.308002 16391 tablet_bootstrap.cc:654] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.306715 16392 tablet_bootstrap.cc:654] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.308887 16391 tablet_bootstrap.cc:492] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.309005 16391 ts_tablet_manager.cc:1403] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:30.309310 16392 tablet_bootstrap.cc:492] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.309396 16392 ts_tablet_manager.cc:1403] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20251025 08:02:30.309593 16391 raft_consensus.cc:359] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.309588 16390 raft_consensus.cc:359] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.309688 16390 raft_consensus.cc:385] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.309725 16390 raft_consensus.cc:740] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.309760 16391 raft_consensus.cc:385] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.309826 16392 raft_consensus.cc:359] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.309863 16390 consensus_queue.cc:260] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.309973 16392 raft_consensus.cc:385] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.310010 16392 raft_consensus.cc:740] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.309883 16391 raft_consensus.cc:740] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.310122 16392 consensus_queue.cc:260] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.310237 16390 ts_tablet_manager.cc:1434] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20251025 08:02:30.310391 16390 tablet_bootstrap.cc:492] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.310345 16391 consensus_queue.cc:260] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.310492 16392 ts_tablet_manager.cc:1434] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.310714 16392 tablet_bootstrap.cc:492] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.310714 16391 ts_tablet_manager.cc:1434] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.310914 16391 tablet_bootstrap.cc:492] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.311276 16390 tablet_bootstrap.cc:654] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.311645 16392 tablet_bootstrap.cc:654] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.312312 16391 tablet_bootstrap.cc:654] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.312672 16392 tablet_bootstrap.cc:492] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.312755 16392 ts_tablet_manager.cc:1403] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20251025 08:02:30.313118 16392 raft_consensus.cc:359] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.313211 16392 raft_consensus.cc:385] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.313246 16392 raft_consensus.cc:740] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.313359 16392 consensus_queue.cc:260] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.313589 16392 ts_tablet_manager.cc:1434] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.313740 16392 tablet_bootstrap.cc:492] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.314515 16392 tablet_bootstrap.cc:654] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.316044 16391 tablet_bootstrap.cc:492] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.316112 16391 ts_tablet_manager.cc:1403] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251025 08:02:30.316468 16391 raft_consensus.cc:359] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.316545 16391 raft_consensus.cc:385] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.316572 16391 raft_consensus.cc:740] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.316674 16391 consensus_queue.cc:260] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.316890 16391 ts_tablet_manager.cc:1434] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.317047 16391 tablet_bootstrap.cc:492] T 75d0c5e694734b37848c4127c4e97085 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.318203 16391 tablet_bootstrap.cc:654] T 75d0c5e694734b37848c4127c4e97085 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.318828 15864 raft_consensus.cc:493] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.318898 15864 raft_consensus.cc:515] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.319195 15864 leader_election.cc:290] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.319404 15374 raft_consensus.cc:493] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.319468 15374 raft_consensus.cc:515] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.319702 15374 leader_election.cc:290] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.320261 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62b2769c6ffc48f980ce7ed2bfa1dd75" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.320266 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb4faadd4fc146a5af032ce815bd6cc4" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.320380 15239 raft_consensus.cc:2468] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.320400 15237 raft_consensus.cc:2468] T fb4faadd4fc146a5af032ce815bd6cc4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.320497 16391 tablet_bootstrap.cc:492] T 75d0c5e694734b37848c4127c4e97085 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.320569 16391 ts_tablet_manager.cc:1403] T 75d0c5e694734b37848c4127c4e97085 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20251025 08:02:30.320976 16391 raft_consensus.cc:359] T 75d0c5e694734b37848c4127c4e97085 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.321070 16391 raft_consensus.cc:385] T 75d0c5e694734b37848c4127c4e97085 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.321108 16391 raft_consensus.cc:740] T 75d0c5e694734b37848c4127c4e97085 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.321209 16391 consensus_queue.cc:260] T 75d0c5e694734b37848c4127c4e97085 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.321475 16391 ts_tablet_manager.cc:1434] T 75d0c5e694734b37848c4127c4e97085 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.321620 16391 tablet_bootstrap.cc:492] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.322454 16391 tablet_bootstrap.cc:654] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.322747 14914 leader_election.cc:304] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.322894 14914 leader_election.cc:304] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.322927 15864 raft_consensus.cc:2804] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.322969 15864 raft_consensus.cc:493] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.322969 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62b2769c6ffc48f980ce7ed2bfa1dd75" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.323007 15864 raft_consensus.cc:3060] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.323068 15114 raft_consensus.cc:2468] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.323117 15374 raft_consensus.cc:2804] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.323163 15374 raft_consensus.cc:493] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.323196 15374 raft_consensus.cc:3060] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.323892 15864 raft_consensus.cc:515] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.323969 15374 raft_consensus.cc:515] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.324180 15864 leader_election.cc:290] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.324342 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb4faadd4fc146a5af032ce815bd6cc4" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.324437 15110 raft_consensus.cc:2468] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.324892 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb4faadd4fc146a5af032ce815bd6cc4" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.324180 15374 leader_election.cc:290] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.324970 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62b2769c6ffc48f980ce7ed2bfa1dd75" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.325004 15240 raft_consensus.cc:3060] T fb4faadd4fc146a5af032ce815bd6cc4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.325049 15237 raft_consensus.cc:3060] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.325814 15237 raft_consensus.cc:2468] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.325873 15240 raft_consensus.cc:2468] T fb4faadd4fc146a5af032ce815bd6cc4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.325913 16391 tablet_bootstrap.cc:492] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.325992 16391 ts_tablet_manager.cc:1403] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:30.326141 14914 leader_election.cc:304] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.326341 14914 leader_election.cc:304] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.326450 16420 raft_consensus.cc:2804] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.326552 16420 raft_consensus.cc:697] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.326612 15380 raft_consensus.cc:493] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.326659 16420 consensus_queue.cc:237] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.326680 15380 raft_consensus.cc:515] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.326776 15864 raft_consensus.cc:2804] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.326884 15864 raft_consensus.cc:697] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.326982 15380 leader_election.cc:290] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.326972 15864 consensus_queue.cc:237] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.328070 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "446194cf013c4b6499deb00fab8db42a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.328368 15049 leader_election.cc:343] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.328447 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fb4faadd4fc146a5af032ce815bd6cc4" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.328516 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "62b2769c6ffc48f980ce7ed2bfa1dd75" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.328540 15114 raft_consensus.cc:3060] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.328596 15110 raft_consensus.cc:3060] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.329098 16391 raft_consensus.cc:359] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.329207 16391 raft_consensus.cc:385] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.329239 16391 raft_consensus.cc:740] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.329355 16391 consensus_queue.cc:260] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.329443 15114 raft_consensus.cc:2468] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.329530 15110 raft_consensus.cc:2468] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.329617 16391 ts_tablet_manager.cc:1434] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s
I20251025 08:02:30.329759 16391 tablet_bootstrap.cc:492] T 327c7f7679dd469cb6f5a9b346c40671 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.330343 15380 raft_consensus.cc:493] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.330421 15380 raft_consensus.cc:515] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.330554 16391 tablet_bootstrap.cc:654] T 327c7f7679dd469cb6f5a9b346c40671 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.330672 15380 leader_election.cc:290] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.330982 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2069ab40d30c4b8dab9d37c466522ac1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.331082 15240 raft_consensus.cc:2468] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.331130 16572 raft_consensus.cc:493] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.331327 15049 leader_election.cc:304] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.331451 16391 tablet_bootstrap.cc:492] T 327c7f7679dd469cb6f5a9b346c40671 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.331475 16572 raft_consensus.cc:515] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.331529 16391 ts_tablet_manager.cc:1403] T 327c7f7679dd469cb6f5a9b346c40671 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:30.331828 16391 raft_consensus.cc:359] T 327c7f7679dd469cb6f5a9b346c40671 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.331923 16391 raft_consensus.cc:385] T 327c7f7679dd469cb6f5a9b346c40671 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.331974 16391 raft_consensus.cc:740] T 327c7f7679dd469cb6f5a9b346c40671 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.331900 16572 leader_election.cc:290] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.332028 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2069ab40d30c4b8dab9d37c466522ac1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.332096 16391 consensus_queue.cc:260] T 327c7f7679dd469cb6f5a9b346c40671 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.332129 15110 raft_consensus.cc:2468] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.332243 15380 raft_consensus.cc:2804] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.332288 15380 raft_consensus.cc:493] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.332320 15380 raft_consensus.cc:3060] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.332304 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2069ab40d30c4b8dab9d37c466522ac1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.332342 16391 ts_tablet_manager.cc:1434] T 327c7f7679dd469cb6f5a9b346c40671 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.332401 14975 raft_consensus.cc:2468] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.332491 16391 tablet_bootstrap.cc:492] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.332641 15185 leader_election.cc:304] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.332929 16572 raft_consensus.cc:2804] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.333027 16572 raft_consensus.cc:493] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.333113 16572 raft_consensus.cc:3060] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.333110 15380 raft_consensus.cc:515] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.333410 16391 tablet_bootstrap.cc:654] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.333436 15380 leader_election.cc:290] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.333755 16390 tablet_bootstrap.cc:492] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.333824 16390 ts_tablet_manager.cc:1403] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20251025 08:02:30.334332 16390 raft_consensus.cc:359] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.334425 16390 raft_consensus.cc:385] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.334455 16391 tablet_bootstrap.cc:492] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.334455 16572 raft_consensus.cc:515] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.334522 16391 ts_tablet_manager.cc:1403] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.334527 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2069ab40d30c4b8dab9d37c466522ac1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.334651 15240 raft_consensus.cc:2393] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:30.334462 16390 raft_consensus.cc:740] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.334914 16391 raft_consensus.cc:359] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.334981 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2069ab40d30c4b8dab9d37c466522ac1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.335011 16391 raft_consensus.cc:385] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.335040 16391 raft_consensus.cc:740] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.335088 15110 raft_consensus.cc:2393] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:30.335039 16390 consensus_queue.cc:260] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.335134 16391 consensus_queue.cc:260] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.335317 16390 ts_tablet_manager.cc:1434] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.335366 16391 ts_tablet_manager.cc:1434] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.335445 16572 leader_election.cc:290] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.335515 16391 tablet_bootstrap.cc:492] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.335625 16390 tablet_bootstrap.cc:492] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.336287 16391 tablet_bootstrap.cc:654] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.336511 16390 tablet_bootstrap.cc:654] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.337296 16391 tablet_bootstrap.cc:492] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.337375 16391 ts_tablet_manager.cc:1403] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.337560 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2069ab40d30c4b8dab9d37c466522ac1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.337646 14975 raft_consensus.cc:3060] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.337872 16391 raft_consensus.cc:359] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.337939 16391 raft_consensus.cc:385] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.337976 16391 raft_consensus.cc:740] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.338057 16391 consensus_queue.cc:260] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.338527 16390 tablet_bootstrap.cc:492] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.338515 14975 raft_consensus.cc:2468] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.338598 16390 ts_tablet_manager.cc:1403] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:30.338775 15183 leader_election.cc:304] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:30.338865 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "446194cf013c4b6499deb00fab8db42a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.339037 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2069ab40d30c4b8dab9d37c466522ac1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.339135 14974 raft_consensus.cc:2393] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:30.339356 16572 raft_consensus.cc:2804] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.339440 16572 raft_consensus.cc:697] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.339521 15374 raft_consensus.cc:493] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.339550 16572 consensus_queue.cc:237] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.339579 15374 raft_consensus.cc:515] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.339840 15374 leader_election.cc:290] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.340286 16391 ts_tablet_manager.cc:1434] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:30.340451 16391 tablet_bootstrap.cc:492] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.340464 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c119ac81d35496cad2630c19f15ea21" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.340553 15240 raft_consensus.cc:2468] T 3c119ac81d35496cad2630c19f15ea21 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.340792 14914 leader_election.cc:304] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.340943 15374 raft_consensus.cc:2804] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.340984 15374 raft_consensus.cc:493] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.341025 15374 raft_consensus.cc:3060] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.341810 15374 raft_consensus.cc:515] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.341958 16390 raft_consensus.cc:359] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.342108 15374 leader_election.cc:290] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.342101 16390 raft_consensus.cc:385] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.342221 16390 raft_consensus.cc:740] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.342622 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c119ac81d35496cad2630c19f15ea21" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.342706 15240 raft_consensus.cc:3060] T 3c119ac81d35496cad2630c19f15ea21 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.342989 16391 tablet_bootstrap.cc:654] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.343515 15240 raft_consensus.cc:2468] T 3c119ac81d35496cad2630c19f15ea21 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.343807 16391 tablet_bootstrap.cc:492] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.343801 14914 leader_election.cc:304] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.343902 16391 ts_tablet_manager.cc:1403] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:30.343976 16390 consensus_queue.cc:260] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.344141 15374 raft_consensus.cc:2804] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.344231 15374 raft_consensus.cc:697] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.344269 16390 ts_tablet_manager.cc:1434] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s
I20251025 08:02:30.344334 15374 consensus_queue.cc:237] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.344547 16390 tablet_bootstrap.cc:492] T 17e61bb1e9c94b949361b2ca152eb3d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.345515 16390 tablet_bootstrap.cc:654] T 17e61bb1e9c94b949361b2ca152eb3d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.345537 16391 raft_consensus.cc:359] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.345633 16391 raft_consensus.cc:385] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.345674 16391 raft_consensus.cc:740] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.345774 16391 consensus_queue.cc:260] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.346099 16391 ts_tablet_manager.cc:1434] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.346289 16391 tablet_bootstrap.cc:492] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.347041 16391 tablet_bootstrap.cc:654] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.348018 16391 tablet_bootstrap.cc:492] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.348095 16391 ts_tablet_manager.cc:1403] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.348498 16391 raft_consensus.cc:359] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.348582 16391 raft_consensus.cc:385] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.348613 16391 raft_consensus.cc:740] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.348697 16391 consensus_queue.cc:260] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.349987 16391 ts_tablet_manager.cc:1434] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.351998 16391 tablet_bootstrap.cc:492] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:30.352205 15048 leader_election.cc:343] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.352279 15048 leader_election.cc:304] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.352394 15380 raft_consensus.cc:2749] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.352869 16391 tablet_bootstrap.cc:654] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.352900 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c119ac81d35496cad2630c19f15ea21" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.353066 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c119ac81d35496cad2630c19f15ea21" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.353173 15114 raft_consensus.cc:3060] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.353340 16392 tablet_bootstrap.cc:492] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.353423 16392 ts_tablet_manager.cc:1403] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.000s
I20251025 08:02:30.353883 16391 tablet_bootstrap.cc:492] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.353957 16391 ts_tablet_manager.cc:1403] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.354027 16392 raft_consensus.cc:359] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.354147 16392 raft_consensus.cc:385] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.354220 16392 raft_consensus.cc:740] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.354359 16392 consensus_queue.cc:260] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.354409 16391 raft_consensus.cc:359] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.354490 16391 raft_consensus.cc:385] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.354532 16391 raft_consensus.cc:740] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.354624 16391 consensus_queue.cc:260] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.354686 16392 ts_tablet_manager.cc:1434] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20251025 08:02:30.354868 16392 tablet_bootstrap.cc:492] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.354871 16391 ts_tablet_manager.cc:1434] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.354079 15114 raft_consensus.cc:2468] T 3c119ac81d35496cad2630c19f15ea21 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.355020 16391 tablet_bootstrap.cc:492] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.355748 16392 tablet_bootstrap.cc:654] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.355899 16391 tablet_bootstrap.cc:654] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.356093 15642 raft_consensus.cc:493] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.356161 15642 raft_consensus.cc:515] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.356482 15642 leader_election.cc:290] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.356887 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bea55cdfbf454d76920806886c3d2c4e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.357203 15049 leader_election.cc:343] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.357514 16390 tablet_bootstrap.cc:492] T 17e61bb1e9c94b949361b2ca152eb3d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.357595 16390 ts_tablet_manager.cc:1403] T 17e61bb1e9c94b949361b2ca152eb3d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.001s
I20251025 08:02:30.357986 16390 raft_consensus.cc:359] T 17e61bb1e9c94b949361b2ca152eb3d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.358076 16390 raft_consensus.cc:385] T 17e61bb1e9c94b949361b2ca152eb3d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.358105 16390 raft_consensus.cc:740] T 17e61bb1e9c94b949361b2ca152eb3d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.358161 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2069ab40d30c4b8dab9d37c466522ac1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.358229 16390 consensus_queue.cc:260] T 17e61bb1e9c94b949361b2ca152eb3d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.358302 14974 raft_consensus.cc:2393] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:30.358923 16390 ts_tablet_manager.cc:1434] T 17e61bb1e9c94b949361b2ca152eb3d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.360708 16390 tablet_bootstrap.cc:492] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.361410 15384 raft_consensus.cc:493] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.361486 15384 raft_consensus.cc:515] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.361799 15384 leader_election.cc:290] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.362308 16390 tablet_bootstrap.cc:654] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.362592 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4edf680e8d4a4b898fd6e64f8ec6f75d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.362700 14974 raft_consensus.cc:2468] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.362950 15183 leader_election.cc:304] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
W20251025 08:02:30.363032 15185 leader_election.cc:343] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 4edf680e8d4a4b898fd6e64f8ec6f75d
I20251025 08:02:30.363260 15384 raft_consensus.cc:2804] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.363314 15384 raft_consensus.cc:493] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.363353 15384 raft_consensus.cc:3060] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.363714 15048 leader_election.cc:304] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.363869 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bea55cdfbf454d76920806886c3d2c4e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.364164 15380 raft_consensus.cc:2749] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20251025 08:02:30.364213 15048 leader_election.cc:343] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.364276 15048 leader_election.cc:304] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.364264 15384 raft_consensus.cc:515] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.364399 15380 raft_consensus.cc:2749] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.364430 16390 tablet_bootstrap.cc:492] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.364495 16390 ts_tablet_manager.cc:1403] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:30.364585 15384 leader_election.cc:290] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.365033 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4edf680e8d4a4b898fd6e64f8ec6f75d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.365147 14974 raft_consensus.cc:3060] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.365971 14974 raft_consensus.cc:2468] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.366642 15864 raft_consensus.cc:493] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.366707 15864 raft_consensus.cc:515] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.366972 15864 leader_election.cc:290] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.367835 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a547fb54ddbf4053b5be20ee6c4fc6b0" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.367926 15237 raft_consensus.cc:2468] T a547fb54ddbf4053b5be20ee6c4fc6b0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
W20251025 08:02:30.368153 15185 leader_election.cc:343] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 4edf680e8d4a4b898fd6e64f8ec6f75d
I20251025 08:02:30.368352 14914 leader_election.cc:304] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.368427 15183 leader_election.cc:304] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:30.368695 15374 raft_consensus.cc:2804] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.368743 15374 raft_consensus.cc:493] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.368778 15374 raft_consensus.cc:3060] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.369596 15374 raft_consensus.cc:515] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.369861 15374 leader_election.cc:290] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.370034 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a547fb54ddbf4053b5be20ee6c4fc6b0" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.370275 15114 raft_consensus.cc:2468] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.370361 16390 raft_consensus.cc:359] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.370461 16390 raft_consensus.cc:385] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.370489 16390 raft_consensus.cc:740] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.370605 16390 consensus_queue.cc:260] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.370646 15380 raft_consensus.cc:493] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.370710 15380 raft_consensus.cc:515] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.370747 16572 raft_consensus.cc:2804] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.370826 16572 raft_consensus.cc:697] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.371021 15380 leader_election.cc:290] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.370885 16390 ts_tablet_manager.cc:1434] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:30.370926 16572 consensus_queue.cc:237] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.371537 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1927cf6a9013402a92c9e6e89e2e1715" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.371812 16390 tablet_bootstrap.cc:492] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
W20251025 08:02:30.372296 15049 leader_election.cc:343] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.372764 16390 tablet_bootstrap.cc:654] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.372802 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a547fb54ddbf4053b5be20ee6c4fc6b0" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.372884 15240 raft_consensus.cc:3060] T a547fb54ddbf4053b5be20ee6c4fc6b0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.373765 15240 raft_consensus.cc:2468] T a547fb54ddbf4053b5be20ee6c4fc6b0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.374840 14914 leader_election.cc:304] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.374945 16391 tablet_bootstrap.cc:492] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.374998 15864 raft_consensus.cc:2804] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.375013 16391 ts_tablet_manager.cc:1403] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.000s
I20251025 08:02:30.375068 15864 raft_consensus.cc:697] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.375178 15864 consensus_queue.cc:237] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.375403 16391 raft_consensus.cc:359] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.375478 16199 raft_consensus.cc:493] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.375501 16391 raft_consensus.cc:385] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.375535 16391 raft_consensus.cc:740] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.375546 16199 raft_consensus.cc:515] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.375630 16391 consensus_queue.cc:260] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.375824 16199 leader_election.cc:290] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.375890 16391 ts_tablet_manager.cc:1434] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.376173 15642 raft_consensus.cc:493] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.376259 15642 raft_consensus.cc:515] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.376446 16391 tablet_bootstrap.cc:492] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.376570 15642 leader_election.cc:290] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.376658 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2562325ea1c9436a85e1d675574c0a6c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.376754 14974 raft_consensus.cc:2468] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.377311 16391 tablet_bootstrap.cc:654] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.377388 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17e61bb1e9c94b949361b2ca152eb3d4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.377485 15240 raft_consensus.cc:2468] T 17e61bb1e9c94b949361b2ca152eb3d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.377724 15049 leader_election.cc:304] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.377972 15642 raft_consensus.cc:2804] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.378026 15642 raft_consensus.cc:493] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.378067 15642 raft_consensus.cc:3060] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.378098 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2562325ea1c9436a85e1d675574c0a6c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.378214 15111 raft_consensus.cc:2468] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.378975 15642 raft_consensus.cc:515] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.379282 15642 leader_election.cc:290] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.379698 16392 tablet_bootstrap.cc:492] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.379763 16392 ts_tablet_manager.cc:1403] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.000s
I20251025 08:02:30.380173 16392 raft_consensus.cc:359] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.380265 16392 raft_consensus.cc:385] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.380297 16392 raft_consensus.cc:740] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.380417 16392 consensus_queue.cc:260] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.380674 16392 ts_tablet_manager.cc:1434] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.380822 16392 tablet_bootstrap.cc:492] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.381292 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17e61bb1e9c94b949361b2ca152eb3d4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.381407 14979 raft_consensus.cc:2468] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.381726 16392 tablet_bootstrap.cc:654] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.381758 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17e61bb1e9c94b949361b2ca152eb3d4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.381839 14979 raft_consensus.cc:3060] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.381922 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1927cf6a9013402a92c9e6e89e2e1715" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.382237 15185 leader_election.cc:304] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.382469 16572 raft_consensus.cc:2804] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.382519 16572 raft_consensus.cc:493] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.382563 16572 raft_consensus.cc:3060] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.382604 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17e61bb1e9c94b949361b2ca152eb3d4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.382683 15240 raft_consensus.cc:3060] T 17e61bb1e9c94b949361b2ca152eb3d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.382730 14979 raft_consensus.cc:2468] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.383412 15240 raft_consensus.cc:2468] T 17e61bb1e9c94b949361b2ca152eb3d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.383482 16572 raft_consensus.cc:515] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.383821 16572 leader_election.cc:290] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.383955 16572 raft_consensus.cc:493] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.384018 16572 raft_consensus.cc:515] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.384277 16572 leader_election.cc:290] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.384917 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75d0c5e694734b37848c4127c4e97085" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.385015 15111 raft_consensus.cc:2468] T 75d0c5e694734b37848c4127c4e97085 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.385097 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a547fb54ddbf4053b5be20ee6c4fc6b0" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
W20251025 08:02:30.385152 15048 leader_election.cc:343] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.385190 15112 raft_consensus.cc:3060] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.385201 15048 leader_election.cc:304] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.385439 15048 leader_election.cc:304] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:30.386051 15112 raft_consensus.cc:2468] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.386157 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75d0c5e694734b37848c4127c4e97085" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.386288 14974 raft_consensus.cc:2468] T 75d0c5e694734b37848c4127c4e97085 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.386358 15380 raft_consensus.cc:2749] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.386457 15380 raft_consensus.cc:2804] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.386528 15380 raft_consensus.cc:697] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:30.386620 15183 leader_election.cc:304] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.386646 15380 consensus_queue.cc:237] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.387092 16570 consensus_queue.cc:1048] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.387252 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2562325ea1c9436a85e1d675574c0a6c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.387317 16570 raft_consensus.cc:2804] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.387352 14979 raft_consensus.cc:3060] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.387377 16570 raft_consensus.cc:493] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.387419 16570 raft_consensus.cc:3060] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.388166 14979 raft_consensus.cc:2468] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.388352 16570 raft_consensus.cc:515] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.388578 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2562325ea1c9436a85e1d675574c0a6c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.388651 16570 leader_election.cc:290] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.388671 15114 raft_consensus.cc:3060] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.389344 16390 tablet_bootstrap.cc:492] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.389420 16390 ts_tablet_manager.cc:1403] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251025 08:02:30.389539 15114 raft_consensus.cc:2468] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.389734 15183 leader_election.cc:304] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.389763 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75d0c5e694734b37848c4127c4e97085" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.389848 15112 raft_consensus.cc:3060] T 75d0c5e694734b37848c4127c4e97085 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.389808 16390 raft_consensus.cc:359] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.389895 16390 raft_consensus.cc:385] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.389968 16390 raft_consensus.cc:740] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.390084 16390 consensus_queue.cc:260] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.390352 16390 ts_tablet_manager.cc:1434] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.390491 16390 tablet_bootstrap.cc:492] T 09fccf0770604812940dd63106f7d993 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.390673 15112 raft_consensus.cc:2468] T 75d0c5e694734b37848c4127c4e97085 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.391141 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "75d0c5e694734b37848c4127c4e97085" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.391248 14979 raft_consensus.cc:3060] T 75d0c5e694734b37848c4127c4e97085 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.391696 16572 raft_consensus.cc:2804] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.391788 16572 raft_consensus.cc:697] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.391887 16572 consensus_queue.cc:237] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.392252 14979 raft_consensus.cc:2468] T 75d0c5e694734b37848c4127c4e97085 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.391502 16390 tablet_bootstrap.cc:654] T 09fccf0770604812940dd63106f7d993 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.393289 15185 leader_election.cc:304] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.393432 15384 raft_consensus.cc:2804] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.393493 15384 raft_consensus.cc:697] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.393587 15384 consensus_queue.cc:237] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.395892 16392 tablet_bootstrap.cc:492] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.395980 16392 ts_tablet_manager.cc:1403] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:30.396399 16392 raft_consensus.cc:359] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.396497 16392 raft_consensus.cc:385] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.396528 16392 raft_consensus.cc:740] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.396613 16392 consensus_queue.cc:260] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.396870 16392 ts_tablet_manager.cc:1434] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.397018 16392 tablet_bootstrap.cc:492] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.398066 16392 tablet_bootstrap.cc:654] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.400169 16392 tablet_bootstrap.cc:492] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.400272 16392 ts_tablet_manager.cc:1403] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:30.401054 16392 raft_consensus.cc:359] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.401154 16392 raft_consensus.cc:385] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.401198 16392 raft_consensus.cc:740] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.401322 16392 consensus_queue.cc:260] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.401648 16392 ts_tablet_manager.cc:1434] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.402536 16392 tablet_bootstrap.cc:492] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.402956 16420 consensus_queue.cc:1048] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.403082 16873 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33b7e3c702ec44079d8b76a0ce6bae97)
I20251025 08:02:30.403193 16873 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:30.403851 16392 tablet_bootstrap.cc:654] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.404785 16390 tablet_bootstrap.cc:492] T 09fccf0770604812940dd63106f7d993 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.404858 16390 ts_tablet_manager.cc:1403] T 09fccf0770604812940dd63106f7d993 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20251025 08:02:30.405333 16391 tablet_bootstrap.cc:492] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.405347 16390 raft_consensus.cc:359] T 09fccf0770604812940dd63106f7d993 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.405409 16391 ts_tablet_manager.cc:1403] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.000s
I20251025 08:02:30.405441 16390 raft_consensus.cc:385] T 09fccf0770604812940dd63106f7d993 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.405481 16390 raft_consensus.cc:740] T 09fccf0770604812940dd63106f7d993 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.405589 16390 consensus_queue.cc:260] T 09fccf0770604812940dd63106f7d993 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.405778 16391 raft_consensus.cc:359] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.405856 16391 raft_consensus.cc:385] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.405889 16391 raft_consensus.cc:740] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.405911 16390 ts_tablet_manager.cc:1434] T 09fccf0770604812940dd63106f7d993 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.406008 16391 consensus_queue.cc:260] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.406100 16392 tablet_bootstrap.cc:492] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.406112 16390 tablet_bootstrap.cc:492] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.406172 16392 ts_tablet_manager.cc:1403] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:30.406296 16391 ts_tablet_manager.cc:1434] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.406461 16391 tablet_bootstrap.cc:492] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.406618 16392 raft_consensus.cc:359] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.406713 16392 raft_consensus.cc:385] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.406742 16392 raft_consensus.cc:740] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.406833 16392 consensus_queue.cc:260] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.407104 16390 tablet_bootstrap.cc:654] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.407145 16392 ts_tablet_manager.cc:1434] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.407325 16392 tablet_bootstrap.cc:492] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.407537 16391 tablet_bootstrap.cc:654] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.408277 16392 tablet_bootstrap.cc:654] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.409096 16857 raft_consensus.cc:493] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.409171 16857 raft_consensus.cc:515] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.409461 16857 leader_election.cc:290] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:30.410264 14914 leader_election.cc:343] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: e48ddcfccc1340d39d21ce94bec4bf27
I20251025 08:02:30.410604 16873 leader_election.cc:290] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 94a96657c5fd49398b88e9ad615bfe1e (127.14.70.62:39499), 33b7e3c702ec44079d8b76a0ce6bae97 (127.14.70.61:44347)
I20251025 08:02:30.415033 16390 tablet_bootstrap.cc:492] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.415033 16392 tablet_bootstrap.cc:492] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.415117 16392 ts_tablet_manager.cc:1403] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20251025 08:02:30.415210 16390 ts_tablet_manager.cc:1403] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251025 08:02:30.415565 16392 raft_consensus.cc:359] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.415665 16392 raft_consensus.cc:385] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.415704 16392 raft_consensus.cc:740] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.415791 16390 raft_consensus.cc:359] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.415822 16392 consensus_queue.cc:260] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.415953 16390 raft_consensus.cc:385] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.416025 16390 raft_consensus.cc:740] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.416131 16392 ts_tablet_manager.cc:1434] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.416244 16390 consensus_queue.cc:260] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.416401 15497 raft_consensus.cc:493] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.416476 15497 raft_consensus.cc:515] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.416514 16392 tablet_bootstrap.cc:492] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.416579 16390 ts_tablet_manager.cc:1434] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.416728 16390 tablet_bootstrap.cc:492] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.416733 15497 leader_election.cc:290] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.417419 16392 tablet_bootstrap.cc:654] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.418068 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0488062b11994f03a1af2e52db492977" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.418169 15237 raft_consensus.cc:2468] T 0488062b11994f03a1af2e52db492977 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.418705 16887 raft_consensus.cc:493] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 33b7e3c702ec44079d8b76a0ce6bae97)
I20251025 08:02:30.418823 16391 tablet_bootstrap.cc:492] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.418890 16391 ts_tablet_manager.cc:1403] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20251025 08:02:30.418849 16887 raft_consensus.cc:515] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:30.419317 15049 leader_election.cc:304] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.419296 16391 raft_consensus.cc:359] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.419384 16391 raft_consensus.cc:385] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.419412 16391 raft_consensus.cc:740] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.419449 15642 raft_consensus.cc:2804] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.419492 15642 raft_consensus.cc:493] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.419528 15642 raft_consensus.cc:3060] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.419684 16391 consensus_queue.cc:260] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.420231 16390 tablet_bootstrap.cc:654] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.420367 16391 ts_tablet_manager.cc:1434] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.420397 15642 raft_consensus.cc:515] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.420626 16391 tablet_bootstrap.cc:492] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.420719 15642 leader_election.cc:290] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.421358 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0488062b11994f03a1af2e52db492977" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.421453 15237 raft_consensus.cc:3060] T 0488062b11994f03a1af2e52db492977 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.421576 16391 tablet_bootstrap.cc:654] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.421972 15642 raft_consensus.cc:493] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.422036 15642 raft_consensus.cc:515] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.422312 15642 leader_election.cc:290] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.422418 15237 raft_consensus.cc:2468] T 0488062b11994f03a1af2e52db492977 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.422662 15049 leader_election.cc:304] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.422874 15642 raft_consensus.cc:2804] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.422941 15642 raft_consensus.cc:697] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:30.423038 15642 consensus_queue.cc:237] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.424225 16570 raft_consensus.cc:493] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.424296 16570 raft_consensus.cc:515] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.424553 16570 leader_election.cc:290] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.425190 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "327c7f7679dd469cb6f5a9b346c40671" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.425295 15237 raft_consensus.cc:2468] T 327c7f7679dd469cb6f5a9b346c40671 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.425676 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba2914feb95475fbbfc5cef5a653408" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.425772 15112 raft_consensus.cc:2468] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.425987 15049 leader_election.cc:304] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.426046 15185 leader_election.cc:304] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.426151 15497 raft_consensus.cc:2804] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.426220 15497 raft_consensus.cc:493] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.426259 15497 raft_consensus.cc:3060] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.426337 16570 raft_consensus.cc:2804] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.426393 16570 raft_consensus.cc:493] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.426437 16570 raft_consensus.cc:3060] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.427099 15497 raft_consensus.cc:515] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.427356 16570 raft_consensus.cc:515] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.427397 15497 leader_election.cc:290] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.427410 16298 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7109d31951574de3bf05a86c94c11d21" candidate_term: 4 candidate_status { last_received { term: 3 index: 695 } } ignore_live_leader: false dest_uuid: "94a96657c5fd49398b88e9ad615bfe1e" is_pre_election: true
I20251025 08:02:30.427649 16298 raft_consensus.cc:2410] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7109d31951574de3bf05a86c94c11d21 for term 4 because replica has last-logged OpId of term: 3 index: 701, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 695.
I20251025 08:02:30.427665 16570 leader_election.cc:290] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.428109 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba2914feb95475fbbfc5cef5a653408" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.428187 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba2914feb95475fbbfc5cef5a653408" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.428210 14974 raft_consensus.cc:2468] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.428416 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fba2914feb95475fbbfc5cef5a653408" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.428512 15112 raft_consensus.cc:3060] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.428622 15497 raft_consensus.cc:493] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.428694 15497 raft_consensus.cc:515] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.429001 15497 leader_election.cc:290] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.429347 15112 raft_consensus.cc:2468] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.429579 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0488062b11994f03a1af2e52db492977" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.429603 15185 leader_election.cc:304] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.429673 14979 raft_consensus.cc:2468] T 0488062b11994f03a1af2e52db492977 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.429804 16572 raft_consensus.cc:2804] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.429888 16572 raft_consensus.cc:697] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.430011 15539 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "94a96657c5fd49398b88e9ad615bfe1e" candidate_term: 4 candidate_status { last_received { term: 3 index: 701 } } ignore_live_leader: false dest_uuid: "7109d31951574de3bf05a86c94c11d21" is_pre_election: true
I20251025 08:02:30.430023 16572 consensus_queue.cc:237] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.430132 15539 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94a96657c5fd49398b88e9ad615bfe1e in term 3.
I20251025 08:02:30.430392 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b69d792862540b6ad1b5d56dea17499" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.430483 16272 leader_election.cc:304] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7109d31951574de3bf05a86c94c11d21, 94a96657c5fd49398b88e9ad615bfe1e; no voters:
I20251025 08:02:30.430737 16887 leader_election.cc:290] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 33b7e3c702ec44079d8b76a0ce6bae97 (127.14.70.61:44347), 7109d31951574de3bf05a86c94c11d21 (127.14.70.60:34453)
I20251025 08:02:30.430824 16887 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20251025 08:02:30.430866 16887 raft_consensus.cc:493] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 33b7e3c702ec44079d8b76a0ce6bae97)
I20251025 08:02:30.430900 16887 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 3 FOLLOWER]: Advancing to term 4
W20251025 08:02:30.430994 14915 consensus_peers.cc:597] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e106f20977444dd4a49b6e4ae0f45380. This is attempt 1: this message will repeat every 5th retry.
W20251025 08:02:30.431089 14915 leader_election.cc:343] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: e48ddcfccc1340d39d21ce94bec4bf27
I20251025 08:02:30.431133 14915 leader_election.cc:304] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.431300 15864 raft_consensus.cc:2749] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.431820 16887 raft_consensus.cc:515] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
W20251025 08:02:30.432211 15049 leader_election.cc:343] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.432247 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "327c7f7679dd469cb6f5a9b346c40671" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.432334 15237 raft_consensus.cc:3060] T 327c7f7679dd469cb6f5a9b346c40671 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.432438 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0488062b11994f03a1af2e52db492977" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.432525 14979 raft_consensus.cc:3060] T 0488062b11994f03a1af2e52db492977 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.432835 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "327c7f7679dd469cb6f5a9b346c40671" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.432932 14974 raft_consensus.cc:2468] T 327c7f7679dd469cb6f5a9b346c40671 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.433168 15237 raft_consensus.cc:2468] T 327c7f7679dd469cb6f5a9b346c40671 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.433454 14979 raft_consensus.cc:2468] T 0488062b11994f03a1af2e52db492977 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.433923 15642 raft_consensus.cc:493] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.433996 15642 raft_consensus.cc:515] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.434561 15642 leader_election.cc:290] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.434906 16390 tablet_bootstrap.cc:492] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.434906 15049 leader_election.cc:304] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.434986 16390 ts_tablet_manager.cc:1403] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251025 08:02:30.435066 15642 raft_consensus.cc:2804] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.435132 15642 raft_consensus.cc:697] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:30.435238 15642 consensus_queue.cc:237] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.435413 16390 raft_consensus.cc:359] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.435494 16390 raft_consensus.cc:385] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.435519 16390 raft_consensus.cc:740] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.435623 16390 consensus_queue.cc:260] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.436671 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6dd0f695a2904df5b750b45782a21ce2" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.436767 15237 raft_consensus.cc:2468] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.437544 16390 ts_tablet_manager.cc:1434] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:30.437755 16390 tablet_bootstrap.cc:492] T 06c159c643804acfb0c3b82190a7a02f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.438460 15864 raft_consensus.cc:493] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.438534 15864 raft_consensus.cc:515] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.438804 15864 leader_election.cc:290] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.438905 16390 tablet_bootstrap.cc:654] T 06c159c643804acfb0c3b82190a7a02f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.439263 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d709ecb9ac9a4525985c7d2bf10719f5" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.439370 15237 raft_consensus.cc:2468] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.439353 15539 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "94a96657c5fd49398b88e9ad615bfe1e" candidate_term: 4 candidate_status { last_received { term: 3 index: 701 } } ignore_live_leader: false dest_uuid: "7109d31951574de3bf05a86c94c11d21"
I20251025 08:02:30.439442 15539 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 3 FOLLOWER]: Advancing to term 4
I20251025 08:02:30.439816 14914 leader_election.cc:304] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.439958 15864 raft_consensus.cc:2804] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.439996 15864 raft_consensus.cc:493] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.440032 15864 raft_consensus.cc:3060] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.440373 15539 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94a96657c5fd49398b88e9ad615bfe1e in term 4.
I20251025 08:02:30.440753 16272 leader_election.cc:304] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7109d31951574de3bf05a86c94c11d21, 94a96657c5fd49398b88e9ad615bfe1e; no voters:
I20251025 08:02:30.440842 15864 raft_consensus.cc:515] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.441181 15864 leader_election.cc:290] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.441387 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b69d792862540b6ad1b5d56dea17499" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:30.441883 15491 leader_election.cc:336] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33b7e3c702ec44079d8b76a0ce6bae97 (127.14.70.61:44347): Network error: Client connection negotiation failed: client connection to 127.14.70.61:44347: connect: Connection refused (error 111)
I20251025 08:02:30.441952 15491 leader_election.cc:304] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7109d31951574de3bf05a86c94c11d21; no voters: 33b7e3c702ec44079d8b76a0ce6bae97, 94a96657c5fd49398b88e9ad615bfe1e
I20251025 08:02:30.442340 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d709ecb9ac9a4525985c7d2bf10719f5" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.442418 16887 leader_election.cc:290] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [CANDIDATE]: Term 4 election: Requested vote from peers 33b7e3c702ec44079d8b76a0ce6bae97 (127.14.70.61:44347), 7109d31951574de3bf05a86c94c11d21 (127.14.70.60:34453)
I20251025 08:02:30.442432 15237 raft_consensus.cc:3060] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.442529 16887 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 4 FOLLOWER]: Leader election won for term 4
I20251025 08:02:30.442607 16887 raft_consensus.cc:697] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [term 4 LEADER]: Becoming Leader. State: Replica: 94a96657c5fd49398b88e9ad615bfe1e, State: Running, Role: LEADER
I20251025 08:02:30.442868 16887 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 701, Committed index: 701, Last appended: 3.701, Last appended by leader: 701, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:30.443145 15049 leader_election.cc:304] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.443256 15237 raft_consensus.cc:2468] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.443288 15380 raft_consensus.cc:2804] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.443327 15380 raft_consensus.cc:493] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.443362 15380 raft_consensus.cc:3060] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.443698 16392 tablet_bootstrap.cc:492] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.442224 16873 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20251025 08:02:30.443774 16392 ts_tablet_manager.cc:1403] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.000s
I20251025 08:02:30.444156 15380 raft_consensus.cc:515] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.444446 15380 leader_election.cc:290] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.444465 16392 raft_consensus.cc:359] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.444557 16392 raft_consensus.cc:385] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.444598 16392 raft_consensus.cc:740] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.444664 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6dd0f695a2904df5b750b45782a21ce2" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.444690 16392 consensus_queue.cc:260] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.444764 14974 raft_consensus.cc:2468] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.444664 14914 leader_election.cc:304] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.444943 16392 ts_tablet_manager.cc:1434] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.445086 15864 raft_consensus.cc:2804] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.445111 16392 tablet_bootstrap.cc:492] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.445166 15864 raft_consensus.cc:697] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.445277 15864 consensus_queue.cc:237] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.446054 15380 raft_consensus.cc:493] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.446079 16392 tablet_bootstrap.cc:654] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.446135 15380 raft_consensus.cc:515] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.446419 15380 leader_election.cc:290] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.446650 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "327c7f7679dd469cb6f5a9b346c40671" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.446734 14979 raft_consensus.cc:3060] T 327c7f7679dd469cb6f5a9b346c40671 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.447502 14979 raft_consensus.cc:2468] T 327c7f7679dd469cb6f5a9b346c40671 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.447857 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6dd0f695a2904df5b750b45782a21ce2" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.447950 15237 raft_consensus.cc:3060] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.448413 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06c159c643804acfb0c3b82190a7a02f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.448671 15237 raft_consensus.cc:2468] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
W20251025 08:02:30.448760 15049 leader_election.cc:343] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.448911 15864 raft_consensus.cc:493] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.448969 15049 leader_election.cc:304] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.448989 15864 raft_consensus.cc:515] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.449102 15497 raft_consensus.cc:2804] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.449167 15497 raft_consensus.cc:697] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:30.449293 15864 leader_election.cc:290] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.449276 15497 consensus_queue.cc:237] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.449604 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af5a5d2903ff4142b1f1e70dd2a7d173" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.449714 15237 raft_consensus.cc:2393] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
W20251025 08:02:30.449970 16270 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.70.61:44347: connect: Connection refused (error 111)
W20251025 08:02:30.451046 16270 leader_election.cc:336] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 33b7e3c702ec44079d8b76a0ce6bae97 (127.14.70.61:44347): Network error: Client connection negotiation failed: client connection to 127.14.70.61:44347: connect: Connection refused (error 111)
I20251025 08:02:30.451862 16390 tablet_bootstrap.cc:492] T 06c159c643804acfb0c3b82190a7a02f P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.451987 16390 ts_tablet_manager.cc:1403] T 06c159c643804acfb0c3b82190a7a02f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20251025 08:02:30.452445 16887 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94a96657c5fd49398b88e9ad615bfe1e. Latest consensus state: current_term: 4 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:30.452540 16887 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: This master's current role is: LEADER
I20251025 08:02:30.452656 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6dd0f695a2904df5b750b45782a21ce2" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.452756 14979 raft_consensus.cc:3060] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.452863 16390 raft_consensus.cc:359] T 06c159c643804acfb0c3b82190a7a02f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.452993 16390 raft_consensus.cc:385] T 06c159c643804acfb0c3b82190a7a02f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.453055 16390 raft_consensus.cc:740] T 06c159c643804acfb0c3b82190a7a02f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.453258 16390 consensus_queue.cc:260] T 06c159c643804acfb0c3b82190a7a02f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:30.453521 15048 leader_election.cc:343] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.453595 15048 leader_election.cc:304] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.453711 16390 ts_tablet_manager.cc:1434] T 06c159c643804acfb0c3b82190a7a02f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:30.453892 16390 tablet_bootstrap.cc:492] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.453919 15380 raft_consensus.cc:2749] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.454260 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "af5a5d2903ff4142b1f1e70dd2a7d173" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.454615 15380 raft_consensus.cc:493] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.454680 15380 raft_consensus.cc:515] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.454766 15864 raft_consensus.cc:493] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.454824 15864 raft_consensus.cc:515] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.454962 15380 leader_election.cc:290] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.455024 16390 tablet_bootstrap.cc:654] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.455107 15864 leader_election.cc:290] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.455432 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e90c358ef454760b8317d78724ee377" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.455466 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6cca70bc3c48bf9c2396fdfdb8e42c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.455541 16392 tablet_bootstrap.cc:492] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.455528 15237 raft_consensus.cc:2468] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.455607 16392 ts_tablet_manager.cc:1403] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20251025 08:02:30.455862 14914 leader_election.cc:304] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.456058 15864 raft_consensus.cc:2804] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.456110 15864 raft_consensus.cc:493] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.456061 16392 raft_consensus.cc:359] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:30.456123 15049 leader_election.cc:343] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.456161 16392 raft_consensus.cc:385] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.456151 15864 raft_consensus.cc:3060] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.456193 16392 raft_consensus.cc:740] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.456301 16392 consensus_queue.cc:260] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.456540 16392 ts_tablet_manager.cc:1434] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.456689 16392 tablet_bootstrap.cc:492] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.457013 14979 raft_consensus.cc:2468] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.457681 16392 tablet_bootstrap.cc:654] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.458073 15864 raft_consensus.cc:515] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.458702 15864 leader_election.cc:290] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.458993 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7e90c358ef454760b8317d78724ee377" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.459082 15237 raft_consensus.cc:3060] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.459857 15237 raft_consensus.cc:2468] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.460879 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6cca70bc3c48bf9c2396fdfdb8e42c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.461691 14914 leader_election.cc:304] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.462047 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06c159c643804acfb0c3b82190a7a02f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:30.462266 14915 leader_election.cc:343] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: d709ecb9ac9a4525985c7d2bf10719f5
W20251025 08:02:30.462415 14915 consensus_peers.cc:597] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae3c8e134d164edd8781f27e7bdc3b92. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:30.462486 14915 leader_election.cc:304] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.462600 16857 raft_consensus.cc:2804] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
W20251025 08:02:30.462651 14915 leader_election.cc:343] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: d709ecb9ac9a4525985c7d2bf10719f5
I20251025 08:02:30.462678 16857 raft_consensus.cc:697] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.462785 16857 consensus_queue.cc:237] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.462973 15380 consensus_queue.cc:1048] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:30.463337 15048 leader_election.cc:343] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.463358 16857 raft_consensus.cc:3060] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.463407 15048 leader_election.cc:304] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.463619 15380 raft_consensus.cc:2749] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:30.463666 15048 leader_election.cc:343] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.463726 15048 leader_election.cc:304] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.463830 15380 raft_consensus.cc:2749] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.464300 16857 raft_consensus.cc:2749] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:30.464852 16270 leader_election.cc:336] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 33b7e3c702ec44079d8b76a0ce6bae97 (127.14.70.61:44347): Network error: Client connection negotiation failed: client connection to 127.14.70.61:44347: connect: Connection refused (error 111)
I20251025 08:02:30.466269 16391 tablet_bootstrap.cc:492] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.466341 16391 ts_tablet_manager.cc:1403] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.000s
I20251025 08:02:30.466725 16391 raft_consensus.cc:359] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.466785 16391 raft_consensus.cc:385] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.466809 16391 raft_consensus.cc:740] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.466913 16391 consensus_queue.cc:260] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.467159 16391 ts_tablet_manager.cc:1434] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.467526 16391 tablet_bootstrap.cc:492] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.468437 16391 tablet_bootstrap.cc:654] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.469099 16908 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
I20251025 08:02:30.469449 16391 tablet_bootstrap.cc:492] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.469514 16391 ts_tablet_manager.cc:1403] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:30.469967 16391 raft_consensus.cc:359] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.470068 16391 raft_consensus.cc:385] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.470098 16391 raft_consensus.cc:740] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.470221 16391 consensus_queue.cc:260] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.470466 16391 ts_tablet_manager.cc:1434] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.470616 16391 tablet_bootstrap.cc:492] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.471612 16391 tablet_bootstrap.cc:654] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:30.471783 14915 leader_election.cc:343] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 7e90c358ef454760b8317d78724ee377
W20251025 08:02:30.471968 14915 leader_election.cc:343] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 7e90c358ef454760b8317d78724ee377
I20251025 08:02:30.473407 16582 raft_consensus.cc:493] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.473501 16582 raft_consensus.cc:515] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.473788 16582 leader_election.cc:290] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.474283 16582 raft_consensus.cc:493] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.474344 16582 raft_consensus.cc:515] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.474499 16390 tablet_bootstrap.cc:492] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.474561 16390 ts_tablet_manager.cc:1403] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20251025 08:02:30.474586 16582 leader_election.cc:290] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.474902 16390 raft_consensus.cc:359] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.474994 16390 raft_consensus.cc:385] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.475019 16390 raft_consensus.cc:740] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.475098 16390 consensus_queue.cc:260] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.475374 16390 ts_tablet_manager.cc:1434] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.475507 16390 tablet_bootstrap.cc:492] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.476290 16390 tablet_bootstrap.cc:654] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.478423 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2b8efa8ed634583b7bf7cc91bfc61a3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.478526 15240 raft_consensus.cc:2468] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.479004 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c582efa6d334a06a48e2f2b94167776" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.479050 15049 leader_election.cc:304] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.479205 16582 raft_consensus.cc:2804] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.479259 16582 raft_consensus.cc:493] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.479321 16582 raft_consensus.cc:3060] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.480268 16582 raft_consensus.cc:515] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.480572 16582 leader_election.cc:290] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.480659 16582 consensus_queue.cc:1048] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.480912 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2b8efa8ed634583b7bf7cc91bfc61a3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.481011 14978 raft_consensus.cc:3060] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.481439 16391 tablet_bootstrap.cc:492] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.481511 16391 ts_tablet_manager.cc:1403] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251025 08:02:30.481817 14978 raft_consensus.cc:2468] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.481961 16391 raft_consensus.cc:359] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.482051 16391 raft_consensus.cc:385] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.482064 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2b8efa8ed634583b7bf7cc91bfc61a3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.482097 16391 raft_consensus.cc:740] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.482159 14974 raft_consensus.cc:2376] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1. Re-sending same reply.
I20251025 08:02:30.482213 16391 consensus_queue.cc:260] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.482487 16391 ts_tablet_manager.cc:1434] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.482583 16392 tablet_bootstrap.cc:492] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.482663 16391 tablet_bootstrap.cc:492] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.482667 16392 ts_tablet_manager.cc:1403] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20251025 08:02:30.482775 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c582efa6d334a06a48e2f2b94167776" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.483064 16392 raft_consensus.cc:359] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.483158 16392 raft_consensus.cc:385] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.483204 16392 raft_consensus.cc:740] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.483330 16392 consensus_queue.cc:260] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.483547 16391 tablet_bootstrap.cc:654] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.483599 16392 ts_tablet_manager.cc:1434] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.483765 16392 tablet_bootstrap.cc:492] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:30.484270 15049 leader_election.cc:343] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.484300 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a2b8efa8ed634583b7bf7cc91bfc61a3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.484402 15237 raft_consensus.cc:3060] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.484753 16392 tablet_bootstrap.cc:654] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.485247 15237 raft_consensus.cc:2468] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.485324 15048 leader_election.cc:304] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:30.485448 15642 raft_consensus.cc:2804] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
W20251025 08:02:30.485502 15048 leader_election.cc:343] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.485519 15642 raft_consensus.cc:697] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:30.485548 15048 leader_election.cc:304] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.485616 15642 consensus_queue.cc:237] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.485888 15497 raft_consensus.cc:2749] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.488772 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_85b56f9883d74360a81c24c7dbe31f32 [id=03f81977ce8b4edbaf54dceff38426af]
I20251025 08:02:30.489352 16390 tablet_bootstrap.cc:492] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.489419 16390 ts_tablet_manager.cc:1403] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20251025 08:02:30.489776 16390 raft_consensus.cc:359] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.489845 16390 raft_consensus.cc:385] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.489871 16390 raft_consensus.cc:740] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.489988 16390 consensus_queue.cc:260] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.490226 16390 ts_tablet_manager.cc:1434] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.490372 16390 tablet_bootstrap.cc:492] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.491312 16390 tablet_bootstrap.cc:654] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.494616 16582 raft_consensus.cc:493] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.494701 16582 raft_consensus.cc:515] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.494997 16582 leader_election.cc:290] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.497231 16391 tablet_bootstrap.cc:492] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.497361 16391 ts_tablet_manager.cc:1403] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251025 08:02:30.498037 16391 raft_consensus.cc:359] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.498227 16391 raft_consensus.cc:385] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.498310 16391 raft_consensus.cc:740] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.498504 16391 consensus_queue.cc:260] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.499020 16391 ts_tablet_manager.cc:1434] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.499246 16391 tablet_bootstrap.cc:492] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.499601 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a3ec64b273d4e8c92b1e24061ac7336" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.499934 15049 leader_election.cc:343] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.501004 16391 tablet_bootstrap.cc:654] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.501242 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a3ec64b273d4e8c92b1e24061ac7336" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:30.501518 15048 leader_election.cc:343] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.501590 15048 leader_election.cc:304] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.501716 16582 raft_consensus.cc:2749] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.501940 16390 tablet_bootstrap.cc:492] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.502031 16390 ts_tablet_manager.cc:1403] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20251025 08:02:30.502430 16390 raft_consensus.cc:359] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.502524 16390 raft_consensus.cc:385] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.502558 16390 raft_consensus.cc:740] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.502663 16390 consensus_queue.cc:260] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.502916 16390 ts_tablet_manager.cc:1434] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.504328 16390 tablet_bootstrap.cc:492] T 24e0f02dd56644a3930c1cc0a972132e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.504654 16392 tablet_bootstrap.cc:492] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.504727 16392 ts_tablet_manager.cc:1403] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20251025 08:02:30.505192 16390 tablet_bootstrap.cc:654] T 24e0f02dd56644a3930c1cc0a972132e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.505126 16392 raft_consensus.cc:359] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.505249 16392 raft_consensus.cc:385] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.505280 16392 raft_consensus.cc:740] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.505391 16392 consensus_queue.cc:260] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.505663 16392 ts_tablet_manager.cc:1434] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.505865 16392 tablet_bootstrap.cc:492] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.506137 16391 tablet_bootstrap.cc:492] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.506268 16391 ts_tablet_manager.cc:1403] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251025 08:02:30.506698 16391 raft_consensus.cc:359] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.506783 16392 tablet_bootstrap.cc:654] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.506795 16391 raft_consensus.cc:385] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.506824 16391 raft_consensus.cc:740] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.506951 16391 consensus_queue.cc:260] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.507228 16391 ts_tablet_manager.cc:1434] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.507392 16391 tablet_bootstrap.cc:492] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.507736 15374 raft_consensus.cc:493] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.507800 15374 raft_consensus.cc:515] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.508057 15374 leader_election.cc:290] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.508479 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf34039d909949af9357299bf8204891" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.508572 15237 raft_consensus.cc:2468] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.508668 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf34039d909949af9357299bf8204891" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.508762 15114 raft_consensus.cc:2468] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.509018 14915 leader_election.cc:304] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:30.509112 16391 tablet_bootstrap.cc:654] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.509158 15374 raft_consensus.cc:2804] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.509236 15374 raft_consensus.cc:493] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.509286 15374 raft_consensus.cc:3060] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.510066 16390 tablet_bootstrap.cc:492] T 24e0f02dd56644a3930c1cc0a972132e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.510135 16390 ts_tablet_manager.cc:1403] T 24e0f02dd56644a3930c1cc0a972132e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:30.510174 15374 raft_consensus.cc:515] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.510614 16390 raft_consensus.cc:359] T 24e0f02dd56644a3930c1cc0a972132e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.510717 16390 raft_consensus.cc:385] T 24e0f02dd56644a3930c1cc0a972132e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.510748 16390 raft_consensus.cc:740] T 24e0f02dd56644a3930c1cc0a972132e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.510777 15374 leader_election.cc:290] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.510851 16390 consensus_queue.cc:260] T 24e0f02dd56644a3930c1cc0a972132e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.511119 16390 ts_tablet_manager.cc:1434] T 24e0f02dd56644a3930c1cc0a972132e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.511180 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf34039d909949af9357299bf8204891" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.511284 15114 raft_consensus.cc:3060] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.511297 16390 tablet_bootstrap.cc:492] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.512143 15114 raft_consensus.cc:2468] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.512200 16390 tablet_bootstrap.cc:654] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.512837 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bf34039d909949af9357299bf8204891" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.512861 14915 leader_election.cc:304] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:30.512933 15237 raft_consensus.cc:3060] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.513708 15237 raft_consensus.cc:2468] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.514387 15374 raft_consensus.cc:2804] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.514467 15374 raft_consensus.cc:697] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.514570 15374 consensus_queue.cc:237] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.515705 16392 tablet_bootstrap.cc:492] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.515858 16570 raft_consensus.cc:493] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.515924 16570 raft_consensus.cc:515] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.516220 16570 leader_election.cc:290] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.516495 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfe9add2f8bf450bb6f49ad57be2caae" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.516597 16392 ts_tablet_manager.cc:1403] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20251025 08:02:30.516592 14979 raft_consensus.cc:2468] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
W20251025 08:02:30.516808 15185 leader_election.cc:343] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: cfe9add2f8bf450bb6f49ad57be2caae
I20251025 08:02:30.516882 15183 leader_election.cc:304] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:30.517009 16570 raft_consensus.cc:2804] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.517053 16570 raft_consensus.cc:493] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.517091 16570 raft_consensus.cc:3060] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.517831 16570 raft_consensus.cc:515] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.518416 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfe9add2f8bf450bb6f49ad57be2caae" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.518507 14979 raft_consensus.cc:3060] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.518154 16570 leader_election.cc:290] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
W20251025 08:02:30.518879 15185 leader_election.cc:343] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: cfe9add2f8bf450bb6f49ad57be2caae
I20251025 08:02:30.519212 16392 raft_consensus.cc:359] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.519325 16392 raft_consensus.cc:385] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.519358 16392 raft_consensus.cc:740] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.519347 14979 raft_consensus.cc:2468] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.519449 16392 consensus_queue.cc:260] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.519706 16392 ts_tablet_manager.cc:1434] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20251025 08:02:30.519896 16392 tablet_bootstrap.cc:492] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.519975 15183 leader_election.cc:304] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:30.520179 16572 raft_consensus.cc:2804] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.520274 16572 raft_consensus.cc:697] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.520372 16572 consensus_queue.cc:237] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.520838 16392 tablet_bootstrap.cc:654] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.520844 16572 raft_consensus.cc:493] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.520903 16572 raft_consensus.cc:515] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.521162 16572 leader_election.cc:290] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.521426 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed5ed91e953d42afa9ebf9ab8b89d0e6" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.521522 14979 raft_consensus.cc:2468] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.521788 16390 tablet_bootstrap.cc:492] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.521807 15183 leader_election.cc:304] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.521862 16390 ts_tablet_manager.cc:1403] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20251025 08:02:30.522277 16390 raft_consensus.cc:359] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.522368 16390 raft_consensus.cc:385] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.522403 16390 raft_consensus.cc:740] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.522506 16390 consensus_queue.cc:260] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.522722 15384 raft_consensus.cc:2804] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.522760 16390 ts_tablet_manager.cc:1434] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.522933 16390 tablet_bootstrap.cc:492] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.523842 16390 tablet_bootstrap.cc:654] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.522768 15384 raft_consensus.cc:493] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.524003 15384 raft_consensus.cc:3060] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.524828 15384 raft_consensus.cc:515] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.524953 16391 tablet_bootstrap.cc:492] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.525027 16391 ts_tablet_manager.cc:1403] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251025 08:02:30.525159 15384 leader_election.cc:290] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.525416 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed5ed91e953d42afa9ebf9ab8b89d0e6" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.525420 16391 raft_consensus.cc:359] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.525516 14979 raft_consensus.cc:3060] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.525518 16391 raft_consensus.cc:385] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.525574 16391 raft_consensus.cc:740] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.525676 16391 consensus_queue.cc:260] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.525895 16391 ts_tablet_manager.cc:1434] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.525887 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed5ed91e953d42afa9ebf9ab8b89d0e6" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.525974 15112 raft_consensus.cc:3060] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.526336 14979 raft_consensus.cc:2468] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.526566 16392 tablet_bootstrap.cc:492] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.526639 16392 ts_tablet_manager.cc:1403] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20251025 08:02:30.526805 15183 leader_election.cc:304] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.526916 15112 raft_consensus.cc:2468] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.527082 16392 raft_consensus.cc:359] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.527364 16391 tablet_bootstrap.cc:492] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.528196 16391 tablet_bootstrap.cc:654] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.527175 16392 raft_consensus.cc:385] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.528646 16392 raft_consensus.cc:740] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.528792 16392 consensus_queue.cc:260] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.529109 16392 ts_tablet_manager.cc:1434] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.529162 15384 raft_consensus.cc:2804] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.529243 15384 raft_consensus.cc:697] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.529335 15384 consensus_queue.cc:237] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.529628 16392 tablet_bootstrap.cc:492] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.530478 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed5ed91e953d42afa9ebf9ab8b89d0e6" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.530570 15114 raft_consensus.cc:2376] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1. Re-sending same reply.
I20251025 08:02:30.530665 16392 tablet_bootstrap.cc:654] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.539630 16391 tablet_bootstrap.cc:492] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.539703 16391 ts_tablet_manager.cc:1403] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20251025 08:02:30.540020 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_cc90154d79cc47bd82be7afaff1b0186 [id=0a4629613477421ba329364dbb42a8b6]
I20251025 08:02:30.540055 16391 raft_consensus.cc:359] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.540176 16391 raft_consensus.cc:385] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.540205 16391 raft_consensus.cc:740] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.540308 16391 consensus_queue.cc:260] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.540518 16391 ts_tablet_manager.cc:1434] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.540668 16391 tablet_bootstrap.cc:492] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.541059 16570 raft_consensus.cc:493] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.541139 16570 raft_consensus.cc:515] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.541445 16570 leader_election.cc:290] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.541529 16391 tablet_bootstrap.cc:654] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.541913 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f814b8ab1c9747e4b7da69f0ef4f2eb4" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.542013 15114 raft_consensus.cc:2468] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.542362 16570 raft_consensus.cc:493] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.542429 16570 raft_consensus.cc:515] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.542443 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f814b8ab1c9747e4b7da69f0ef4f2eb4" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.542527 14979 raft_consensus.cc:2468] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.542707 16570 leader_election.cc:290] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:30.542845 15183 leader_election.cc:304] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.543020 16570 raft_consensus.cc:2804] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.543064 16570 raft_consensus.cc:493] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.543107 16570 raft_consensus.cc:3060] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.543102 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6cedb44483cf4f62acf52b90b6708dfb" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.543183 14979 raft_consensus.cc:2468] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.543533 15183 leader_election.cc:304] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.543660 16572 raft_consensus.cc:2804] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.543721 16572 raft_consensus.cc:493] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.543754 16572 raft_consensus.cc:3060] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.543973 16570 raft_consensus.cc:515] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.544257 16570 leader_election.cc:290] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.544523 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f814b8ab1c9747e4b7da69f0ef4f2eb4" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.544602 14979 raft_consensus.cc:3060] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.544653 16572 raft_consensus.cc:515] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.544979 16572 leader_election.cc:290] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:30.544965 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f814b8ab1c9747e4b7da69f0ef4f2eb4" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.545059 15112 raft_consensus.cc:3060] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.545377 14979 raft_consensus.cc:2468] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.545854 15183 leader_election.cc:304] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.545933 15112 raft_consensus.cc:2468] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.546015 16572 raft_consensus.cc:2804] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.546098 16572 raft_consensus.cc:697] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.546301 16572 consensus_queue.cc:237] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.546434 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6cedb44483cf4f62acf52b90b6708dfb" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.546516 15114 raft_consensus.cc:2468] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.547142 16582 raft_consensus.cc:493] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.547223 16582 raft_consensus.cc:515] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.547514 16582 leader_election.cc:290] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.547969 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d05bf0056dfc43eeb4105af559497bdc" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.548028 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d05bf0056dfc43eeb4105af559497bdc" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.548101 15237 raft_consensus.cc:2468] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.548126 14974 raft_consensus.cc:2468] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.548460 15048 leader_election.cc:304] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:30.548590 15642 raft_consensus.cc:2804] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.548637 15642 raft_consensus.cc:493] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.548674 15642 raft_consensus.cc:3060] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.549033 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6cedb44483cf4f62acf52b90b6708dfb" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.549129 15112 raft_consensus.cc:3060] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.549490 15642 raft_consensus.cc:515] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.549793 15642 leader_election.cc:290] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.549957 15112 raft_consensus.cc:2468] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.550212 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6cedb44483cf4f62acf52b90b6708dfb" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.550330 14979 raft_consensus.cc:3060] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.550468 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d05bf0056dfc43eeb4105af559497bdc" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.550572 14974 raft_consensus.cc:3060] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.551100 14979 raft_consensus.cc:2468] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.551471 14974 raft_consensus.cc:2468] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.551501 15183 leader_election.cc:304] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.551641 16572 raft_consensus.cc:2804] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.551723 16572 raft_consensus.cc:697] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.551748 15642 raft_consensus.cc:493] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.551807 15642 raft_consensus.cc:515] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.551841 16572 consensus_queue.cc:237] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.552093 15642 leader_election.cc:290] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.552237 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d05bf0056dfc43eeb4105af559497bdc" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.552327 15240 raft_consensus.cc:3060] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.553018 15048 leader_election.cc:304] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:30.553206 15240 raft_consensus.cc:2468] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.553244 15642 raft_consensus.cc:2804] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.553309 15642 raft_consensus.cc:697] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:30.553417 15642 consensus_queue.cc:237] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.553753 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "685d09c4a80b4d48b477cd4c0fc9db40" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.554224 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "685d09c4a80b4d48b477cd4c0fc9db40" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.554705 15864 consensus_queue.cc:1048] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:30.554836 15049 leader_election.cc:343] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.555387 15864 raft_consensus.cc:493] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.555459 15864 raft_consensus.cc:515] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.555725 15864 leader_election.cc:290] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:30.556025 15048 leader_election.cc:343] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.556085 15048 leader_election.cc:304] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.556490 15642 raft_consensus.cc:2749] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.559207 16572 raft_consensus.cc:493] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.559279 16572 raft_consensus.cc:515] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.559540 16572 leader_election.cc:290] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.559639 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3379087113041beba7ddbc6596c3b0a" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.559728 15240 raft_consensus.cc:2468] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.559924 14914 leader_election.cc:304] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.560011 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a941ba28528d41699390e9db80f25594" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.560098 14974 raft_consensus.cc:2468] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.560109 15864 raft_consensus.cc:2804] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.560155 15864 raft_consensus.cc:493] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.560139 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a941ba28528d41699390e9db80f25594" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.560191 15864 raft_consensus.cc:3060] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.560241 15114 raft_consensus.cc:2468] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.560433 15183 leader_election.cc:304] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.560539 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3379087113041beba7ddbc6596c3b0a" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.560621 15112 raft_consensus.cc:2468] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.560778 15384 raft_consensus.cc:2804] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.560830 15384 raft_consensus.cc:493] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.560870 15384 raft_consensus.cc:3060] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.561103 15864 raft_consensus.cc:515] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.561399 15864 leader_election.cc:290] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.561767 15384 raft_consensus.cc:515] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.561925 16392 tablet_bootstrap.cc:492] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.561992 16392 ts_tablet_manager.cc:1403] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20251025 08:02:30.562053 15384 leader_election.cc:290] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.562415 16392 raft_consensus.cc:359] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.562508 16392 raft_consensus.cc:385] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.562541 16392 raft_consensus.cc:740] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.562628 16392 consensus_queue.cc:260] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.562743 16572 raft_consensus.cc:493] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.562765 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3379087113041beba7ddbc6596c3b0a" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.562812 16572 raft_consensus.cc:515] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.562876 16392 ts_tablet_manager.cc:1434] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.562840 15240 raft_consensus.cc:3060] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.563022 16392 tablet_bootstrap.cc:492] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.563122 16572 leader_election.cc:290] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.563661 15240 raft_consensus.cc:2468] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.563884 16392 tablet_bootstrap.cc:654] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.564054 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a941ba28528d41699390e9db80f25594" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.564144 15114 raft_consensus.cc:3060] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.565063 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a941ba28528d41699390e9db80f25594" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.565145 14974 raft_consensus.cc:3060] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.565305 15114 raft_consensus.cc:2468] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.565462 14914 leader_election.cc:304] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.565670 15185 leader_election.cc:304] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.565817 15864 raft_consensus.cc:2804] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.565892 15864 raft_consensus.cc:697] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.565915 14974 raft_consensus.cc:2468] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.566017 15864 consensus_queue.cc:237] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.566105 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d162f3ee21bd40ce9a9c74b7863a3878" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.566228 14979 raft_consensus.cc:2468] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.566550 16572 raft_consensus.cc:2804] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.566702 15183 leader_election.cc:304] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.566815 15909 raft_consensus.cc:2804] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.566848 15909 raft_consensus.cc:493] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.566881 15909 raft_consensus.cc:3060] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.567636 15909 raft_consensus.cc:515] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.567919 15909 leader_election.cc:290] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.562438 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a3379087113041beba7ddbc6596c3b0a" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.566763 16572 raft_consensus.cc:697] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.568064 15112 raft_consensus.cc:3060] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.568104 16572 consensus_queue.cc:237] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.568949 15112 raft_consensus.cc:2468] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.569444 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d162f3ee21bd40ce9a9c74b7863a3878" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.569532 14979 raft_consensus.cc:3060] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.570051 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d162f3ee21bd40ce9a9c74b7863a3878" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.570153 15114 raft_consensus.cc:2468] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.570359 14979 raft_consensus.cc:2468] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.570595 15183 leader_election.cc:304] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.571175 16572 raft_consensus.cc:2804] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.571249 16572 raft_consensus.cc:697] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.571341 16572 consensus_queue.cc:237] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.572165 16391 tablet_bootstrap.cc:492] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.572233 16391 ts_tablet_manager.cc:1403] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.000s
I20251025 08:02:30.572592 16391 raft_consensus.cc:359] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.572670 16391 raft_consensus.cc:385] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.572695 16391 raft_consensus.cc:740] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.572775 16391 consensus_queue.cc:260] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.572525 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d162f3ee21bd40ce9a9c74b7863a3878" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.572862 15114 raft_consensus.cc:3060] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.573006 16391 ts_tablet_manager.cc:1434] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.573150 16391 tablet_bootstrap.cc:492] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.574112 16391 tablet_bootstrap.cc:654] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.575486 15114 raft_consensus.cc:2468] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
W20251025 08:02:30.578706 15185 consensus_peers.cc:597] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e762c440cb0947deb7e6a4186deebdc1. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:30.579919 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_4c672efab2bb448ab1dcfd4325e8c053 [id=0db3af0dc90e4ea5ac9a029e3864ce58]
I20251025 08:02:30.581341 16392 tablet_bootstrap.cc:492] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.581418 16392 ts_tablet_manager.cc:1403] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20251025 08:02:30.581784 16392 raft_consensus.cc:359] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.581887 16392 raft_consensus.cc:385] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.581916 16392 raft_consensus.cc:740] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.582011 16392 consensus_queue.cc:260] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.582289 16392 ts_tablet_manager.cc:1434] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.582449 16392 tablet_bootstrap.cc:492] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.583305 16392 tablet_bootstrap.cc:654] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.585703 15642 raft_consensus.cc:493] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.585788 15642 raft_consensus.cc:515] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.586176 15642 leader_election.cc:290] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.586575 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64996b8137f647b993923cb1bb093211" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.587231 15049 leader_election.cc:343] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.587324 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64996b8137f647b993923cb1bb093211" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:30.587765 15048 leader_election.cc:343] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.587831 15048 leader_election.cc:304] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.588280 15497 raft_consensus.cc:2749] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.589354 16391 tablet_bootstrap.cc:492] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.589434 16391 ts_tablet_manager.cc:1403] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.002s
I20251025 08:02:30.589867 16391 raft_consensus.cc:359] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.589989 16391 raft_consensus.cc:385] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.590022 16391 raft_consensus.cc:740] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.590123 16391 consensus_queue.cc:260] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.590436 16391 ts_tablet_manager.cc:1434] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.590623 16391 tablet_bootstrap.cc:492] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.591495 16391 tablet_bootstrap.cc:654] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.592530 16392 tablet_bootstrap.cc:492] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.592602 16392 ts_tablet_manager.cc:1403] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:30.593048 16392 raft_consensus.cc:359] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.593153 16392 raft_consensus.cc:385] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.593204 16392 raft_consensus.cc:740] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.593345 16392 consensus_queue.cc:260] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.593637 16392 ts_tablet_manager.cc:1434] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.593828 16392 tablet_bootstrap.cc:492] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.594676 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_96eed584de4f4711b66e6f802a78ca6f [id=115470413d904ac0a4a3acecc6e6723e]
I20251025 08:02:30.594905 16392 tablet_bootstrap.cc:654] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.594976 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_d03eda3087a54490a502678eeeeeabc8 [id=1297b3a21b8a458d80575525d6df9783]
I20251025 08:02:30.595203 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_49bbc2328aab41cda10e05a7fb925cd9 [id=1338885c63014b47bcd512a9ddfaf31d]
I20251025 08:02:30.595944 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_96ffee6ed67048c5bc78a91d739e8a02 [id=194a3dd184f4450da0604a85ace48fe9]
I20251025 08:02:30.596500 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95]
I20251025 08:02:30.596720 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_0762822d85ed47bc93809bd77c712935 [id=1e0739ca3fad4a22893a3453c3b2eac8]
I20251025 08:02:30.596825 14616 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
/tmp/dist-test-taskbKFzMV/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.70.61:44347
--webserver_interface=127.14.70.61
--webserver_port=41597
--builtin_ntp_servers=127.14.70.20:37905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20251025 08:02:30.597025 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_1ccbe630ac5a41ecb7b00087172bec38 [id=1e716be545914b22887b2f7e069c41c4]
I20251025 08:02:30.597219 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_08073379da334076bcc5503770a32982 [id=1ee33ee129d749d0bd7f26dc49fca0fe]
I20251025 08:02:30.597394 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_5d847a37cb0c456294cb5137046f80bb [id=1f6784494d0b4b98b46077a0af6c2ea8]
I20251025 08:02:30.597694 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_1ba04ec4ed664c8eaaeddbf2485375ae [id=2283253a9522485d93d6c484c5eef6e4]
I20251025 08:02:30.597899 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_89fbe6e89c5b4265a3becdf00dc8a9e2 [id=229b4804d467428f8028c82314a3c3fb]
I20251025 08:02:30.598841 15864 raft_consensus.cc:493] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.598927 15864 raft_consensus.cc:515] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.599227 15864 leader_election.cc:290] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.599761 16390 tablet_bootstrap.cc:492] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.599865 16390 ts_tablet_manager.cc:1403] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.077s user 0.002s sys 0.000s
I20251025 08:02:30.600124 16391 tablet_bootstrap.cc:492] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.600239 16391 ts_tablet_manager.cc:1403] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:30.600271 16392 tablet_bootstrap.cc:492] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.600342 16392 ts_tablet_manager.cc:1403] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20251025 08:02:30.600354 16390 raft_consensus.cc:359] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.600442 16390 raft_consensus.cc:385] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.600473 16390 raft_consensus.cc:740] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.600581 16390 consensus_queue.cc:260] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.600747 16392 raft_consensus.cc:359] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.600828 16392 raft_consensus.cc:385] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.600857 16392 raft_consensus.cc:740] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.600869 16390 ts_tablet_manager.cc:1434] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.600816 16391 raft_consensus.cc:359] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.600950 16391 raft_consensus.cc:385] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.601001 16391 raft_consensus.cc:740] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.600968 16392 consensus_queue.cc:260] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.601048 16390 tablet_bootstrap.cc:492] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.601222 16392 ts_tablet_manager.cc:1434] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.601164 16391 consensus_queue.cc:260] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.601352 16392 tablet_bootstrap.cc:492] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.601612 16391 ts_tablet_manager.cc:1434] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.601802 16391 tablet_bootstrap.cc:492] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.601974 16390 tablet_bootstrap.cc:654] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.604492 16391 tablet_bootstrap.cc:654] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.605185 16392 tablet_bootstrap.cc:654] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.605551 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09fccf0770604812940dd63106f7d993" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.605651 15240 raft_consensus.cc:2468] T 09fccf0770604812940dd63106f7d993 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.606319 14914 leader_election.cc:304] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.606516 15864 raft_consensus.cc:2804] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.606570 15864 raft_consensus.cc:493] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.606601 15864 raft_consensus.cc:3060] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.607513 15864 raft_consensus.cc:515] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.607565 16392 tablet_bootstrap.cc:492] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.607635 16392 ts_tablet_manager.cc:1403] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:30.607908 15864 leader_election.cc:290] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.608029 16392 raft_consensus.cc:359] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.608120 16392 raft_consensus.cc:385] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.608155 16392 raft_consensus.cc:740] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.608274 16392 consensus_queue.cc:260] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.608563 16392 ts_tablet_manager.cc:1434] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.608724 16392 tablet_bootstrap.cc:492] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.609618 16392 tablet_bootstrap.cc:654] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.610615 16392 tablet_bootstrap.cc:492] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.610692 16392 ts_tablet_manager.cc:1403] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.611186 16392 raft_consensus.cc:359] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.611296 16392 raft_consensus.cc:385] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.611333 16392 raft_consensus.cc:740] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.611459 16392 consensus_queue.cc:260] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.611815 16392 ts_tablet_manager.cc:1434] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.611984 16392 tablet_bootstrap.cc:492] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.612036 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09fccf0770604812940dd63106f7d993" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.612128 15239 raft_consensus.cc:3060] T 09fccf0770604812940dd63106f7d993 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.613022 16392 tablet_bootstrap.cc:654] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.613111 15239 raft_consensus.cc:2468] T 09fccf0770604812940dd63106f7d993 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.614230 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_19e4d10cf3d64b008591270ed9ee26f3 [id=2481098eb7b44b7ca9be9b9393a44523]
I20251025 08:02:30.614935 15497 raft_consensus.cc:493] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.615012 15497 raft_consensus.cc:515] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.615298 15497 leader_election.cc:290] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.615496 16390 tablet_bootstrap.cc:492] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.615564 16390 ts_tablet_manager.cc:1403] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251025 08:02:30.615729 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09fccf0770604812940dd63106f7d993" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.615818 15111 raft_consensus.cc:3060] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.615942 16390 raft_consensus.cc:359] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.616050 16390 raft_consensus.cc:385] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.616079 16390 raft_consensus.cc:740] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.616077 14914 leader_election.cc:304] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.616171 16390 consensus_queue.cc:260] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.616240 15864 raft_consensus.cc:2804] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.616367 15864 raft_consensus.cc:697] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.616429 16390 ts_tablet_manager.cc:1434] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.616466 15864 consensus_queue.cc:237] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.616592 16390 tablet_bootstrap.cc:492] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.616806 15111 raft_consensus.cc:2468] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.617527 16390 tablet_bootstrap.cc:654] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.618034 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "09fccf0770604812940dd63106f7d993" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.618119 15112 raft_consensus.cc:2376] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1. Re-sending same reply.
I20251025 08:02:30.618865 15642 raft_consensus.cc:493] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.618933 15642 raft_consensus.cc:515] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.619212 15642 leader_election.cc:290] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.619395 15864 consensus_queue.cc:1048] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.620167 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "24e0f02dd56644a3930c1cc0a972132e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.620263 15239 raft_consensus.cc:2468] T 24e0f02dd56644a3930c1cc0a972132e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.621891 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "24e0f02dd56644a3930c1cc0a972132e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.621984 14979 raft_consensus.cc:2468] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.622205 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f426e93af38e4e17b30cd01eea12dcac" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.622301 15049 leader_election.cc:304] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.622505 15642 raft_consensus.cc:2804] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.622550 15642 raft_consensus.cc:493] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.622584 15642 raft_consensus.cc:3060] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.623629 15642 raft_consensus.cc:515] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.623919 15642 leader_election.cc:290] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.624266 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f426e93af38e4e17b30cd01eea12dcac" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.624428 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "24e0f02dd56644a3930c1cc0a972132e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.624506 15237 raft_consensus.cc:3060] T 24e0f02dd56644a3930c1cc0a972132e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.625151 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_a6bf9c572cb3485f9ecced6d0d55877d [id=26a6f00041d04924b3e8eb2b279b55de]
I20251025 08:02:30.625404 15237 raft_consensus.cc:2468] T 24e0f02dd56644a3930c1cc0a972132e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.626096 16391 tablet_bootstrap.cc:492] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.626171 16391 ts_tablet_manager.cc:1403] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20251025 08:02:30.626722 16391 raft_consensus.cc:359] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.626827 16391 raft_consensus.cc:385] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.626870 16391 raft_consensus.cc:740] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.626961 16391 consensus_queue.cc:260] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.627303 16391 ts_tablet_manager.cc:1434] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20251025 08:02:30.625658 15048 leader_election.cc:343] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:30.628402 15049 leader_election.cc:343] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.628563 15049 leader_election.cc:304] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.628684 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "24e0f02dd56644a3930c1cc0a972132e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.628775 14974 raft_consensus.cc:3060] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.628854 15049 leader_election.cc:304] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.628994 16582 raft_consensus.cc:2749] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.629148 16582 raft_consensus.cc:2804] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.629213 16582 raft_consensus.cc:697] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:30.629310 16582 consensus_queue.cc:237] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.629586 14974 raft_consensus.cc:2468] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.630064 15864 consensus_queue.cc:1048] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.630205 15374 raft_consensus.cc:493] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.630270 15374 raft_consensus.cc:515] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.630532 15374 leader_election.cc:290] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.632997 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5cd481a98514f16bed3fb0bf5003526" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.636451 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d5cd481a98514f16bed3fb0bf5003526" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.636582 15114 raft_consensus.cc:2393] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:30.636811 14915 leader_election.cc:304] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.636986 15374 raft_consensus.cc:3060] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.637691 16392 tablet_bootstrap.cc:492] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.637759 16392 ts_tablet_manager.cc:1403] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.000s
I20251025 08:02:30.637763 15374 raft_consensus.cc:2749] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.638154 16392 raft_consensus.cc:359] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.638288 16392 raft_consensus.cc:385] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.638321 16392 raft_consensus.cc:740] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.638427 16392 consensus_queue.cc:260] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.638672 16392 ts_tablet_manager.cc:1434] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.638844 16392 tablet_bootstrap.cc:492] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.639753 16392 tablet_bootstrap.cc:654] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.642928 16570 consensus_queue.cc:1048] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.643661 15642 raft_consensus.cc:493] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.643726 15642 raft_consensus.cc:515] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.643961 15642 leader_election.cc:290] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.644268 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4d1c652b6a4420a81e03cd58c6dbc69" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.644516 15049 leader_election.cc:343] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.644776 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4d1c652b6a4420a81e03cd58c6dbc69" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:30.646363 15048 leader_election.cc:343] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.646651 15048 leader_election.cc:304] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.647284 15642 raft_consensus.cc:2749] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.652725 16391 tablet_bootstrap.cc:492] T 36cb8c32d8cb4fbb9be18767c0336506 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.653796 16391 tablet_bootstrap.cc:654] T 36cb8c32d8cb4fbb9be18767c0336506 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.655725 14974 raft_consensus.cc:3060] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.656924 15864 raft_consensus.cc:493] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.657003 15864 raft_consensus.cc:515] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.657284 15864 leader_election.cc:290] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.657706 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42e8a5ee7d6a42aaaf95c33617abff3f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.658605 15864 raft_consensus.cc:493] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.658613 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_ebce5278d348458e8ab930ddd6088775 [id=2de94631eeee41489ea858ed887de8c1]
I20251025 08:02:30.658680 15864 raft_consensus.cc:515] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.658767 16570 consensus_queue.cc:1048] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.658846 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_a6c6f65ea3444858aa562a65d71c4e77 [id=2ef2d72066f446619f9045da34df7814]
I20251025 08:02:30.658924 15864 leader_election.cc:290] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.659272 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_165ff894c5ab455e8daf5d1cf318b785 [id=325e0a7553e840c58179c04253e874dc]
I20251025 08:02:30.659426 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bea55cdfbf454d76920806886c3d2c4e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.659523 15237 raft_consensus.cc:2468] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.659785 16570 consensus_queue.cc:1048] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.660279 16392 tablet_bootstrap.cc:492] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.660346 16392 ts_tablet_manager.cc:1403] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.000s
I20251025 08:02:30.660724 16392 raft_consensus.cc:359] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.660809 16392 raft_consensus.cc:385] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.660838 16392 raft_consensus.cc:740] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.660965 16392 consensus_queue.cc:260] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.661224 16392 ts_tablet_manager.cc:1434] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.661365 16392 tablet_bootstrap.cc:492] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.662397 14914 leader_election.cc:304] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.662441 16392 tablet_bootstrap.cc:654] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.662603 15864 raft_consensus.cc:2804] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.662658 15864 raft_consensus.cc:493] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.662700 15864 raft_consensus.cc:3060] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.663059 15380 raft_consensus.cc:493] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.663133 15380 raft_consensus.cc:515] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.663422 15380 leader_election.cc:290] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.663496 15864 raft_consensus.cc:515] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.663717 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_fe4cbb31d8584609ab3669f24baa8c27 [id=33bbe4605d924011b9002a939a73203d]
I20251025 08:02:30.663779 15864 leader_election.cc:290] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.664150 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bea55cdfbf454d76920806886c3d2c4e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.664254 15237 raft_consensus.cc:3060] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.664384 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85c7748077184fdda472821a0826cd77" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.665076 15049 leader_election.cc:343] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.665144 15237 raft_consensus.cc:2468] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.665529 14914 leader_election.cc:304] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.665663 15864 raft_consensus.cc:2804] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.665774 15864 raft_consensus.cc:697] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.665779 16390 tablet_bootstrap.cc:492] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.665844 16390 ts_tablet_manager.cc:1403] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.049s user 0.002s sys 0.000s
I20251025 08:02:30.665872 15864 consensus_queue.cc:237] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.666232 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_ddaa9d9bb575414e95d302ba39e4df09 [id=34a3343e709b46128ae84467e02e48de]
I20251025 08:02:30.666281 16390 raft_consensus.cc:359] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.666370 16390 raft_consensus.cc:385] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.666404 16390 raft_consensus.cc:740] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.666534 16390 consensus_queue.cc:260] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.666821 16390 ts_tablet_manager.cc:1434] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.667011 16390 tablet_bootstrap.cc:492] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.667945 16390 tablet_bootstrap.cc:654] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.668315 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_cce271e6706043dabfbd2c4b55bf198b [id=3a6e3a35c29b486b9ed32bc6fe1ec042]
I20251025 08:02:30.668944 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_c8ac7973eef94a68bf4ebe1459c2e6e6 [id=3c371b3791fd45be983458cd55d67827]
I20251025 08:02:30.669173 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_67238f79fb2446bd9c19c32182814dd0 [id=3c97ef2101a945cd900b30a00a1c8459]
I20251025 08:02:30.669751 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_754e539219a14fbba92f1f3fe54b0f2e [id=3e1281c3f28346a4a1dd2c4fcc990a2e]
I20251025 08:02:30.671482 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24]
I20251025 08:02:30.671983 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]
I20251025 08:02:30.672703 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_b9669fd414104dcca80167117a5b0ed7 [id=431195fe6a3847caa5b39d62cb399ffb]
I20251025 08:02:30.672972 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_9c7e0359120c415cba47b89251b0be94 [id=4510ebbcd6ee43babe7ee133a0ce6ae5]
I20251025 08:02:30.676184 16572 consensus_queue.cc:1048] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.676651 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85c7748077184fdda472821a0826cd77" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.676648 16570 consensus_queue.cc:1048] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.676707 15642 raft_consensus.cc:493] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.676784 15642 raft_consensus.cc:515] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.677052 15642 leader_election.cc:290] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.677333 16582 raft_consensus.cc:493] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.677397 16582 raft_consensus.cc:515] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.677608 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bea55cdfbf454d76920806886c3d2c4e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.677675 16582 leader_election.cc:290] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.677697 15111 raft_consensus.cc:3060] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.677791 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "42e8a5ee7d6a42aaaf95c33617abff3f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.677991 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "bea55cdfbf454d76920806886c3d2c4e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
W20251025 08:02:30.678210 15048 leader_election.cc:343] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.678293 15048 leader_election.cc:304] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.678489 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_87199a6b9d0a48909e5a74fb64314424 [id=4620fcb32741453f9d1ae07209213d59]
I20251025 08:02:30.678494 15642 raft_consensus.cc:2749] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.678725 15111 raft_consensus.cc:2468] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.678823 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_a9afe52cc64243a295d043eb385ef7d9 [id=46383e9b028a4d2bb7b39e04f147491e]
I20251025 08:02:30.679020 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14b47bf733754b72b34bd74aa033afa3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.679100 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93d383e3e2f4493d9cc8a71a4284e107" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.679148 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_ec7c18f36d434e0b9d294354387082e6 [id=4644ba57f12f4ad4bf7e89f80c4cd161]
I20251025 08:02:30.679220 14974 raft_consensus.cc:2468] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.679821 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93d383e3e2f4493d9cc8a71a4284e107" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.679910 15237 raft_consensus.cc:2468] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.679729 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_14a3c11816aa4e2d93e0a9912024dbd2 [id=4e3924f6f712459db0d167bb72825701]
I20251025 08:02:30.680366 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14b47bf733754b72b34bd74aa033afa3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.680459 15237 raft_consensus.cc:2468] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.680639 15049 leader_election.cc:304] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.680856 15642 raft_consensus.cc:2804] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.680922 15642 raft_consensus.cc:493] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.680960 15642 raft_consensus.cc:3060] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.681830 15642 raft_consensus.cc:515] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.682104 15642 leader_election.cc:290] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.682471 15049 leader_election.cc:304] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.682765 15380 raft_consensus.cc:2804] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.682811 15380 raft_consensus.cc:493] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.682847 15380 raft_consensus.cc:3060] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.683678 15380 raft_consensus.cc:515] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.683969 15380 leader_election.cc:290] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.684607 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93d383e3e2f4493d9cc8a71a4284e107" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.684705 15237 raft_consensus.cc:3060] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.685565 15237 raft_consensus.cc:2468] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.686268 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14b47bf733754b72b34bd74aa033afa3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.686364 15237 raft_consensus.cc:3060] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.687157 15237 raft_consensus.cc:2468] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.687469 14915 leader_election.cc:304] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.687654 15864 raft_consensus.cc:2749] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251025 08:02:30.687767 15049 leader_election.cc:304] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.687916 15642 raft_consensus.cc:2804] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.688033 15642 raft_consensus.cc:697] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:30.688179 15642 consensus_queue.cc:237] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.688957 15049 leader_election.cc:304] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.689329 15380 raft_consensus.cc:2804] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.689419 15380 raft_consensus.cc:697] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:30.689553 15380 consensus_queue.cc:237] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.690531 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "93d383e3e2f4493d9cc8a71a4284e107" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.690636 14974 raft_consensus.cc:3060] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.691413 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "14b47bf733754b72b34bd74aa033afa3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.691551 14974 raft_consensus.cc:2468] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.692232 16392 tablet_bootstrap.cc:492] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.692329 16392 ts_tablet_manager.cc:1403] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20251025 08:02:30.692759 16392 raft_consensus.cc:359] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.692862 16392 raft_consensus.cc:385] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.692899 16392 raft_consensus.cc:740] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.692937 16390 tablet_bootstrap.cc:492] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.693030 16390 ts_tablet_manager.cc:1403] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.000s
I20251025 08:02:30.693006 16392 consensus_queue.cc:260] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.693274 16392 ts_tablet_manager.cc:1434] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.693455 16392 tablet_bootstrap.cc:492] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.693452 16390 raft_consensus.cc:359] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.693543 16390 raft_consensus.cc:385] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.693583 16390 raft_consensus.cc:740] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.693691 16390 consensus_queue.cc:260] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:30.693712 15048 leader_election.cc:343] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.693994 16390 ts_tablet_manager.cc:1434] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.694206 16390 tablet_bootstrap.cc:492] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.695058 16390 tablet_bootstrap.cc:654] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.696303 15497 raft_consensus.cc:493] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.696383 15497 raft_consensus.cc:515] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.696517 16570 consensus_queue.cc:1048] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.696660 15497 leader_election.cc:290] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.696987 16570 raft_consensus.cc:493] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.697067 16570 raft_consensus.cc:515] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.697364 16570 leader_election.cc:290] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.697405 16392 tablet_bootstrap.cc:654] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.697779 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bb5b825be9a44d489151239947d471e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.697885 15112 raft_consensus.cc:2468] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.698220 15185 leader_election.cc:304] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.698391 16570 raft_consensus.cc:2804] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.698429 16570 raft_consensus.cc:493] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.698458 16570 raft_consensus.cc:3060] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:30.698643 15048 leader_election.cc:343] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.699275 16570 raft_consensus.cc:515] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.699553 16570 leader_election.cc:290] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.699815 14979 raft_consensus.cc:3060] T 1dd5a31508964130828ee0367a3317ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.700052 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bb5b825be9a44d489151239947d471e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.700134 15112 raft_consensus.cc:3060] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.700289 16391 tablet_bootstrap.cc:492] T 36cb8c32d8cb4fbb9be18767c0336506 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.700356 16391 ts_tablet_manager.cc:1403] T 36cb8c32d8cb4fbb9be18767c0336506 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.001s
I20251025 08:02:30.700742 16391 raft_consensus.cc:359] T 36cb8c32d8cb4fbb9be18767c0336506 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.700815 16391 raft_consensus.cc:385] T 36cb8c32d8cb4fbb9be18767c0336506 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.700840 16391 raft_consensus.cc:740] T 36cb8c32d8cb4fbb9be18767c0336506 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.700944 16391 consensus_queue.cc:260] T 36cb8c32d8cb4fbb9be18767c0336506 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.701066 15112 raft_consensus.cc:2468] T 9bb5b825be9a44d489151239947d471e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.701182 16391 ts_tablet_manager.cc:1434] T 36cb8c32d8cb4fbb9be18767c0336506 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.701328 16391 tablet_bootstrap.cc:492] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.701695 15185 leader_election.cc:304] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.701918 16570 raft_consensus.cc:2804] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.702004 16570 raft_consensus.cc:697] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.702169 16391 tablet_bootstrap.cc:654] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.702126 16570 consensus_queue.cc:237] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.703018 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bb5b825be9a44d489151239947d471e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.703114 14979 raft_consensus.cc:2468] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.703513 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "442d83935a0a41658508e3022f4b557f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.703925 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9bb5b825be9a44d489151239947d471e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.704011 14979 raft_consensus.cc:3060] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.704121 15497 consensus_queue.cc:1048] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.704754 15497 raft_consensus.cc:493] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.704778 14979 raft_consensus.cc:2468] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.704828 15497 raft_consensus.cc:515] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.705121 15497 leader_election.cc:290] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.705245 16572 consensus_queue.cc:1048] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:30.705400 15049 leader_election.cc:343] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.706065 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d16499315044408ad4bc1dca6341ed5" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.707057 15049 leader_election.cc:343] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.707293 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b [id=4e47e7759fc64598807f1ee3a973820f]
I20251025 08:02:30.707700 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b]
I20251025 08:02:30.707976 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_df3848a55c7646b1bd519eb12aa88aa1 [id=5160fad54600448f8b2c5bfc942f60a2]
I20251025 08:02:30.708261 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_d8110cf18c6748b092f8bf7348349f88 [id=53d57abf556c4926b02a1e265cf34c61]
I20251025 08:02:30.708926 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_9ad25f68a3a040818a9cd919b194b424 [id=5c3e59374e02472bb347c7891cb16537]
I20251025 08:02:30.709518 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_c2e0c935fdb34bc38f482cac268ad080 [id=62e3c831964e4f71a8ee6aca23069b44]
I20251025 08:02:30.709895 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_911ed9daff7b411c80d61a5a6ca9c623 [id=64be55e8604a4eb2b9cdf27d75e0e546]
I20251025 08:02:30.710438 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056]
I20251025 08:02:30.711059 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_d77beb2fdfdd42e5b1a16072888cfcac [id=6a04bdbf8b9046c59dc87dd393367134]
I20251025 08:02:30.711387 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_889a72b0cc55456889c7b37190901b20 [id=6b4ebc3c554648b48d6ea2f5916e1bad]
I20251025 08:02:30.711659 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]
I20251025 08:02:30.713979 16390 tablet_bootstrap.cc:492] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.714067 16390 ts_tablet_manager.cc:1403] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20251025 08:02:30.714659 16390 raft_consensus.cc:359] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.714749 16390 raft_consensus.cc:385] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.714783 16390 raft_consensus.cc:740] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.714895 16390 consensus_queue.cc:260] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.715147 16390 ts_tablet_manager.cc:1434] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.715327 16390 tablet_bootstrap.cc:492] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.716178 16390 tablet_bootstrap.cc:654] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.716629 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_20420bbacfa743d4ad1ed935423c4ff5 [id=6c847ade4b8f485fb3353af3d2ec442b]
I20251025 08:02:30.718341 16199 consensus_queue.cc:1048] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.720507 16570 consensus_queue.cc:1048] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.721341 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_7c6a96cbfd864aa9842d67953f6853d4 [id=6f74f5eecc0b48a48a191ee958d7a651]
I20251025 08:02:30.721648 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_ea3622c669ee4aa5a2b88a9e87aeadaf [id=72243e33e90940c09953a9ec2fcfd435]
I20251025 08:02:30.721936 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09]
I20251025 08:02:30.722290 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_fa7f3472406144b795d1ec3e8669bf04 [id=73c88284db0345458af97c86039f6c5d]
I20251025 08:02:30.722498 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_154bf3fb109a4052a26aed5719b8cd1d [id=73dc21342ffe4d88bcee8530555b260d]
I20251025 08:02:30.722807 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_3d5f1adc46e8481386de4051dd453445 [id=7481684b10d946299ea5a1f0918a2407]
I20251025 08:02:30.723407 16392 tablet_bootstrap.cc:492] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.723476 16392 ts_tablet_manager.cc:1403] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20251025 08:02:30.723834 16392 raft_consensus.cc:359] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.723908 16392 raft_consensus.cc:385] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.723935 16392 raft_consensus.cc:740] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.724038 16392 consensus_queue.cc:260] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.724282 16392 ts_tablet_manager.cc:1434] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.724403 16392 tablet_bootstrap.cc:492] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.725183 16392 tablet_bootstrap.cc:654] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.726444 16570 consensus_queue.cc:1048] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.726500 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_85a7a7da077848fe960699e536360b41 [id=76245c883dcd4a6d8526bfc7ac12f4cb]
I20251025 08:02:30.726953 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_e0041c8cf73f46c5b49515b6f328f500 [id=768625af4c474964ad2b502cf0b03fa7]
I20251025 08:02:30.727319 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_e9a56ee98afd4b14bb77f82f256e8379 [id=7769118047914c3eb51e98a441aa5c50]
I20251025 08:02:30.727568 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_8001f289cc1341ce83a82f259b0255f1 [id=786fb14e6748434da35e7a7da1289963]
I20251025 08:02:30.727905 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_37152b4a34aa41dbbf4a0be51631faf9 [id=7956205ae4e9408988c3d82c46db1706]
I20251025 08:02:30.728181 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_1068ad8fb18a4d21954bb70b20fd5760 [id=79c76995e71143438cb6e30a9df85c31]
I20251025 08:02:30.728654 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "442d83935a0a41658508e3022f4b557f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.728982 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_0ac9d6fdd08b48f0b70da65d5f7a722a [id=7c9a46c4cada46ad916b89605c18190f]
I20251025 08:02:30.729362 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_25e0298aad614dba82f598191e458567 [id=7edb1b5b68864e54b6366186a8915fcf]
I20251025 08:02:30.729718 16570 raft_consensus.cc:493] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.729796 16570 raft_consensus.cc:515] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.730108 16570 leader_election.cc:290] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.730527 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1927cf6a9013402a92c9e6e89e2e1715" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.730623 14973 raft_consensus.cc:2468] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.730894 15183 leader_election.cc:304] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.731042 16570 raft_consensus.cc:2804] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.731029 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1927cf6a9013402a92c9e6e89e2e1715" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.731088 16570 raft_consensus.cc:493] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.731120 16570 raft_consensus.cc:3060] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.731124 15111 raft_consensus.cc:2468] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.731935 16570 raft_consensus.cc:515] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.732234 16570 leader_election.cc:290] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.732498 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1927cf6a9013402a92c9e6e89e2e1715" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.732607 15111 raft_consensus.cc:3060] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.732656 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1927cf6a9013402a92c9e6e89e2e1715" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.732738 14973 raft_consensus.cc:3060] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.733094 16966 consensus_queue.cc:1048] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.733579 15111 raft_consensus.cc:2468] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.734042 14973 raft_consensus.cc:2468] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.734404 15185 leader_election.cc:304] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.734447 16392 tablet_bootstrap.cc:492] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.734519 16392 ts_tablet_manager.cc:1403] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:30.734644 15864 raft_consensus.cc:493] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.734707 15864 raft_consensus.cc:515] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.734833 16572 raft_consensus.cc:2804] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.734907 16572 raft_consensus.cc:697] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.734928 16392 raft_consensus.cc:359] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.735013 16392 raft_consensus.cc:385] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.735006 15864 leader_election.cc:290] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.735049 16392 raft_consensus.cc:740] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.735020 16572 consensus_queue.cc:237] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.735146 16392 consensus_queue.cc:260] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.735405 16392 ts_tablet_manager.cc:1434] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.735570 16392 tablet_bootstrap.cc:492] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.735826 16570 consensus_queue.cc:1048] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.736613 16392 tablet_bootstrap.cc:654] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.737262 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23eedc2695db43afbd6f5dbebb0ea2be" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.737354 15240 raft_consensus.cc:2468] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.737560 15909 consensus_queue.cc:1048] T 1dd5a31508964130828ee0367a3317ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.737627 14914 leader_election.cc:304] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.737766 15864 raft_consensus.cc:2804] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.737807 15864 raft_consensus.cc:493] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.737844 15864 raft_consensus.cc:3060] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.730671 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_5228048f3783458dbb44280a7a6e4816 [id=7fe739c2f676459d8c73632266babedb]
I20251025 08:02:30.738655 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_221091e6cc7f49d0ba8ff4c967382bce [id=816e76daa7934c3498290c4154c8fce3]
I20251025 08:02:30.738692 15864 raft_consensus.cc:515] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.738849 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_6c4b782dd6a04a1bbeb82b8537829558 [id=838e1bc6ed30426ba4dd16cc04efb68e]
I20251025 08:02:30.739027 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]
I20251025 08:02:30.739028 15864 leader_election.cc:290] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.739711 16390 tablet_bootstrap.cc:492] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.739794 16390 ts_tablet_manager.cc:1403] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.001s
I20251025 08:02:30.740284 16390 raft_consensus.cc:359] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.740386 16390 raft_consensus.cc:385] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.740427 16390 raft_consensus.cc:740] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.740547 16390 consensus_queue.cc:260] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.740855 16390 ts_tablet_manager.cc:1434] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.741273 16390 tablet_bootstrap.cc:492] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.742461 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23eedc2695db43afbd6f5dbebb0ea2be" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.742573 15240 raft_consensus.cc:3060] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.743163 16966 raft_consensus.cc:493] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.743243 16966 raft_consensus.cc:515] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.743571 16966 leader_election.cc:290] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.743598 15240 raft_consensus.cc:2468] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.743707 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d16499315044408ad4bc1dca6341ed5" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.743891 14914 leader_election.cc:304] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.744099 16857 raft_consensus.cc:2804] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.744163 16857 raft_consensus.cc:697] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.744261 16857 consensus_queue.cc:237] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.745065 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55db2958c76e4886b807fdb237f9b2a9" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.745792 15049 leader_election.cc:343] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.746311 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_5a29e7dba4ba43dfbd0c27981080a1ac [id=8611464429b848fbb277f6a03557cd0d]
I20251025 08:02:30.746970 16390 tablet_bootstrap.cc:654] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.748227 16392 tablet_bootstrap.cc:492] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.748325 16392 ts_tablet_manager.cc:1403] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20251025 08:02:30.748553 15909 consensus_queue.cc:1048] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.748723 16570 consensus_queue.cc:1048] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.748920 16392 raft_consensus.cc:359] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.749024 16392 raft_consensus.cc:385] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.749070 16392 raft_consensus.cc:740] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.749168 16392 consensus_queue.cc:260] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.749537 16392 ts_tablet_manager.cc:1434] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:30.749693 16392 tablet_bootstrap.cc:492] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.749408 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_beff096618394ac1b31db74a94a9f991 [id=8a0e4fe9e4544c539cb23b0279c1deaf]
I20251025 08:02:30.750156 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_1294a307080744bd964b420814ae843f [id=8be0a7e83b634a6b90b3bf1bb535585c]
I20251025 08:02:30.750418 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031]
I20251025 08:02:30.750660 16392 tablet_bootstrap.cc:654] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.750648 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_27c6a21fc727493fba3613698ba9e108 [id=8e0aa39fb7de4352b22bd41fb1313236]
I20251025 08:02:30.752075 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_cac23e61bde0461d9772761aba8b3abb [id=8f399d7e1e774ee79ae9b9892dbc2d18]
I20251025 08:02:30.752310 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_8c890e1813a149b88e2168cf6a19b056 [id=90132a732dd24174a9b63820b5ce85f6]
I20251025 08:02:30.752519 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_3c48d3160e5d42509de4f0be1af855e2 [id=912da5ef8bbf4af29528c084ea7fa633]
I20251025 08:02:30.753058 16966 raft_consensus.cc:493] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.753126 16966 raft_consensus.cc:515] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:30.753300 15048 leader_election.cc:343] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.753407 15048 leader_election.cc:304] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.753474 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23eedc2695db43afbd6f5dbebb0ea2be" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.753574 15114 raft_consensus.cc:2468] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.753726 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "23eedc2695db43afbd6f5dbebb0ea2be" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.753584 15642 raft_consensus.cc:2749] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.753793 15113 raft_consensus.cc:3060] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.754838 15113 raft_consensus.cc:2468] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.753412 16966 leader_election.cc:290] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.755576 15380 raft_consensus.cc:493] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.755653 15380 raft_consensus.cc:515] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.755934 15380 leader_election.cc:290] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.758226 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce5ae591c86c4455a1dd3704f1c95d1c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.758327 15380 raft_consensus.cc:493] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.758387 15380 raft_consensus.cc:515] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.758423 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "36cb8c32d8cb4fbb9be18767c0336506" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.758695 15049 leader_election.cc:343] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.758693 15380 leader_election.cc:290] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:30.759083 15049 leader_election.cc:343] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.759382 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "454a76de5e2c421ab035e6cf1a958c11" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.759654 15049 leader_election.cc:343] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.761502 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_a4db03b0afac4934abd7b889be3d9f30 [id=9759ac18bd46453eab5a8c294a229886]
W20251025 08:02:30.753793 15048 leader_election.cc:343] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.764523 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_215d6056104143a2a5c44b771c493865 [id=9926090b33ae4c169603cb1673d71c87]
I20251025 08:02:30.764777 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_78daee932a6e4b46b0271ad11e4715c8 [id=9a293f6565184a56a16bf3e755444870]
I20251025 08:02:30.765022 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_05bac665c2114dacac7804da6adfc06e [id=9aee333b5b9f4e1daba6449f643ea43a]
I20251025 08:02:30.764204 15048 leader_election.cc:304] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.766024 15642 raft_consensus.cc:2749] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.766148 15642 consensus_queue.cc:1048] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.766331 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_e3dddd8db8a64833bd7de5ad2fec599a [id=9b1cfdaffd964fba879de8e58c7ac93c]
I20251025 08:02:30.766825 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]
I20251025 08:02:30.767794 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55db2958c76e4886b807fdb237f9b2a9" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.768157 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_c6928dca846645b8887db36cc7cb9675 [id=9d1a6ae0121b45cda008d5dda6ea7e35]
I20251025 08:02:30.768574 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_6ae9d9f6f9b942e689eecb0548fdf715 [id=a1ed1a0c27ef42c69acd197420340d7d]
I20251025 08:02:30.768651 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce5ae591c86c4455a1dd3704f1c95d1c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.768898 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8]
W20251025 08:02:30.769318 15048 leader_election.cc:343] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.769382 15048 leader_election.cc:304] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:30.769701 15048 leader_election.cc:343] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.769768 15048 leader_election.cc:304] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.769702 15497 raft_consensus.cc:2749] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.769898 15497 raft_consensus.cc:2749] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.770586 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "36cb8c32d8cb4fbb9be18767c0336506" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.770702 14973 raft_consensus.cc:2468] T 36cb8c32d8cb4fbb9be18767c0336506 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:30.770968 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "454a76de5e2c421ab035e6cf1a958c11" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.771133 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_0517aaafe6e64827b84bb99171d2ad75 [id=a8e0504bc08744b4915157fa63d2226e]
I20251025 08:02:30.773236 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_789c5c7cc2df43f4b7c5c63316f47042 [id=aa46eca7031242f3b4a3144dd521cc6b]
I20251025 08:02:30.773576 15384 consensus_queue.cc:1048] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.774709 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_b074f35366374acd92bf7528094773a0 [id=afe8a5e6aa824ba69530f71c2b2d4617]
I20251025 08:02:30.774818 15384 consensus_queue.cc:1048] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.774940 16391 tablet_bootstrap.cc:492] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.775007 16391 ts_tablet_manager.cc:1403] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.074s user 0.000s sys 0.001s
I20251025 08:02:30.775405 16391 raft_consensus.cc:359] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.775499 16391 raft_consensus.cc:385] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.775534 16391 raft_consensus.cc:740] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.775651 16391 consensus_queue.cc:260] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.775933 16391 ts_tablet_manager.cc:1434] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.776222 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_9d8c68374942454a8e7c869e8cef206f [id=b228e3c8480f475ca877713e168bcba8]
I20251025 08:02:30.780094 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_fa9d9b9a535648d89d19b74bb940ed9f [id=b3e6b8f18f2f40fc977b978d7d2c1b0b]
I20251025 08:02:30.772505 15048 leader_election.cc:304] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.780426 15642 raft_consensus.cc:2804] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.780480 15642 raft_consensus.cc:493] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.780524 15642 raft_consensus.cc:3060] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.780606 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_b3ddde442f824bc6986a5d2e95a6b069 [id=b43a2ee282444f159384bc0849691707]
I20251025 08:02:30.780827 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_155857795087477392a338e28fb60afc [id=b58927a3527c45cb946d1fcc0681d6bf]
I20251025 08:02:30.781023 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_c13a8bad402148f19fcdc19766286842 [id=b5be4f412cc04aa59c819d0e1cc403bf]
I20251025 08:02:30.781240 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_75b0519af19a461d8dd5bdfd0c7a50c5 [id=b73d5c5cd3824129b9efc54f3aa7c304]
I20251025 08:02:30.781482 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_3447d48d82304580af188ed3290be5af [id=b80518faef5b4348a9247367008e0992]
I20251025 08:02:30.781507 15642 raft_consensus.cc:515] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.781690 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_599c0d46a95d45b4aa9bab3b54b52470 [id=b8e6ffed1a2e442db3c9ee5ac1a6ff3d]
I20251025 08:02:30.781821 15642 leader_election.cc:290] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.782243 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "36cb8c32d8cb4fbb9be18767c0336506" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
W20251025 08:02:30.782599 15049 leader_election.cc:343] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.783356 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064]
W20251025 08:02:30.783434 15048 leader_election.cc:343] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.783495 15048 leader_election.cc:304] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.783833 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_9f2128ef54374befaec2adc1a1295f27 [id=bc094a879104430797416fd06811a2e3]
I20251025 08:02:30.783879 16391 tablet_bootstrap.cc:492] T 8b69d792862540b6ad1b5d56dea17499 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.783921 15642 raft_consensus.cc:2749] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.784148 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_aa5c70a86540451b8a07688d25edc3b7 [id=bd246e92f35b47a2864b5da042da3232]
I20251025 08:02:30.784543 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_b1d8db45b7d745a0b4dd9ff09300da89 [id=be37bd4a45da444e83846233c335d445]
I20251025 08:02:30.784857 16391 tablet_bootstrap.cc:654] T 8b69d792862540b6ad1b5d56dea17499 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.785151 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_d9fe75661236465ca4c58953ed0023c4 [id=c0f5ecd0d89d409785fbd905d22e3fc2]
I20251025 08:02:30.786134 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_85ecb3ae3f1a4810b5abcb29f861e881 [id=c1cc91015b38477f93e56504bf700ffb]
I20251025 08:02:30.786209 15380 consensus_queue.cc:1048] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.786552 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_59553db1e7714c3b8a827e02fa059e1e [id=c2a7a02e46184b638b19f9a95da2eda8]
I20251025 08:02:30.787022 15864 consensus_queue.cc:1048] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.787292 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_d69575be86d241a797b7167bbe70fa79 [id=c3b6a46013fd4221a273b1842765f917]
I20251025 08:02:30.788592 15864 consensus_queue.cc:1048] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.789496 15909 raft_consensus.cc:493] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.789572 15909 raft_consensus.cc:515] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.789840 15909 leader_election.cc:290] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.790336 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64996b8137f647b993923cb1bb093211" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.790428 15110 raft_consensus.cc:2468] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.790668 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "36cb8c32d8cb4fbb9be18767c0336506" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.790755 14973 raft_consensus.cc:3060] T 36cb8c32d8cb4fbb9be18767c0336506 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.790858 15185 leader_election.cc:304] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.791003 15909 raft_consensus.cc:2804] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.791049 15909 raft_consensus.cc:493] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.791085 15909 raft_consensus.cc:3060] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.791673 14973 raft_consensus.cc:2468] T 36cb8c32d8cb4fbb9be18767c0336506 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:30.791977 15909 raft_consensus.cc:515] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.792294 15909 leader_election.cc:290] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.792726 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64996b8137f647b993923cb1bb093211" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.792763 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64996b8137f647b993923cb1bb093211" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.792739 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64996b8137f647b993923cb1bb093211" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.792840 15110 raft_consensus.cc:3060] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:30.793192 15183 leader_election.cc:343] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:30.793358 15183 leader_election.cc:343] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.793509 16390 tablet_bootstrap.cc:492] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.793582 16390 ts_tablet_manager.cc:1403] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.000s
I20251025 08:02:30.793733 15110 raft_consensus.cc:2468] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.793977 16390 raft_consensus.cc:359] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.794086 16390 raft_consensus.cc:385] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.794056 15909 consensus_queue.cc:1048] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.794121 16390 raft_consensus.cc:740] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.794258 16390 consensus_queue.cc:260] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.794338 15909 raft_consensus.cc:493] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.794414 15909 raft_consensus.cc:515] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.794592 15185 leader_election.cc:304] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:30.794701 15909 leader_election.cc:290] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.794786 15909 raft_consensus.cc:2804] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.794849 15909 raft_consensus.cc:697] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.794986 15909 consensus_queue.cc:237] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.795143 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "36cb8c32d8cb4fbb9be18767c0336506" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.795276 14973 raft_consensus.cc:2393] T 36cb8c32d8cb4fbb9be18767c0336506 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:30.796226 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "36cb8c32d8cb4fbb9be18767c0336506" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.796358 15110 raft_consensus.cc:2393] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:30.796644 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]
I20251025 08:02:30.796640 15185 leader_election.cc:304] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:30.796926 16390 ts_tablet_manager.cc:1434] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:30.797094 16390 tablet_bootstrap.cc:492] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.798015 16390 tablet_bootstrap.cc:654] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.798449 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_a901c364849c4301910d7c32f0ec25fc [id=cadc2427db7c404cbbf9d3542145cccc]
I20251025 08:02:30.798641 16199 raft_consensus.cc:3060] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.799582 16199 raft_consensus.cc:2749] T 36cb8c32d8cb4fbb9be18767c0336506 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.799314 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_56b69a1e3b4d4e7dbaa6a4697a940880 [id=cb9294ed7c474aae989ac13159ec3166]
I20251025 08:02:30.800726 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_2e26e9814f71438c825c74fa33301a37 [id=cbc9424490e64b5dad8de10af69959f9]
I20251025 08:02:30.800984 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_06d9fbe4ef5e4a59b12abb65af8ce2a0 [id=ce6a220ddfc540dbb17e28bc74b66449]
I20251025 08:02:30.803701 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_66c1bf4cbbca4bf086d9409663f762f2 [id=cf8fb3a063d049e5bd23bcfb9cf64b59]
I20251025 08:02:30.804412 16392 tablet_bootstrap.cc:492] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.804497 16392 ts_tablet_manager.cc:1403] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.055s user 0.000s sys 0.002s
I20251025 08:02:30.804754 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_5fe5289f69bd4a458aced0607d8247fa [id=cfa501bfaffb4d95893a0cd10caedcb4]
I20251025 08:02:30.804948 16392 raft_consensus.cc:359] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.805049 16392 raft_consensus.cc:385] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.805088 16392 raft_consensus.cc:740] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.805198 16392 consensus_queue.cc:260] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.805498 16392 ts_tablet_manager.cc:1434] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.805684 16582 raft_consensus.cc:493] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.805778 16582 raft_consensus.cc:515] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.806134 16582 leader_election.cc:290] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.805670 16392 tablet_bootstrap.cc:492] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.806531 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f4add8060af4a9da95c3e78567f871f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.806805 15380 raft_consensus.cc:493] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.806885 15380 raft_consensus.cc:515] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.807178 15380 leader_election.cc:290] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.807753 16392 tablet_bootstrap.cc:654] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:30.808754 15049 leader_election.cc:343] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.810688 15864 raft_consensus.cc:493] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.810762 15864 raft_consensus.cc:515] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.811077 15864 leader_election.cc:290] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.811475 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06c159c643804acfb0c3b82190a7a02f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.811589 15238 raft_consensus.cc:2468] T 06c159c643804acfb0c3b82190a7a02f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.811861 14914 leader_election.cc:304] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.811939 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "212ccfb58f964d7bae31e5af110b4079" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.811998 15864 raft_consensus.cc:2804] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.812044 15864 raft_consensus.cc:493] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.812075 15864 raft_consensus.cc:3060] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:30.812321 15049 leader_election.cc:343] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.812866 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_97dcb2270cdf4d21824166c30b3a62a9 [id=d53447a316c5438e86cdac872682b3a1]
I20251025 08:02:30.812933 15864 raft_consensus.cc:515] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.813092 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e]
I20251025 08:02:30.813263 15864 leader_election.cc:290] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.813702 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06c159c643804acfb0c3b82190a7a02f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:30.813786 15237 raft_consensus.cc:3060] T 06c159c643804acfb0c3b82190a7a02f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.814606 15237 raft_consensus.cc:2468] T 06c159c643804acfb0c3b82190a7a02f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.814894 14914 leader_election.cc:304] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.815053 15374 raft_consensus.cc:2804] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.815117 15374 raft_consensus.cc:697] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:30.815222 15374 consensus_queue.cc:237] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.816740 15384 raft_consensus.cc:493] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.816809 15384 raft_consensus.cc:515] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.817111 15384 leader_election.cc:290] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.817135 16570 consensus_queue.cc:1048] T 75d0c5e694734b37848c4127c4e97085 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.817351 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a3ec64b273d4e8c92b1e24061ac7336" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.817446 15111 raft_consensus.cc:2468] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.817718 15185 leader_election.cc:304] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.817946 16570 raft_consensus.cc:2804] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.818001 16570 raft_consensus.cc:493] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.818042 16570 raft_consensus.cc:3060] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.818708 16392 tablet_bootstrap.cc:492] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.818789 16392 ts_tablet_manager.cc:1403] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20251025 08:02:30.819008 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a3ec64b273d4e8c92b1e24061ac7336" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.819324 16392 raft_consensus.cc:359] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.819443 16392 raft_consensus.cc:385] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.819476 16392 raft_consensus.cc:740] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.819609 16392 consensus_queue.cc:260] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.820019 16392 ts_tablet_manager.cc:1434] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.820200 16392 tablet_bootstrap.cc:492] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.820254 16570 raft_consensus.cc:515] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.820557 16570 leader_election.cc:290] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.820814 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a3ec64b273d4e8c92b1e24061ac7336" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.820904 15111 raft_consensus.cc:3060] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:30.820904 15183 leader_election.cc:343] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.821189 16392 tablet_bootstrap.cc:654] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.821390 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a3ec64b273d4e8c92b1e24061ac7336" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.821870 15111 raft_consensus.cc:2468] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
W20251025 08:02:30.821911 15183 leader_election.cc:343] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.822288 16570 consensus_queue.cc:1048] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.822320 15185 leader_election.cc:304] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:30.822446 16572 raft_consensus.cc:2804] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.822523 16572 raft_consensus.cc:697] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.822642 16572 consensus_queue.cc:237] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.822973 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_2c042f0ac6454365ae570c2cd26b31ca [id=d656394d725244dbbe22b0cfb8e4c89f]
I20251025 08:02:30.825225 16390 tablet_bootstrap.cc:492] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.825306 16390 ts_tablet_manager.cc:1403] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.028s user 0.000s sys 0.002s
I20251025 08:02:30.825549 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_37a4fd748a93467eb24cd79ee89df4ef [id=d785bc9e4c3b4e4c856d280eeba182e6]
I20251025 08:02:30.825678 16390 raft_consensus.cc:359] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.825773 16390 raft_consensus.cc:385] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.825805 16390 raft_consensus.cc:740] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.825980 16390 consensus_queue.cc:260] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.826261 16390 ts_tablet_manager.cc:1434] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.826413 16390 tablet_bootstrap.cc:492] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.826994 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_21b4f92893424716afe86f9c67b6a691 [id=db6654cc26a348709c7f0577b91f18af]
I20251025 08:02:30.827272 16390 tablet_bootstrap.cc:654] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.827526 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_401f8def453c48a19fc90b04a3294a16 [id=db8975b3e7bf43ffbd8b23ba666ffdd6]
I20251025 08:02:30.828548 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_808c7980d96b48a181f79124ea5a0adb [id=e3c0ae796ee2421abe38408b729dd2a6]
I20251025 08:02:30.830505 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_5bc70f62257c438bb0c52926674f2bdf [id=e62c2aba4e5546e2bd881c5f2ae3abd4]
I20251025 08:02:30.830767 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_acf14806991f4da89dc9bb3361537133 [id=e63210d8c6d148e18496c0bc0d326ab9]
I20251025 08:02:30.833379 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_f2e0f883fa4646a0aa3e785a7de7f152 [id=ea0a64fc70c84a7eb2b7c8e8e4a933fe]
I20251025 08:02:30.834563 16392 tablet_bootstrap.cc:492] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.834657 16392 ts_tablet_manager.cc:1403] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.000s
I20251025 08:02:30.835076 16392 raft_consensus.cc:359] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.835239 16392 raft_consensus.cc:385] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.835289 16392 raft_consensus.cc:740] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.835429 16392 consensus_queue.cc:260] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.835770 16392 ts_tablet_manager.cc:1434] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.835947 16392 tablet_bootstrap.cc:492] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.836941 16392 tablet_bootstrap.cc:654] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.806815 15048 leader_election.cc:304] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.837620 15380 raft_consensus.cc:2804] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.837711 15380 raft_consensus.cc:697] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:30.837833 15380 consensus_queue.cc:237] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.837911 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_c5c036d7c66344eba94e15be432088bc [id=ebfa83131bd946d0897b32ef3c188c19]
I20251025 08:02:30.838382 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06c159c643804acfb0c3b82190a7a02f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.838474 15113 raft_consensus.cc:2468] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:30.838737 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "06c159c643804acfb0c3b82190a7a02f" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.838816 15113 raft_consensus.cc:3060] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.839089 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_9ab03dea59b04746968d5f6753b931d6 [id=ec9b64d93dfc44a29aae35e6b02e2fe8]
I20251025 08:02:30.839306 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_3ad0d85469a7485ba556f83ce20cecdf [id=edf9af4acd364a30814a645d32d35224]
I20251025 08:02:30.839514 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_90a6f70e509d406597d257083a3d3a6a [id=ef3a1760f2c44935bbb79e518510905f]
I20251025 08:02:30.839794 15113 raft_consensus.cc:2468] T 06c159c643804acfb0c3b82190a7a02f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:30.839978 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e]
I20251025 08:02:30.840544 16390 tablet_bootstrap.cc:492] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.840667 16390 ts_tablet_manager.cc:1403] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20251025 08:02:30.841163 16390 raft_consensus.cc:359] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.841332 16390 raft_consensus.cc:385] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.841650 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f4add8060af4a9da95c3e78567f871f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.841972 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "212ccfb58f964d7bae31e5af110b4079" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.842672 16390 raft_consensus.cc:740] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.842845 16390 consensus_queue.cc:260] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.843170 16390 ts_tablet_manager.cc:1434] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.843626 16857 consensus_queue.cc:1048] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.844803 16392 tablet_bootstrap.cc:492] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.844880 16392 ts_tablet_manager.cc:1403] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:30.845162 16390 tablet_bootstrap.cc:492] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.845293 16392 raft_consensus.cc:359] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.845399 16392 raft_consensus.cc:385] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.845433 16392 raft_consensus.cc:740] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.845556 16392 consensus_queue.cc:260] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.845892 16392 ts_tablet_manager.cc:1434] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.846031 16392 tablet_bootstrap.cc:492] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.846968 16390 tablet_bootstrap.cc:654] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.847124 16392 tablet_bootstrap.cc:654] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.850544 16582 raft_consensus.cc:493] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.850625 16582 raft_consensus.cc:515] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.850940 16582 leader_election.cc:290] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.851001 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]
I20251025 08:02:30.851356 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b866fc38e3444514b834f7876fb700ed" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.851675 15049 leader_election.cc:343] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.852219 16420 consensus_queue.cc:1048] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.852375 15374 consensus_queue.cc:1048] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.852515 16420 consensus_queue.cc:1048] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.852705 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b866fc38e3444514b834f7876fb700ed" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.853513 16391 tablet_bootstrap.cc:492] T 8b69d792862540b6ad1b5d56dea17499 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.853587 16391 ts_tablet_manager.cc:1403] T 8b69d792862540b6ad1b5d56dea17499 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.070s user 0.000s sys 0.001s
I20251025 08:02:30.853973 16391 raft_consensus.cc:359] T 8b69d792862540b6ad1b5d56dea17499 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.854060 16391 raft_consensus.cc:385] T 8b69d792862540b6ad1b5d56dea17499 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.854089 16391 raft_consensus.cc:740] T 8b69d792862540b6ad1b5d56dea17499 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.854209 16391 consensus_queue.cc:260] T 8b69d792862540b6ad1b5d56dea17499 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.854450 16391 ts_tablet_manager.cc:1434] T 8b69d792862540b6ad1b5d56dea17499 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.854602 16391 tablet_bootstrap.cc:492] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.855461 16391 tablet_bootstrap.cc:654] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:30.856678 15048 leader_election.cc:343] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.857108 15048 leader_election.cc:304] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.857162 15864 consensus_queue.cc:1048] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.851502 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_13374d55596a48c493e555af032ca1ff [id=fa967d72a93f477e86f08e71a6810d0a]
I20251025 08:02:30.858733 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_0a6ff7ae05a040c3be53115abe29f5ce [id=fb111be93abf42e9b40d60ddcf64190f]
I20251025 08:02:30.858719 16582 raft_consensus.cc:2749] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:30.859128 15048 leader_election.cc:343] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.859195 15048 leader_election.cc:304] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.859467 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_075d43596a3d4f1e889c2cd50b615157 [id=fb192136f9d9453a8d0aad2c1103118d]
I20251025 08:02:30.860167 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_f84103a22819458c976f0d1ca4716b47 [id=fe4920e7d4f143388063f22590eb2f64]
I20251025 08:02:30.862706 16582 raft_consensus.cc:2749] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.863349 16908 catalog_manager.cc:679] Loaded metadata for table default.Table_a01a1e605d7944fc9e89f1b656ccd903 [id=ff44f0c128c44faa9f36925f9477c66a]
W20251025 08:02:30.863639 15048 leader_election.cc:343] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.863708 15048 leader_election.cc:304] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.863822 16582 raft_consensus.cc:2749] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.864024 16390 tablet_bootstrap.cc:492] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.864111 16390 ts_tablet_manager.cc:1403] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20251025 08:02:30.864362 16392 tablet_bootstrap.cc:492] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.864447 16392 ts_tablet_manager.cc:1403] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251025 08:02:30.864535 16390 raft_consensus.cc:359] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.864640 16390 raft_consensus.cc:385] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.864682 16390 raft_consensus.cc:740] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.864800 16390 consensus_queue.cc:260] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.864871 16392 raft_consensus.cc:359] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.864959 16392 raft_consensus.cc:385] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.864990 16392 raft_consensus.cc:740] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.865121 16392 consensus_queue.cc:260] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.865465 16392 ts_tablet_manager.cc:1434] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.865569 16420 consensus_queue.cc:1048] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.865638 16392 tablet_bootstrap.cc:492] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:30.866554 16390 ts_tablet_manager.cc:1434] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:30.866789 16392 tablet_bootstrap.cc:654] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.867209 16390 tablet_bootstrap.cc:492] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.868229 16390 tablet_bootstrap.cc:654] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.877534 16391 tablet_bootstrap.cc:492] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.877619 16391 ts_tablet_manager.cc:1403] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.000s
I20251025 08:02:30.877976 16391 raft_consensus.cc:359] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.878057 16391 raft_consensus.cc:385] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.878082 16391 raft_consensus.cc:740] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.878172 16391 consensus_queue.cc:260] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.878504 16390 tablet_bootstrap.cc:492] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.878527 16391 ts_tablet_manager.cc:1434] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.878576 16390 ts_tablet_manager.cc:1403] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20251025 08:02:30.878656 16391 tablet_bootstrap.cc:492] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.878994 16390 raft_consensus.cc:359] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.879088 16390 raft_consensus.cc:385] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.879123 16390 raft_consensus.cc:740] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.879262 16390 consensus_queue.cc:260] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.879436 15374 consensus_queue.cc:1048] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.879942 16390 ts_tablet_manager.cc:1434] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.880115 16390 tablet_bootstrap.cc:492] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.881436 16966 raft_consensus.cc:493] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.881510 16966 raft_consensus.cc:515] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.881520 15374 consensus_queue.cc:1048] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.881654 16390 tablet_bootstrap.cc:654] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.881866 16966 leader_election.cc:290] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.882134 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9ccba7de6874245bc0e1cdb8e8acfb1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.882423 15049 leader_election.cc:343] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.882773 16570 consensus_queue.cc:1048] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.884845 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9ccba7de6874245bc0e1cdb8e8acfb1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.894778 16390 tablet_bootstrap.cc:492] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.895099 16390 ts_tablet_manager.cc:1403] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.001s
I20251025 08:02:30.895403 16572 consensus_queue.cc:1048] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.897049 14979 raft_consensus.cc:3060] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.898386 16572 consensus_queue.cc:1048] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.899312 15374 consensus_queue.cc:1048] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.895956 16390 raft_consensus.cc:359] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.899693 16390 raft_consensus.cc:385] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.899776 16390 raft_consensus.cc:740] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.899945 16390 consensus_queue.cc:260] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.900043 15539 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [term 4 FOLLOWER]: Refusing update from remote peer 94a96657c5fd49398b88e9ad615bfe1e: Log matching property violated. Preceding OpId in replica: term: 3 index: 695. Preceding OpId from leader: term: 4 index: 702. (index mismatch)
I20251025 08:02:30.900679 16901 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 702, Last known committed idx: 695, Time since last communication: 0.000s
I20251025 08:02:30.900951 16390 ts_tablet_manager.cc:1434] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:30.901681 16390 tablet_bootstrap.cc:492] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.903018 16966 consensus_queue.cc:1048] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.903390 16390 tablet_bootstrap.cc:654] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.903633 16873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94a96657c5fd49398b88e9ad615bfe1e. Latest consensus state: current_term: 4 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:30.903724 16873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:30.904731 16908 tablet_loader.cc:96] loaded metadata for tablet 0078dd6fb0e34d01a54889326dd6dfd7 (table default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b])
I20251025 08:02:30.905344 16391 tablet_bootstrap.cc:654] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.905341 16908 tablet_loader.cc:96] loaded metadata for tablet 0488062b11994f03a1af2e52db492977 (table default.Table_96ffee6ed67048c5bc78a91d739e8a02 [id=194a3dd184f4450da0604a85ace48fe9])
I20251025 08:02:30.906792 16908 tablet_loader.cc:96] loaded metadata for tablet 05df39a0910f406082e7864a321b46cf (table default.Table_911ed9daff7b411c80d61a5a6ca9c623 [id=64be55e8604a4eb2b9cdf27d75e0e546])
W20251025 08:02:30.907073 15185 consensus_peers.cc:597] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4edf680e8d4a4b898fd6e64f8ec6f75d. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:30.908484 16572 raft_consensus.cc:493] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.908553 16572 raft_consensus.cc:515] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.908834 16572 leader_election.cc:290] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.909087 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b69d792862540b6ad1b5d56dea17499" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.909193 15109 raft_consensus.cc:2468] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.909389 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b69d792862540b6ad1b5d56dea17499" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.909482 14973 raft_consensus.cc:2468] T 8b69d792862540b6ad1b5d56dea17499 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.909605 15185 leader_election.cc:304] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.909752 16572 raft_consensus.cc:2804] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.909817 16572 raft_consensus.cc:493] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.909869 16572 raft_consensus.cc:3060] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.910506 16908 tablet_loader.cc:96] loaded metadata for tablet 06c159c643804acfb0c3b82190a7a02f (table default.Table_fa7f3472406144b795d1ec3e8669bf04 [id=73c88284db0345458af97c86039f6c5d])
I20251025 08:02:30.910893 16572 raft_consensus.cc:515] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.911204 16572 leader_election.cc:290] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.911475 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b69d792862540b6ad1b5d56dea17499" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.911530 16572 raft_consensus.cc:493] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.911578 15114 raft_consensus.cc:3060] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.911592 16572 raft_consensus.cc:515] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.911885 16572 leader_election.cc:290] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.912145 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4d1c652b6a4420a81e03cd58c6dbc69" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:30.912432 15183 leader_election.cc:343] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:30.912485 15048 leader_election.cc:343] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.912514 15114 raft_consensus.cc:2468] T 8b69d792862540b6ad1b5d56dea17499 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.912546 15048 leader_election.cc:304] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.912700 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b69d792862540b6ad1b5d56dea17499" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.912786 14973 raft_consensus.cc:3060] T 8b69d792862540b6ad1b5d56dea17499 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.912798 16582 raft_consensus.cc:2749] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.912892 16582 consensus_queue.cc:1048] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.913713 14973 raft_consensus.cc:2468] T 8b69d792862540b6ad1b5d56dea17499 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.913904 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4d1c652b6a4420a81e03cd58c6dbc69" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.913980 15183 leader_election.cc:304] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.914000 15109 raft_consensus.cc:2468] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.914124 16572 raft_consensus.cc:2804] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.914709 15185 leader_election.cc:304] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:30.914878 15384 raft_consensus.cc:2804] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.914939 15384 raft_consensus.cc:493] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.915004 15384 raft_consensus.cc:3060] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:30.915294 15185 consensus_peers.cc:597] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cfe9add2f8bf450bb6f49ad57be2caae. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:30.915763 16392 tablet_bootstrap.cc:492] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:30.915855 16392 ts_tablet_manager.cc:1403] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.000s
I20251025 08:02:30.915930 15384 raft_consensus.cc:515] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.916077 16908 tablet_loader.cc:96] loaded metadata for tablet 0769fe05ef364f8e80786bded1ec44cf (table default.Table_165ff894c5ab455e8daf5d1cf318b785 [id=325e0a7553e840c58179c04253e874dc])
I20251025 08:02:30.916280 16908 tablet_loader.cc:96] loaded metadata for tablet 077ed236d1064a4d9a855bafabe0cdd7 (table default.Table_59553db1e7714c3b8a827e02fa059e1e [id=c2a7a02e46184b638b19f9a95da2eda8])
I20251025 08:02:30.916280 15384 leader_election.cc:290] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.916352 15384 raft_consensus.cc:493] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.916352 16392 raft_consensus.cc:359] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.916417 15384 raft_consensus.cc:515] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.916448 16392 raft_consensus.cc:385] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.916473 16908 tablet_loader.cc:96] loaded metadata for tablet 080d77feb2a242959fb8e375f07e5a5f (table default.Table_4c672efab2bb448ab1dcfd4325e8c053 [id=0db3af0dc90e4ea5ac9a029e3864ce58])
I20251025 08:02:30.916486 16392 raft_consensus.cc:740] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.916576 16392 consensus_queue.cc:260] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.916718 15384 leader_election.cc:290] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.916895 16392 ts_tablet_manager.cc:1434] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.916939 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "446194cf013c4b6499deb00fab8db42a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.917037 15109 raft_consensus.cc:2468] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.914366 16572 raft_consensus.cc:697] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.917068 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4d1c652b6a4420a81e03cd58c6dbc69" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.917155 15111 raft_consensus.cc:3060] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.917201 16572 consensus_queue.cc:237] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.917356 15185 leader_election.cc:304] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.917457 16908 tablet_loader.cc:96] loaded metadata for tablet 090117a75882489d84687e41b50616e9 (table default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e])
I20251025 08:02:30.917479 16199 raft_consensus.cc:2804] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.917519 16199 raft_consensus.cc:493] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.917554 16199 raft_consensus.cc:3060] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.917667 16908 tablet_loader.cc:96] loaded metadata for tablet 09fccf0770604812940dd63106f7d993 (table default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056])
I20251025 08:02:30.917954 16908 tablet_loader.cc:96] loaded metadata for tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c (table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865])
I20251025 08:02:30.918056 15111 raft_consensus.cc:2468] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.918352 15185 leader_election.cc:304] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.918519 16908 tablet_loader.cc:96] loaded metadata for tablet 1019d033e1f24ab596309462cbeb9c73 (table default.Table_ec7c18f36d434e0b9d294354387082e6 [id=4644ba57f12f4ad4bf7e89f80c4cd161])
I20251025 08:02:30.918581 16199 raft_consensus.cc:515] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.918922 16199 leader_election.cc:290] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.918920 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "446194cf013c4b6499deb00fab8db42a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.919023 16199 raft_consensus.cc:2804] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.919035 14974 raft_consensus.cc:2468] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.919100 16199 raft_consensus.cc:697] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.919180 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "446194cf013c4b6499deb00fab8db42a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.919206 16199 consensus_queue.cc:237] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.919270 15109 raft_consensus.cc:3060] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.918941 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4d1c652b6a4420a81e03cd58c6dbc69" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:30.919940 15183 leader_election.cc:343] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.920149 15109 raft_consensus.cc:2468] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.920423 15185 leader_election.cc:304] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.920547 15384 raft_consensus.cc:2804] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.920635 15384 raft_consensus.cc:697] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.920722 15384 consensus_queue.cc:237] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.920758 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "446194cf013c4b6499deb00fab8db42a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:30.920847 14973 raft_consensus.cc:3060] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.921784 14973 raft_consensus.cc:2468] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.922591 16901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:30.922701 16901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: This master's current role is: LEADER
I20251025 08:02:30.924104 16391 tablet_bootstrap.cc:492] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.924175 16391 ts_tablet_manager.cc:1403] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.046s user 0.000s sys 0.002s
I20251025 08:02:30.924229 16908 tablet_loader.cc:96] loaded metadata for tablet 17339d7c0a4b40a78b3252d17481c192 (table default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33])
I20251025 08:02:30.924415 16908 tablet_loader.cc:96] loaded metadata for tablet 174daf21bc41408d825ebe926af39c1b (table default.Table_d69575be86d241a797b7167bbe70fa79 [id=c3b6a46013fd4221a273b1842765f917])
I20251025 08:02:30.924576 16908 tablet_loader.cc:96] loaded metadata for tablet 17e61bb1e9c94b949361b2ca152eb3d4 (table default.Table_9d8c68374942454a8e7c869e8cef206f [id=b228e3c8480f475ca877713e168bcba8])
I20251025 08:02:30.924535 16391 raft_consensus.cc:359] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.924630 16391 raft_consensus.cc:385] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.924664 16391 raft_consensus.cc:740] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.924765 16391 consensus_queue.cc:260] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.924845 16908 tablet_loader.cc:96] loaded metadata for tablet 1927cf6a9013402a92c9e6e89e2e1715 (table default.Table_d03eda3087a54490a502678eeeeeabc8 [id=1297b3a21b8a458d80575525d6df9783])
I20251025 08:02:30.925025 16391 ts_tablet_manager.cc:1434] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.925184 16391 tablet_bootstrap.cc:492] T 1f4add8060af4a9da95c3e78567f871f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.925231 16908 tablet_loader.cc:96] loaded metadata for tablet 1ab6b9d8278045ae92043ada5ce6dd71 (table default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4])
I20251025 08:02:30.925635 16908 tablet_loader.cc:96] loaded metadata for tablet 1dd5a31508964130828ee0367a3317ed (table default.Table_2e26e9814f71438c825c74fa33301a37 [id=cbc9424490e64b5dad8de10af69959f9])
I20251025 08:02:30.925947 16908 tablet_loader.cc:96] loaded metadata for tablet 1f4add8060af4a9da95c3e78567f871f (table default.Table_6c4b782dd6a04a1bbeb82b8537829558 [id=838e1bc6ed30426ba4dd16cc04efb68e])
I20251025 08:02:30.925980 16391 tablet_bootstrap.cc:654] T 1f4add8060af4a9da95c3e78567f871f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.926256 16873 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:30.926339 16873 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7109d31951574de3bf05a86c94c11d21 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:30.926692 16908 tablet_loader.cc:96] loaded metadata for tablet 212ccfb58f964d7bae31e5af110b4079 (table default.Table_ebce5278d348458e8ab930ddd6088775 [id=2de94631eeee41489ea858ed887de8c1])
I20251025 08:02:30.926987 16908 tablet_loader.cc:96] loaded metadata for tablet 23eedc2695db43afbd6f5dbebb0ea2be (table default.Table_d9fe75661236465ca4c58953ed0023c4 [id=c0f5ecd0d89d409785fbd905d22e3fc2])
W20251025 08:02:30.927683 16270 consensus_peers.cc:597] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e -> Peer 33b7e3c702ec44079d8b76a0ce6bae97 (127.14.70.61:44347): Couldn't send request to peer 33b7e3c702ec44079d8b76a0ce6bae97. Status: Network error: Client connection negotiation failed: client connection to 127.14.70.61:44347: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:30.931964 16582 raft_consensus.cc:493] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.932049 16582 raft_consensus.cc:515] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.932351 16582 leader_election.cc:290] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.932322 16857 consensus_queue.cc:1048] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.933362 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0cc4859d32a4e119b413e1cbbb52834" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.933636 15049 leader_election.cc:343] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.938318 16582 raft_consensus.cc:493] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.938400 16582 raft_consensus.cc:515] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.938467 16908 tablet_loader.cc:96] loaded metadata for tablet 24e0f02dd56644a3930c1cc0a972132e (table default.Table_14a3c11816aa4e2d93e0a9912024dbd2 [id=4e3924f6f712459db0d167bb72825701])
I20251025 08:02:30.938653 16908 tablet_loader.cc:96] loaded metadata for tablet 2562325ea1c9436a85e1d675574c0a6c (table default.Table_beff096618394ac1b31db74a94a9f991 [id=8a0e4fe9e4544c539cb23b0279c1deaf])
I20251025 08:02:30.938714 16582 leader_election.cc:290] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.938817 16908 tablet_loader.cc:96] loaded metadata for tablet 262014e996b54824824aa99c0b7ad771 (table default.Table_e22e6abaeec0420496616ee334cf07eb [id=b3be7f970bc745f7873e9d54a68e3e50])
I20251025 08:02:30.939123 16908 tablet_loader.cc:96] loaded metadata for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b (table default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064])
I20251025 08:02:30.939194 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "89eda91ab00245418389e614550f20c1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.939563 15049 leader_election.cc:343] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.939774 16391 tablet_bootstrap.cc:492] T 1f4add8060af4a9da95c3e78567f871f P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:30.939847 16391 ts_tablet_manager.cc:1403] T 1f4add8060af4a9da95c3e78567f871f P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.001s
I20251025 08:02:30.940274 16391 raft_consensus.cc:359] T 1f4add8060af4a9da95c3e78567f871f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.940361 16391 raft_consensus.cc:385] T 1f4add8060af4a9da95c3e78567f871f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.940395 16391 raft_consensus.cc:740] T 1f4add8060af4a9da95c3e78567f871f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.940495 16391 consensus_queue.cc:260] T 1f4add8060af4a9da95c3e78567f871f P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.941047 16391 ts_tablet_manager.cc:1434] T 1f4add8060af4a9da95c3e78567f871f P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:30.941259 16391 tablet_bootstrap.cc:492] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:30.941946 16582 raft_consensus.cc:493] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.942030 16582 raft_consensus.cc:515] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.942348 16582 leader_election.cc:290] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.942384 16391 tablet_bootstrap.cc:654] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.942837 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17339d7c0a4b40a78b3252d17481c192" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.943346 15049 leader_election.cc:343] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.944990 16908 tablet_loader.cc:96] loaded metadata for tablet 2d16499315044408ad4bc1dca6341ed5 (table default.Table_401f8def453c48a19fc90b04a3294a16 [id=db8975b3e7bf43ffbd8b23ba666ffdd6])
I20251025 08:02:30.946511 16908 tablet_loader.cc:96] loaded metadata for tablet 2f64072c416f4a77b1c81855d7db8f01 (table default.Table_b9669fd414104dcca80167117a5b0ed7 [id=431195fe6a3847caa5b39d62cb399ffb])
I20251025 08:02:30.947096 16908 tablet_loader.cc:96] loaded metadata for tablet 327c7f7679dd469cb6f5a9b346c40671 (table default.Table_b3ddde442f824bc6986a5d2e95a6b069 [id=b43a2ee282444f159384bc0849691707])
I20251025 08:02:30.947319 16908 tablet_loader.cc:96] loaded metadata for tablet 346c0c8bf30b4dbaa92436b45e5fbf47 (table default.Table_90a6f70e509d406597d257083a3d3a6a [id=ef3a1760f2c44935bbb79e518510905f])
I20251025 08:02:30.947503 16908 tablet_loader.cc:96] loaded metadata for tablet 34c330b5dd544ae686f741cdd85d023d (table default.Table_aa5c70a86540451b8a07688d25edc3b7 [id=bd246e92f35b47a2864b5da042da3232])
I20251025 08:02:30.947924 16908 tablet_loader.cc:96] loaded metadata for tablet 36cb8c32d8cb4fbb9be18767c0336506 (table default.Table_19e4d10cf3d64b008591270ed9ee26f3 [id=2481098eb7b44b7ca9be9b9393a44523])
I20251025 08:02:30.948257 16908 tablet_loader.cc:96] loaded metadata for tablet 3743a9de419d40689c49aae471edfa01 (table default.Table_37152b4a34aa41dbbf4a0be51631faf9 [id=7956205ae4e9408988c3d82c46db1706])
I20251025 08:02:30.948462 16908 tablet_loader.cc:96] loaded metadata for tablet 399d6b0459864b1586aa99948c56baea (table default.Table_2c042f0ac6454365ae570c2cd26b31ca [id=d656394d725244dbbe22b0cfb8e4c89f])
I20251025 08:02:30.948786 16908 tablet_loader.cc:96] loaded metadata for tablet 3c119ac81d35496cad2630c19f15ea21 (table default.Table_154bf3fb109a4052a26aed5719b8cd1d [id=73dc21342ffe4d88bcee8530555b260d])
I20251025 08:02:30.948976 16582 consensus_queue.cc:1048] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.950817 16572 consensus_queue.cc:1048] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.952750 16908 tablet_loader.cc:96] loaded metadata for tablet 42e8a5ee7d6a42aaaf95c33617abff3f (table default.Table_5d847a37cb0c456294cb5137046f80bb [id=1f6784494d0b4b98b46077a0af6c2ea8])
I20251025 08:02:30.952947 16908 tablet_loader.cc:96] loaded metadata for tablet 43da3f4fc9604562a95dff59da3c574b (table default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031])
I20251025 08:02:30.953248 16908 tablet_loader.cc:96] loaded metadata for tablet 442d83935a0a41658508e3022f4b557f (table default.Table_221091e6cc7f49d0ba8ff4c967382bce [id=816e76daa7934c3498290c4154c8fce3])
I20251025 08:02:30.953406 16908 tablet_loader.cc:96] loaded metadata for tablet 446194cf013c4b6499deb00fab8db42a (table default.Table_1294a307080744bd964b420814ae843f [id=8be0a7e83b634a6b90b3bf1bb535585c])
I20251025 08:02:30.953554 16908 tablet_loader.cc:96] loaded metadata for tablet 454a76de5e2c421ab035e6cf1a958c11 (table default.Table_d397fc560379473eaaf32d983dd63291 [id=72c011b62b744dce916913de58d26d09])
I20251025 08:02:30.953682 16908 tablet_loader.cc:96] loaded metadata for tablet 45a22457031a4eff8e82fa232b6f05bb (table default.Table_ddaa9d9bb575414e95d302ba39e4df09 [id=34a3343e709b46128ae84467e02e48de])
I20251025 08:02:30.954030 16908 tablet_loader.cc:96] loaded metadata for tablet 47c5c768eafa494db9a0110bf5625451 (table default.Table_89fbe6e89c5b4265a3becdf00dc8a9e2 [id=229b4804d467428f8028c82314a3c3fb])
I20251025 08:02:30.954208 16908 tablet_loader.cc:96] loaded metadata for tablet 4bb463fc8b104a87b5503bfc2467a23e (table default.Table_5fe5289f69bd4a458aced0607d8247fa [id=cfa501bfaffb4d95893a0cd10caedcb4])
I20251025 08:02:30.954491 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0cc4859d32a4e119b413e1cbbb52834" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.955057 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "89eda91ab00245418389e614550f20c1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.955190 16908 tablet_loader.cc:96] loaded metadata for tablet 4ff32cab636840bc86a54aa6c91e9456 (table default.Table_3447d48d82304580af188ed3290be5af [id=b80518faef5b4348a9247367008e0992])
I20251025 08:02:30.955411 16908 tablet_loader.cc:96] loaded metadata for tablet 5022f9beb59449828f59dca9d14caa50 (table default.Table_06d9fbe4ef5e4a59b12abb65af8ce2a0 [id=ce6a220ddfc540dbb17e28bc74b66449])
I20251025 08:02:30.955583 16908 tablet_loader.cc:96] loaded metadata for tablet 519f631918c144ff8edcfc7127ca23dc (table default.Table_13374d55596a48c493e555af032ca1ff [id=fa967d72a93f477e86f08e71a6810d0a])
I20251025 08:02:30.955873 16908 tablet_loader.cc:96] loaded metadata for tablet 53f89ab2ef9b4136812cb4a320a645a6 (table default.Table_78f6013cec184a249b798e35ae7f09ce [id=d57a04f056d34c7c8b61650af3081d0e])
I20251025 08:02:30.956347 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17339d7c0a4b40a78b3252d17481c192" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.956624 16966 raft_consensus.cc:493] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.956698 16966 raft_consensus.cc:515] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.956736 15380 raft_consensus.cc:493] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.956806 15380 raft_consensus.cc:515] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.956982 16966 leader_election.cc:290] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.957048 15380 leader_election.cc:290] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.956995 15642 consensus_queue.cc:1048] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.957864 16572 raft_consensus.cc:493] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.957938 16572 raft_consensus.cc:515] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.958233 16572 leader_election.cc:290] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.958480 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "685d09c4a80b4d48b477cd4c0fc9db40" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.958568 15112 raft_consensus.cc:2468] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:30.958575 15380 raft_consensus.cc:493] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.958647 15380 raft_consensus.cc:515] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.958834 15185 leader_election.cc:304] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.958897 15380 leader_election.cc:290] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.959060 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86b1873446154249a80fa67b99496545" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.959141 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e967a52212164b8cb6f9c39f207024a1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.958987 16572 raft_consensus.cc:2804] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:30.959267 16572 raft_consensus.cc:493] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:30.959323 16572 raft_consensus.cc:3060] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:30.960157 16572 raft_consensus.cc:515] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.960471 16572 leader_election.cc:290] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:30.960611 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "685d09c4a80b4d48b477cd4c0fc9db40" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:30.960676 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ab6b9d8278045ae92043ada5ce6dd71" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.960812 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "685d09c4a80b4d48b477cd4c0fc9db40" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:30.960908 15112 raft_consensus.cc:3060] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:30.961128 15049 leader_election.cc:343] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:30.961234 15049 leader_election.cc:343] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.961491 15380 raft_consensus.cc:493] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.961562 15380 raft_consensus.cc:515] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.961798 15112 raft_consensus.cc:2468] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:30.961889 15380 leader_election.cc:290] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.962100 15185 leader_election.cc:304] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:30.962267 16572 raft_consensus.cc:2804] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:30.962456 16572 raft_consensus.cc:697] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:30.962638 16572 consensus_queue.cc:237] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.962749 16908 tablet_loader.cc:96] loaded metadata for tablet 54de7e83e8ea42ef93218b0204c61ec6 (table default.Table_a6bf9c572cb3485f9ecced6d0d55877d [id=26a6f00041d04924b3e8eb2b279b55de])
W20251025 08:02:30.963478 15183 leader_election.cc:343] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.963828 16908 tablet_loader.cc:96] loaded metadata for tablet 5564705a3771425da1f33830e7b51e03 (table default.Table_9ab03dea59b04746968d5f6753b931d6 [id=ec9b64d93dfc44a29aae35e6b02e2fe8])
I20251025 08:02:30.964021 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "685d09c4a80b4d48b477cd4c0fc9db40" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:30.964457 15049 leader_election.cc:343] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.964757 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7dd513b6c7a24dffb91f66c32acc7696" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.965253 15183 leader_election.cc:343] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:30.965755 15049 leader_election.cc:343] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.966037 16390 tablet_bootstrap.cc:492] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.966126 16390 ts_tablet_manager.cc:1403] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.065s user 0.001s sys 0.000s
I20251025 08:02:30.966549 16390 raft_consensus.cc:359] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.966642 16390 raft_consensus.cc:385] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.966671 16390 raft_consensus.cc:740] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.966765 16390 consensus_queue.cc:260] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.967046 16390 ts_tablet_manager.cc:1434] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.967221 16390 tablet_bootstrap.cc:492] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.968125 16390 tablet_bootstrap.cc:654] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.968089 15380 consensus_queue.cc:1048] T 327c7f7679dd469cb6f5a9b346c40671 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.968317 15380 raft_consensus.cc:493] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.968386 15380 raft_consensus.cc:515] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:30.968658 15380 leader_election.cc:290] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.969269 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4ff32cab636840bc86a54aa6c91e9456" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:30.969319 16908 tablet_loader.cc:96] loaded metadata for tablet 55db2958c76e4886b807fdb237f9b2a9 (table default.Table_215d6056104143a2a5c44b771c493865 [id=9926090b33ae4c169603cb1673d71c87])
I20251025 08:02:30.970018 16908 tablet_loader.cc:96] loaded metadata for tablet 56ef6eeb5739448ebeb42d0de38512a7 (table default.Table_87199a6b9d0a48909e5a74fb64314424 [id=4620fcb32741453f9d1ae07209213d59])
W20251025 08:02:30.970017 15049 leader_election.cc:343] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.970956 16908 tablet_loader.cc:96] loaded metadata for tablet 5b49d48b94b0427aa2dcc39dae45a4eb (table default.Table_20420bbacfa743d4ad1ed935423c4ff5 [id=6c847ade4b8f485fb3353af3d2ec442b])
I20251025 08:02:30.971240 16908 tablet_loader.cc:96] loaded metadata for tablet 5bf286568e8343b7921ac256a9313e63 (table default.Table_a9afe52cc64243a295d043eb385ef7d9 [id=46383e9b028a4d2bb7b39e04f147491e])
I20251025 08:02:30.971387 16572 consensus_queue.cc:1048] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.972131 16908 tablet_loader.cc:96] loaded metadata for tablet 60c49b70f8f44dd3aec433206b897843 (table default.Table_df3848a55c7646b1bd519eb12aa88aa1 [id=5160fad54600448f8b2c5bfc942f60a2])
I20251025 08:02:30.973734 15864 raft_consensus.cc:493] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:30.973809 15864 raft_consensus.cc:515] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.974087 15864 leader_election.cc:290] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:30.974509 16908 tablet_loader.cc:96] loaded metadata for tablet 62b2769c6ffc48f980ce7ed2bfa1dd75 (table default.Table_0a6ff7ae05a040c3be53115abe29f5ce [id=fb111be93abf42e9b40d60ddcf64190f])
I20251025 08:02:30.974504 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64996b8137f647b993923cb1bb093211" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:30.957052 15048 leader_election.cc:343] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.975163 15048 leader_election.cc:304] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:30.975360 15048 leader_election.cc:343] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.975332 17054 raft_consensus.cc:2749] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.975652 16908 tablet_loader.cc:96] loaded metadata for tablet 64996b8137f647b993923cb1bb093211 (table default.Table_c8ac7973eef94a68bf4ebe1459c2e6e6 [id=3c371b3791fd45be983458cd55d67827])
I20251025 08:02:30.975905 16908 tablet_loader.cc:96] loaded metadata for tablet 64ebf3a6aca8403fa811202af7e3fe01 (table default.Table_96eed584de4f4711b66e6f802a78ca6f [id=115470413d904ac0a4a3acecc6e6723e])
I20251025 08:02:30.976679 16908 tablet_loader.cc:96] loaded metadata for tablet 658a20d894c5444a820ce6bd33e4fdf0 (table default.Table_25e0298aad614dba82f598191e458567 [id=7edb1b5b68864e54b6366186a8915fcf])
I20251025 08:02:30.975425 15048 leader_election.cc:304] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:30.978688 15048 leader_election.cc:343] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:30.978706 15380 raft_consensus.cc:2749] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.978746 15048 leader_election.cc:304] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:30.978894 16390 tablet_bootstrap.cc:492] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.978900 15380 raft_consensus.cc:2749] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:30.978963 16390 ts_tablet_manager.cc:1403] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20251025 08:02:30.979386 16390 raft_consensus.cc:359] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.979470 16390 raft_consensus.cc:385] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.979502 16390 raft_consensus.cc:740] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.979606 16390 consensus_queue.cc:260] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:30.979770 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "64996b8137f647b993923cb1bb093211" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:30.979887 16390 ts_tablet_manager.cc:1434] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.979900 15112 raft_consensus.cc:2393] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:30.980059 16390 tablet_bootstrap.cc:492] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.981163 16390 tablet_bootstrap.cc:654] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.982254 16908 tablet_loader.cc:96] loaded metadata for tablet 685d09c4a80b4d48b477cd4c0fc9db40 (table default.Table_27c6a21fc727493fba3613698ba9e108 [id=8e0aa39fb7de4352b22bd41fb1313236])
I20251025 08:02:30.982481 16908 tablet_loader.cc:96] loaded metadata for tablet 6a3ec64b273d4e8c92b1e24061ac7336 (table default.Table_1068ad8fb18a4d21954bb70b20fd5760 [id=79c76995e71143438cb6e30a9df85c31])
I20251025 08:02:30.982679 16908 tablet_loader.cc:96] loaded metadata for tablet 6c582efa6d334a06a48e2f2b94167776 (table default.Table_b1d8db45b7d745a0b4dd9ff09300da89 [id=be37bd4a45da444e83846233c335d445])
I20251025 08:02:30.982750 16582 consensus_queue.cc:1048] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.983040 16908 tablet_loader.cc:96] loaded metadata for tablet 6d1979a4f43a4659976b0cd6d1b888ef (table default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95])
I20251025 08:02:30.983868 16908 tablet_loader.cc:96] loaded metadata for tablet 736f75f26af142e59e7996c2ebb80868 (table default.Table_d77beb2fdfdd42e5b1a16072888cfcac [id=6a04bdbf8b9046c59dc87dd393367134])
I20251025 08:02:30.985234 16908 tablet_loader.cc:96] loaded metadata for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 (table default.Table_05bac665c2114dacac7804da6adfc06e [id=9aee333b5b9f4e1daba6449f643ea43a])
I20251025 08:02:30.985229 15864 consensus_queue.cc:1048] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.985998 16908 tablet_loader.cc:96] loaded metadata for tablet 75d0c5e694734b37848c4127c4e97085 (table default.Table_78daee932a6e4b46b0271ad11e4715c8 [id=9a293f6565184a56a16bf3e755444870])
I20251025 08:02:30.986723 16908 tablet_loader.cc:96] loaded metadata for tablet 77f04f445b5d47d2a78fdac0641a7372 (table default.Table_3d5f1adc46e8481386de4051dd453445 [id=7481684b10d946299ea5a1f0918a2407])
I20251025 08:02:30.990525 16390 tablet_bootstrap.cc:492] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:30.990598 16390 ts_tablet_manager.cc:1403] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20251025 08:02:30.990970 16390 raft_consensus.cc:359] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.991048 16390 raft_consensus.cc:385] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:30.991076 16390 raft_consensus.cc:740] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:30.991176 16390 consensus_queue.cc:260] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:30.991431 16390 ts_tablet_manager.cc:1434] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:30.991575 16390 tablet_bootstrap.cc:492] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:30.992539 16390 tablet_bootstrap.cc:654] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:30.992771 16199 consensus_queue.cc:1048] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.992683 17054 consensus_queue.cc:1048] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20251025 08:02:30.994095 16908 tablet_loader.cc:96] loaded metadata for tablet 7dd513b6c7a24dffb91f66c32acc7696 (table default.Table_49bbc2328aab41cda10e05a7fb925cd9 [id=1338885c63014b47bcd512a9ddfaf31d])
I20251025 08:02:30.994457 16908 tablet_loader.cc:96] loaded metadata for tablet 7f5c6a17507d4a5a8057a725d3299ab9 (table default.Table_c13a8bad402148f19fcdc19766286842 [id=b5be4f412cc04aa59c819d0e1cc403bf])
I20251025 08:02:30.995165 16908 tablet_loader.cc:96] loaded metadata for tablet 82b93b7537c047aea430658ae2c2654b (table default.Table_0ac9d6fdd08b48f0b70da65d5f7a722a [id=7c9a46c4cada46ad916b89605c18190f])
I20251025 08:02:30.995523 16908 tablet_loader.cc:96] loaded metadata for tablet 8362e26d86d44e9780d3c78c6a468556 (table default.Table_5a29e7dba4ba43dfbd0c27981080a1ac [id=8611464429b848fbb277f6a03557cd0d])
I20251025 08:02:30.995764 16908 tablet_loader.cc:96] loaded metadata for tablet 85c7748077184fdda472821a0826cd77 (table default.Table_e3dddd8db8a64833bd7de5ad2fec599a [id=9b1cfdaffd964fba879de8e58c7ac93c])
I20251025 08:02:30.996109 16908 tablet_loader.cc:96] loaded metadata for tablet 86b1873446154249a80fa67b99496545 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155])
I20251025 08:02:30.996452 16908 tablet_loader.cc:96] loaded metadata for tablet 878883a39db14b2dac25abacdc3dd0eb (table default.Table_37a4fd748a93467eb24cd79ee89df4ef [id=d785bc9e4c3b4e4c856d280eeba182e6])
I20251025 08:02:30.997897 15384 consensus_queue.cc:1048] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:30.998469 16908 tablet_loader.cc:96] loaded metadata for tablet 89eda91ab00245418389e614550f20c1 (table default.Table_7c6a96cbfd864aa9842d67953f6853d4 [id=6f74f5eecc0b48a48a191ee958d7a651])
I20251025 08:02:30.998705 16908 tablet_loader.cc:96] loaded metadata for tablet 8b69d792862540b6ad1b5d56dea17499 (table default.Table_8c890e1813a149b88e2168cf6a19b056 [id=90132a732dd24174a9b63820b5ce85f6])
I20251025 08:02:30.998939 16908 tablet_loader.cc:96] loaded metadata for tablet 8b6ae6527fd64c3bb5999dec97db861d (table default.Table_599c0d46a95d45b4aa9bab3b54b52470 [id=b8e6ffed1a2e442db3c9ee5ac1a6ff3d])
I20251025 08:02:30.999996 16908 tablet_loader.cc:96] loaded metadata for tablet 95030a851b5d4155b235a4e896250c80 (table default.Table_8001f289cc1341ce83a82f259b0255f1 [id=786fb14e6748434da35e7a7da1289963])
I20251025 08:02:31.000998 16391 tablet_bootstrap.cc:492] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.001076 16391 ts_tablet_manager.cc:1403] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.001s
I20251025 08:02:31.001485 16391 raft_consensus.cc:359] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.001586 16391 raft_consensus.cc:385] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.001622 16391 raft_consensus.cc:740] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.001727 16391 consensus_queue.cc:260] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.001967 16391 ts_tablet_manager.cc:1434] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.002139 16391 tablet_bootstrap.cc:492] T 442d83935a0a41658508e3022f4b557f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.002673 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86b1873446154249a80fa67b99496545" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.002847 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e967a52212164b8cb6f9c39f207024a1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.003259 16391 tablet_bootstrap.cc:654] T 442d83935a0a41658508e3022f4b557f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.005827 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ab6b9d8278045ae92043ada5ce6dd71" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.006132 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7dd513b6c7a24dffb91f66c32acc7696" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.008317 15909 consensus_queue.cc:1048] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.010499 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4ff32cab636840bc86a54aa6c91e9456" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.010743 16908 tablet_loader.cc:96] loaded metadata for tablet 95c9778bd0d94542bec79e9d36c6ce46 (table default.Table_754e539219a14fbba92f1f3fe54b0f2e [id=3e1281c3f28346a4a1dd2c4fcc990a2e])
I20251025 08:02:31.010890 17043 consensus_queue.cc:1048] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.011346 16908 tablet_loader.cc:96] loaded metadata for tablet 997c8c5921ad4ec18914fd50c97fc33e (table default.Table_56b69a1e3b4d4e7dbaa6a4697a940880 [id=cb9294ed7c474aae989ac13159ec3166])
I20251025 08:02:31.011409 17054 raft_consensus.cc:493] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.011492 17054 raft_consensus.cc:515] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.011685 16908 tablet_loader.cc:96] loaded metadata for tablet 9bb5b825be9a44d489151239947d471e (table default.Table_f84103a22819458c976f0d1ca4716b47 [id=fe4920e7d4f143388063f22590eb2f64])
I20251025 08:02:31.011829 17054 leader_election.cc:290] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.012508 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73cdd9616b9c460f8fcd4a40e4a3ccc8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:31.012995 15049 leader_election.cc:343] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.013806 16908 tablet_loader.cc:96] loaded metadata for tablet a547fb54ddbf4053b5be20ee6c4fc6b0 (table default.Table_a4db03b0afac4934abd7b889be3d9f30 [id=9759ac18bd46453eab5a8c294a229886])
I20251025 08:02:31.015281 17054 raft_consensus.cc:493] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.015368 17054 raft_consensus.cc:515] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.015625 17054 leader_election.cc:290] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.016139 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "174daf21bc41408d825ebe926af39c1b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:31.016461 14915 consensus_peers.cc:597] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e90c358ef454760b8317d78724ee377. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:31.016623 14915 leader_election.cc:304] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:31.016892 15049 leader_election.cc:343] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.016957 15864 raft_consensus.cc:3060] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.017812 15864 raft_consensus.cc:2749] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.018416 15909 consensus_queue.cc:1048] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.019407 16391 tablet_bootstrap.cc:492] T 442d83935a0a41658508e3022f4b557f P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.019495 16391 ts_tablet_manager.cc:1403] T 442d83935a0a41658508e3022f4b557f P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20251025 08:02:31.019891 16391 raft_consensus.cc:359] T 442d83935a0a41658508e3022f4b557f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.019970 16391 raft_consensus.cc:385] T 442d83935a0a41658508e3022f4b557f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.020000 16391 raft_consensus.cc:740] T 442d83935a0a41658508e3022f4b557f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.020099 16391 consensus_queue.cc:260] T 442d83935a0a41658508e3022f4b557f P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.020366 16391 ts_tablet_manager.cc:1434] T 442d83935a0a41658508e3022f4b557f P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.020515 16391 tablet_bootstrap.cc:492] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.021344 16391 tablet_bootstrap.cc:654] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.022372 17054 raft_consensus.cc:493] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.022468 17054 raft_consensus.cc:515] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.022742 17054 leader_election.cc:290] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.023344 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "174daf21bc41408d825ebe926af39c1b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.023386 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73cdd9616b9c460f8fcd4a40e4a3ccc8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.023952 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d81b65e094a34703ac47897d9bfa4c7c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:31.024507 15049 leader_election.cc:343] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.024812 17054 consensus_queue.cc:1048] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:31.025995 15048 leader_election.cc:343] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.026064 15048 leader_election.cc:304] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:31.026237 15048 leader_election.cc:343] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.026281 15048 leader_election.cc:304] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.026378 16582 raft_consensus.cc:2749] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.026456 16582 raft_consensus.cc:2749] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.026693 15380 consensus_queue.cc:1048] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:31.026737 15048 leader_election.cc:343] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.026786 15048 leader_election.cc:304] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.026875 15380 consensus_queue.cc:1048] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.027082 15380 raft_consensus.cc:2749] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.027207 16908 tablet_loader.cc:96] loaded metadata for tablet a68d3a248e944a83ba77b651793cc480 (table default.Table_bd3b1a4a23a447bead9ce165c79693e6 [id=000ce64aa9d14e45ae6570f8948bb0a3])
I20251025 08:02:31.027753 16908 tablet_loader.cc:96] loaded metadata for tablet a941ba28528d41699390e9db80f25594 (table default.Table_155857795087477392a338e28fb60afc [id=b58927a3527c45cb946d1fcc0681d6bf])
I20251025 08:02:31.028237 16908 tablet_loader.cc:96] loaded metadata for tablet adc14c254b0c4974bfbadede727b6c6b (table default.Table_d8110cf18c6748b092f8bf7348349f88 [id=53d57abf556c4926b02a1e265cf34c61])
I20251025 08:02:31.028702 16908 tablet_loader.cc:96] loaded metadata for tablet af5a5d2903ff4142b1f1e70dd2a7d173 (table default.Table_97dcb2270cdf4d21824166c30b3a62a9 [id=d53447a316c5438e86cdac872682b3a1])
I20251025 08:02:31.029970 16199 consensus_queue.cc:1048] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.031160 16391 tablet_bootstrap.cc:492] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.031243 16391 ts_tablet_manager.cc:1403] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20251025 08:02:31.031320 16908 tablet_loader.cc:96] loaded metadata for tablet b3fdc5bd4c7f4506a150f31137e8b091 (table default.Table_a01a1e605d7944fc9e89f1b656ccd903 [id=ff44f0c128c44faa9f36925f9477c66a])
I20251025 08:02:31.031517 16908 tablet_loader.cc:96] loaded metadata for tablet b41e092b7f40410a979bcfd5bbc7c225 (table default.Table_e9a56ee98afd4b14bb77f82f256e8379 [id=7769118047914c3eb51e98a441aa5c50])
I20251025 08:02:31.031683 16391 raft_consensus.cc:359] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.031716 16908 tablet_loader.cc:96] loaded metadata for tablet b4d1c652b6a4420a81e03cd58c6dbc69 (table default.Table_c2e0c935fdb34bc38f482cac268ad080 [id=62e3c831964e4f71a8ee6aca23069b44])
I20251025 08:02:31.031766 16391 raft_consensus.cc:385] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.031800 16391 raft_consensus.cc:740] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.031912 16908 tablet_loader.cc:96] loaded metadata for tablet b7bb3d7d89674b7e825868c17495bbb3 (table default.Table_c6928dca846645b8887db36cc7cb9675 [id=9d1a6ae0121b45cda008d5dda6ea7e35])
I20251025 08:02:31.031926 16391 consensus_queue.cc:260] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.032217 16391 ts_tablet_manager.cc:1434] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:31.032387 16391 tablet_bootstrap.cc:492] T b866fc38e3444514b834f7876fb700ed P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.032428 16908 tablet_loader.cc:96] loaded metadata for tablet b7ff0b4596944f38ae9325a95167c287 (table default.Table_f2e0f883fa4646a0aa3e785a7de7f152 [id=ea0a64fc70c84a7eb2b7c8e8e4a933fe])
I20251025 08:02:31.032514 16570 consensus_queue.cc:1048] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.032617 16908 tablet_loader.cc:96] loaded metadata for tablet b866fc38e3444514b834f7876fb700ed (table default.Table_66c1bf4cbbca4bf086d9409663f762f2 [id=cf8fb3a063d049e5bd23bcfb9cf64b59])
I20251025 08:02:31.033116 16908 tablet_loader.cc:96] loaded metadata for tablet bcf414d04305456b80b2ec5dd8fb0ba7 (table default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24])
I20251025 08:02:31.033385 16391 tablet_bootstrap.cc:654] T b866fc38e3444514b834f7876fb700ed P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.033638 16908 tablet_loader.cc:96] loaded metadata for tablet bf34039d909949af9357299bf8204891 (table default.Table_0762822d85ed47bc93809bd77c712935 [id=1e0739ca3fad4a22893a3453c3b2eac8])
I20251025 08:02:31.034329 16908 tablet_loader.cc:96] loaded metadata for tablet bfdc6022cc5747439edcb8aa865b9437 (table default.Table_5bc70f62257c438bb0c52926674f2bdf [id=e62c2aba4e5546e2bd881c5f2ae3abd4])
I20251025 08:02:31.035102 16908 tablet_loader.cc:96] loaded metadata for tablet c043ab70d7364e05b0b352ac5c416db1 (table default.Table_21b4f92893424716afe86f9c67b6a691 [id=db6654cc26a348709c7f0577b91f18af])
I20251025 08:02:31.035161 17043 consensus_queue.cc:1048] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.037658 16390 tablet_bootstrap.cc:492] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.037731 16390 ts_tablet_manager.cc:1403] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.000s
I20251025 08:02:31.038128 16390 raft_consensus.cc:359] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.038237 16390 raft_consensus.cc:385] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.038270 16390 raft_consensus.cc:740] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.038367 16390 consensus_queue.cc:260] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.038619 16390 ts_tablet_manager.cc:1434] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.038774 16390 tablet_bootstrap.cc:492] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.039592 16390 tablet_bootstrap.cc:654] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.041855 16908 tablet_loader.cc:96] loaded metadata for tablet c2415c51234f482ca295cc71a74e7cab (table default.Table_9f2128ef54374befaec2adc1a1295f27 [id=bc094a879104430797416fd06811a2e3])
I20251025 08:02:31.042101 16908 tablet_loader.cc:96] loaded metadata for tablet c59083b54df24c21a3114c34a73dd638 (table default.Table_808c7980d96b48a181f79124ea5a0adb [id=e3c0ae796ee2421abe38408b729dd2a6])
I20251025 08:02:31.043022 15909 raft_consensus.cc:493] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.043094 15909 raft_consensus.cc:515] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.043376 15909 leader_election.cc:290] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:31.043449 15909 raft_consensus.cc:493] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.043500 15909 raft_consensus.cc:515] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.043803 15909 leader_election.cc:290] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.043942 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c582efa6d334a06a48e2f2b94167776" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.044041 15113 raft_consensus.cc:2468] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.044055 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6cca70bc3c48bf9c2396fdfdb8e42c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.044165 15112 raft_consensus.cc:2468] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.044270 15185 leader_election.cc:304] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.044301 16908 tablet_loader.cc:96] loaded metadata for tablet c6ee2b8cfe7743d29714910fe8060083 (table default.Table_789c5c7cc2df43f4b7c5c63316f47042 [id=aa46eca7031242f3b4a3144dd521cc6b])
I20251025 08:02:31.044413 15384 raft_consensus.cc:2804] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.044481 15384 raft_consensus.cc:493] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.044533 15384 raft_consensus.cc:3060] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.044543 15185 leader_election.cc:304] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.044600 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c582efa6d334a06a48e2f2b94167776" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:31.045148 15183 leader_election.cc:343] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.045480 15384 raft_consensus.cc:515] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.045748 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6cca70bc3c48bf9c2396fdfdb8e42c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.045809 15384 leader_election.cc:290] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:31.045890 15384 raft_consensus.cc:2804] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.045928 15384 raft_consensus.cc:493] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.045964 15384 raft_consensus.cc:3060] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.046028 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c582efa6d334a06a48e2f2b94167776" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.046111 15112 raft_consensus.cc:3060] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:31.046232 15183 leader_election.cc:343] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.046269 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6c582efa6d334a06a48e2f2b94167776" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:31.046630 15183 leader_election.cc:343] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.046805 15384 raft_consensus.cc:515] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.047109 15384 leader_election.cc:290] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.047194 15384 consensus_queue.cc:1048] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.047322 15112 raft_consensus.cc:2468] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.047569 15185 leader_election.cc:304] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:31.047724 15909 raft_consensus.cc:2804] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.047802 15909 raft_consensus.cc:697] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.047904 15909 consensus_queue.cc:237] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.048048 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6cca70bc3c48bf9c2396fdfdb8e42c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.048130 15113 raft_consensus.cc:3060] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.048946 15113 raft_consensus.cc:2468] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.049293 16908 tablet_loader.cc:96] loaded metadata for tablet c84d6bed24444dcfab1920efad849932 (table default.Table_67238f79fb2446bd9c19c32182814dd0 [id=3c97ef2101a945cd900b30a00a1c8459])
I20251025 08:02:31.049320 15185 leader_election.cc:304] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.049472 16572 raft_consensus.cc:2804] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.049556 16572 raft_consensus.cc:697] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.049666 16572 consensus_queue.cc:237] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:31.027087 15048 leader_election.cc:343] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.050190 15048 leader_election.cc:304] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.050406 16582 raft_consensus.cc:2749] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.050419 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6cca70bc3c48bf9c2396fdfdb8e42c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:31.050686 15048 leader_election.cc:343] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.050707 16908 tablet_loader.cc:96] loaded metadata for tablet cb3569ec2cdd4736b264b00abf1fa36a (table default.Table_08073379da334076bcc5503770a32982 [id=1ee33ee129d749d0bd7f26dc49fca0fe])
I20251025 08:02:31.050758 15048 leader_election.cc:304] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.050895 16908 tablet_loader.cc:96] loaded metadata for tablet cc676245d2984363b4af1e817b444c3d (table default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8])
I20251025 08:02:31.050895 16582 raft_consensus.cc:2749] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.051061 16582 consensus_queue.cc:1048] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:31.051095 15048 leader_election.cc:343] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.051142 15048 leader_election.cc:304] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:31.051275 15048 leader_election.cc:343] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.051313 15048 leader_election.cc:304] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.051353 16582 raft_consensus.cc:2749] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.051424 16582 raft_consensus.cc:2749] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.051641 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d81b65e094a34703ac47897d9bfa4c7c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.052829 16908 tablet_loader.cc:96] loaded metadata for tablet ce5ae591c86c4455a1dd3704f1c95d1c (table default.Table_9c7e0359120c415cba47b89251b0be94 [id=4510ebbcd6ee43babe7ee133a0ce6ae5])
W20251025 08:02:31.054493 15183 leader_election.cc:343] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.054658 16390 tablet_bootstrap.cc:492] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.054728 16390 ts_tablet_manager.cc:1403] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20251025 08:02:31.055158 16390 raft_consensus.cc:359] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.055253 16390 raft_consensus.cc:385] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.055289 16390 raft_consensus.cc:740] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.055392 16390 consensus_queue.cc:260] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.055670 16390 ts_tablet_manager.cc:1434] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.055821 16390 tablet_bootstrap.cc:492] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.056725 16390 tablet_bootstrap.cc:654] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.059046 16908 tablet_loader.cc:96] loaded metadata for tablet d049bf946c744664aba74d7a12fa4ff1 (table default.Table_fe4cbb31d8584609ab3669f24baa8c27 [id=33bbe4605d924011b9002a939a73203d])
I20251025 08:02:31.060388 16908 tablet_loader.cc:96] loaded metadata for tablet d05bf0056dfc43eeb4105af559497bdc (table default.Table_ea3622c669ee4aa5a2b88a9e87aeadaf [id=72243e33e90940c09953a9ec2fcfd435])
I20251025 08:02:31.061120 16908 tablet_loader.cc:96] loaded metadata for tablet d116fbec0c6149938b8f6c19af9607af (table default.Table_85ecb3ae3f1a4810b5abcb29f861e881 [id=c1cc91015b38477f93e56504bf700ffb])
I20251025 08:02:31.061491 16908 tablet_loader.cc:96] loaded metadata for tablet d14e12c45323420b84de06d828238caa (table default.Table_889a72b0cc55456889c7b37190901b20 [id=6b4ebc3c554648b48d6ea2f5916e1bad])
I20251025 08:02:31.062608 16908 tablet_loader.cc:96] loaded metadata for tablet d162f3ee21bd40ce9a9c74b7863a3878 (table default.Table_a6c6f65ea3444858aa562a65d71c4e77 [id=2ef2d72066f446619f9045da34df7814])
W20251025 08:02:31.065223 14915 consensus_peers.cc:597] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d709ecb9ac9a4525985c7d2bf10719f5. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:31.065346 16908 tablet_loader.cc:96] loaded metadata for tablet d81b65e094a34703ac47897d9bfa4c7c (table default.Table_e0041c8cf73f46c5b49515b6f328f500 [id=768625af4c474964ad2b502cf0b03fa7])
I20251025 08:02:31.065809 16908 tablet_loader.cc:96] loaded metadata for tablet d993e2350f37492bb712d145d03e8afb (table default.Table_1ccbe630ac5a41ecb7b00087172bec38 [id=1e716be545914b22887b2f7e069c41c4])
I20251025 08:02:31.066380 16390 tablet_bootstrap.cc:492] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.066454 16390 ts_tablet_manager.cc:1403] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s
I20251025 08:02:31.066829 16390 raft_consensus.cc:359] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.066912 16390 raft_consensus.cc:385] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.066946 16390 raft_consensus.cc:740] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.067063 16390 consensus_queue.cc:260] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.067303 16390 ts_tablet_manager.cc:1434] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.067461 16390 tablet_bootstrap.cc:492] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.068306 16390 tablet_bootstrap.cc:654] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.070039 16390 tablet_bootstrap.cc:492] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.070116 16390 ts_tablet_manager.cc:1403] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:31.070674 16390 raft_consensus.cc:359] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.070773 16390 raft_consensus.cc:385] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.070809 16390 raft_consensus.cc:740] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.070911 16390 consensus_queue.cc:260] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.071274 16390 ts_tablet_manager.cc:1434] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.071444 16390 tablet_bootstrap.cc:492] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.071542 15384 consensus_queue.cc:1048] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.071858 16857 raft_consensus.cc:493] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.071961 16857 raft_consensus.cc:515] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.072280 16857 leader_election.cc:290] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.073101 16390 tablet_bootstrap.cc:654] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.073194 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "685d09c4a80b4d48b477cd4c0fc9db40" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.075158 16908 tablet_loader.cc:96] loaded metadata for tablet e0cc4859d32a4e119b413e1cbbb52834 (table default.Table_acf14806991f4da89dc9bb3361537133 [id=e63210d8c6d148e18496c0bc0d326ab9])
I20251025 08:02:31.076097 16908 tablet_loader.cc:96] loaded metadata for tablet e2b014e0f49c4f7da8e65b7d4c98ea63 (table default.Table_5228048f3783458dbb44280a7a6e4816 [id=7fe739c2f676459d8c73632266babedb])
I20251025 08:02:31.076574 16570 consensus_queue.cc:1048] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.076894 16908 tablet_loader.cc:96] loaded metadata for tablet e5e907ec8e7c420d8d6d68a954cc8beb (table default.Table_85a7a7da077848fe960699e536360b41 [id=76245c883dcd4a6d8526bfc7ac12f4cb])
I20251025 08:02:31.077080 16908 tablet_loader.cc:96] loaded metadata for tablet e66c7b43490a4391a59e09f1832a53b3 (table default.Table_fa9d9b9a535648d89d19b74bb940ed9f [id=b3e6b8f18f2f40fc977b978d7d2c1b0b])
I20251025 08:02:31.077679 16420 consensus_queue.cc:1048] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.083142 16908 tablet_loader.cc:96] loaded metadata for tablet e87bae31e5e642a5a34a8c170c62fdca (table default.Table_3ad0d85469a7485ba556f83ce20cecdf [id=edf9af4acd364a30814a645d32d35224])
I20251025 08:02:31.083357 16908 tablet_loader.cc:96] loaded metadata for tablet e967a52212164b8cb6f9c39f207024a1 (table default.Table_cc90154d79cc47bd82be7afaff1b0186 [id=0a4629613477421ba329364dbb42a8b6])
I20251025 08:02:31.083567 16908 tablet_loader.cc:96] loaded metadata for tablet ea0d438e99864c57999abf3467edc643 (table default.Table_3c48d3160e5d42509de4f0be1af855e2 [id=912da5ef8bbf4af29528c084ea7fa633])
I20251025 08:02:31.083811 16908 tablet_loader.cc:96] loaded metadata for tablet ed2036a8ebd74ab18c0bbd6d9aa67ef0 (table default.Table_0517aaafe6e64827b84bb99171d2ad75 [id=a8e0504bc08744b4915157fa63d2226e])
I20251025 08:02:31.084503 16908 tablet_loader.cc:96] loaded metadata for tablet ed5ed91e953d42afa9ebf9ab8b89d0e6 (table default.Table_a901c364849c4301910d7c32f0ec25fc [id=cadc2427db7c404cbbf9d3542145cccc])
I20251025 08:02:31.085516 16908 tablet_loader.cc:96] loaded metadata for tablet f3f42babc0b2421fa80b265997effe36 (table default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37])
I20251025 08:02:31.086071 16390 tablet_bootstrap.cc:492] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.086146 16390 ts_tablet_manager.cc:1403] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251025 08:02:31.086591 16390 raft_consensus.cc:359] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.086673 16390 raft_consensus.cc:385] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.086704 16390 raft_consensus.cc:740] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.086804 16390 consensus_queue.cc:260] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.087054 16390 ts_tablet_manager.cc:1434] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:31.087219 16390 tablet_bootstrap.cc:492] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.088039 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "685d09c4a80b4d48b477cd4c0fc9db40" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.088140 16390 tablet_bootstrap.cc:654] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.088183 15110 raft_consensus.cc:2393] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:31.089867 16908 tablet_loader.cc:96] loaded metadata for tablet f426e93af38e4e17b30cd01eea12dcac (table default.Table_6ae9d9f6f9b942e689eecb0548fdf715 [id=a1ed1a0c27ef42c69acd197420340d7d])
I20251025 08:02:31.090471 16908 tablet_loader.cc:96] loaded metadata for tablet f5f72ca8cfb94178a21619ddc9fc0352 (table default.Table_75b0519af19a461d8dd5bdfd0c7a50c5 [id=b73d5c5cd3824129b9efc54f3aa7c304])
I20251025 08:02:31.090714 16908 tablet_loader.cc:96] loaded metadata for tablet f6082b299bb44d31b567f70d8da7f0ac (table default.Table_c5c036d7c66344eba94e15be432088bc [id=ebfa83131bd946d0897b32ef3c188c19])
I20251025 08:02:31.091214 16908 tablet_loader.cc:96] loaded metadata for tablet f65b1ad4764a4ed3a33baccaf278f043 (table default.Table_b074f35366374acd92bf7528094773a0 [id=afe8a5e6aa824ba69530f71c2b2d4617])
I20251025 08:02:31.091545 16908 tablet_loader.cc:96] loaded metadata for tablet f8576553f17b49f8bd11436ecac471ed (table default.Table_1ba04ec4ed664c8eaaeddbf2485375ae [id=2283253a9522485d93d6c484c5eef6e4])
I20251025 08:02:31.092541 16908 tablet_loader.cc:96] loaded metadata for tablet f9a7f96be1e2427bb0c4e109c6bac400 (table default.Table_85b56f9883d74360a81c24c7dbe31f32 [id=03f81977ce8b4edbaf54dceff38426af])
I20251025 08:02:31.094316 16570 raft_consensus.cc:493] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.094383 16570 raft_consensus.cc:515] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.094640 16570 leader_election.cc:290] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.094893 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0cc4859d32a4e119b413e1cbbb52834" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.095013 15113 raft_consensus.cc:2468] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.095023 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0cc4859d32a4e119b413e1cbbb52834" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.095137 16908 tablet_loader.cc:96] loaded metadata for tablet f9ccba7de6874245bc0e1cdb8e8acfb1 (table default.Table_cac23e61bde0461d9772761aba8b3abb [id=8f399d7e1e774ee79ae9b9892dbc2d18])
I20251025 08:02:31.095326 15185 leader_election.cc:304] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
W20251025 08:02:31.095467 15183 leader_election.cc:343] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.095470 16570 raft_consensus.cc:2804] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.095552 16570 raft_consensus.cc:493] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.095589 16570 raft_consensus.cc:3060] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.096377 16390 tablet_bootstrap.cc:492] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.096446 16390 ts_tablet_manager.cc:1403] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s
I20251025 08:02:31.096494 16570 raft_consensus.cc:515] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.096796 16570 leader_election.cc:290] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.096828 16390 raft_consensus.cc:359] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.096915 16390 raft_consensus.cc:385] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.096944 16390 raft_consensus.cc:740] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.096958 16908 tablet_loader.cc:96] loaded metadata for tablet fb4faadd4fc146a5af032ce815bd6cc4 (table default.Table_9ad25f68a3a040818a9cd919b194b424 [id=5c3e59374e02472bb347c7891cb16537])
I20251025 08:02:31.097043 16390 consensus_queue.cc:260] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.097179 16908 tablet_loader.cc:96] loaded metadata for tablet fba2914feb95475fbbfc5cef5a653408 (table default.Table_cce271e6706043dabfbd2c4b55bf198b [id=3a6e3a35c29b486b9ed32bc6fe1ec042])
I20251025 08:02:31.097241 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0cc4859d32a4e119b413e1cbbb52834" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.097360 16390 ts_tablet_manager.cc:1434] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:31.097383 16908 tablet_loader.cc:96] loaded metadata for tablet fbae08a3a1c34dfda60b1985346e7761 (table default.Table_075d43596a3d4f1e889c2cd50b615157 [id=fb192136f9d9453a8d0aad2c1103118d])
I20251025 08:02:31.097525 16390 tablet_bootstrap.cc:492] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.097582 16908 tablet_loader.cc:96] loaded metadata for tablet fc5f892ca7a246a28a556fe0eb3f5442 (table default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b [id=4e47e7759fc64598807f1ee3a973820f])
W20251025 08:02:31.097540 15183 leader_election.cc:343] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.098085 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0cc4859d32a4e119b413e1cbbb52834" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.098131 16908 tablet_loader.cc:96] loaded metadata for tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799])
I20251025 08:02:31.098372 15113 raft_consensus.cc:3060] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.099344 15113 raft_consensus.cc:2468] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.099635 15185 leader_election.cc:304] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:31.099788 16199 raft_consensus.cc:2804] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.099879 16199 raft_consensus.cc:697] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.099974 16199 consensus_queue.cc:237] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.100160 16908 catalog_manager.cc:1494] Initializing Kudu cluster ID...
I20251025 08:02:31.101593 16390 tablet_bootstrap.cc:654] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.103351 16857 consensus_queue.cc:1048] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.103844 16857 consensus_queue.cc:1048] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.104429 16857 consensus_queue.cc:1048] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.105566 16391 tablet_bootstrap.cc:492] T b866fc38e3444514b834f7876fb700ed P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.105654 16391 ts_tablet_manager.cc:1403] T b866fc38e3444514b834f7876fb700ed P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.073s user 0.001s sys 0.001s
I20251025 08:02:31.105990 14915 leader_election.cc:304] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.106083 16391 raft_consensus.cc:359] T b866fc38e3444514b834f7876fb700ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.106149 16857 raft_consensus.cc:3060] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.106164 16391 raft_consensus.cc:385] T b866fc38e3444514b834f7876fb700ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.106215 16391 raft_consensus.cc:740] T b866fc38e3444514b834f7876fb700ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.106312 16391 consensus_queue.cc:260] T b866fc38e3444514b834f7876fb700ed P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.106570 16391 ts_tablet_manager.cc:1434] T b866fc38e3444514b834f7876fb700ed P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.106711 16391 tablet_bootstrap.cc:492] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.107065 16857 raft_consensus.cc:2749] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.107651 16391 tablet_bootstrap.cc:654] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.109356 16966 raft_consensus.cc:493] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.109437 16966 raft_consensus.cc:515] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.109752 16966 leader_election.cc:290] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.110258 16966 raft_consensus.cc:493] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.110342 16966 raft_consensus.cc:515] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:31.110365 15048 leader_election.cc:343] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.110427 15048 leader_election.cc:304] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.110622 16966 leader_election.cc:290] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.110828 16966 raft_consensus.cc:2749] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.111002 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6d1979a4f43a4659976b0cd6d1b888ef" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.111169 16966 consensus_queue.cc:1048] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.111380 16966 consensus_queue.cc:1048] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.111963 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7bb3d7d89674b7e825868c17495bbb3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.112404 14973 raft_consensus.cc:3060] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.112422 16570 raft_consensus.cc:493] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.112486 16570 raft_consensus.cc:515] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.112777 16570 leader_election.cc:290] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
W20251025 08:02:31.113229 15049 leader_election.cc:343] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:31.113339 15049 leader_election.cc:343] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.113562 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "442d83935a0a41658508e3022f4b557f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.113672 15113 raft_consensus.cc:2468] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.113898 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "442d83935a0a41658508e3022f4b557f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.113905 15185 leader_election.cc:304] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.114027 14973 raft_consensus.cc:2468] T 442d83935a0a41658508e3022f4b557f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.114087 16572 raft_consensus.cc:2804] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.114132 16572 raft_consensus.cc:493] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.114174 16572 raft_consensus.cc:3060] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.114593 15380 consensus_queue.cc:1048] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.115151 16572 raft_consensus.cc:515] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.115507 16572 leader_election.cc:290] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:31.115715 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "442d83935a0a41658508e3022f4b557f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.115813 15113 raft_consensus.cc:3060] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.116689 15113 raft_consensus.cc:2468] T 442d83935a0a41658508e3022f4b557f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.116894 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "442d83935a0a41658508e3022f4b557f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.116961 15185 leader_election.cc:304] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.116990 14973 raft_consensus.cc:3060] T 442d83935a0a41658508e3022f4b557f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.117121 16570 raft_consensus.cc:2804] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.117201 16570 raft_consensus.cc:697] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.117318 16570 consensus_queue.cc:237] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.117828 14973 raft_consensus.cc:2468] T 442d83935a0a41658508e3022f4b557f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.118541 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7bb3d7d89674b7e825868c17495bbb3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.119594 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6d1979a4f43a4659976b0cd6d1b888ef" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.119624 16908 catalog_manager.cc:1269] Loaded cluster ID: f2d8b893da824042af3b8623826039ce
I20251025 08:02:31.119671 16908 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
I20251025 08:02:31.121373 15642 consensus_queue.cc:1048] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:31.121755 15048 leader_election.cc:343] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.121845 15048 leader_election.cc:304] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.122023 15642 raft_consensus.cc:2749] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.126672 16420 consensus_queue.cc:1048] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:31.127211 15048 leader_election.cc:343] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.127311 15048 leader_election.cc:304] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.127460 15642 raft_consensus.cc:2749] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.129721 16572 raft_consensus.cc:493] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.129799 16572 raft_consensus.cc:515] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.130205 16572 leader_election.cc:290] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:31.130434 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "212ccfb58f964d7bae31e5af110b4079" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.130535 15111 raft_consensus.cc:2468] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.130736 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "212ccfb58f964d7bae31e5af110b4079" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:31.131021 15183 leader_election.cc:343] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.131119 15185 leader_election.cc:304] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:31.131510 16570 raft_consensus.cc:2804] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.131563 16570 raft_consensus.cc:493] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.131596 16570 raft_consensus.cc:3060] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.132524 16570 raft_consensus.cc:515] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.132822 16570 leader_election.cc:290] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:31.133062 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "212ccfb58f964d7bae31e5af110b4079" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.133162 15111 raft_consensus.cc:3060] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.133409 16420 consensus_queue.cc:1048] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.134253 15111 raft_consensus.cc:2468] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.134511 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "212ccfb58f964d7bae31e5af110b4079" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.134685 15185 leader_election.cc:304] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.134822 16572 raft_consensus.cc:2804] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.134905 16572 raft_consensus.cc:697] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.135031 16572 consensus_queue.cc:237] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:31.135089 15183 leader_election.cc:343] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.144492 16420 consensus_queue.cc:1048] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.146281 16582 consensus_queue.cc:1048] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.146409 16391 tablet_bootstrap.cc:492] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.146482 16391 ts_tablet_manager.cc:1403] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20251025 08:02:31.146914 16391 raft_consensus.cc:359] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.147004 16391 raft_consensus.cc:385] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.147047 16391 raft_consensus.cc:740] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.147145 16391 consensus_queue.cc:260] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.147404 16391 ts_tablet_manager.cc:1434] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.147558 16391 tablet_bootstrap.cc:492] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.148533 16391 tablet_bootstrap.cc:654] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.149780 15497 consensus_queue.cc:1048] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.160468 15642 raft_consensus.cc:493] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.160553 15642 raft_consensus.cc:515] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.160698 17094 consensus_queue.cc:1048] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.160852 15642 leader_election.cc:290] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.161217 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47c5c768eafa494db9a0110bf5625451" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:31.164168 15049 leader_election.cc:343] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.164377 16390 tablet_bootstrap.cc:492] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.164453 16390 ts_tablet_manager.cc:1403] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.067s user 0.002s sys 0.000s
I20251025 08:02:31.164912 16390 raft_consensus.cc:359] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.165000 16390 raft_consensus.cc:385] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.165040 16390 raft_consensus.cc:740] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.165163 16390 consensus_queue.cc:260] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.165462 16390 ts_tablet_manager.cc:1434] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.165614 16390 tablet_bootstrap.cc:492] T f9ccba7de6874245bc0e1cdb8e8acfb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.166661 16390 tablet_bootstrap.cc:654] T f9ccba7de6874245bc0e1cdb8e8acfb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.169381 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47c5c768eafa494db9a0110bf5625451" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.171489 16908 catalog_manager.cc:1514] Loading token signing keys...
I20251025 08:02:31.171566 16390 tablet_bootstrap.cc:492] T f9ccba7de6874245bc0e1cdb8e8acfb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.171646 16390 ts_tablet_manager.cc:1403] T f9ccba7de6874245bc0e1cdb8e8acfb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.002s
I20251025 08:02:31.171749 16572 raft_consensus.cc:493] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.171824 16572 raft_consensus.cc:515] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.172062 16390 raft_consensus.cc:359] T f9ccba7de6874245bc0e1cdb8e8acfb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.172151 16572 leader_election.cc:290] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:31.172168 16390 raft_consensus.cc:385] T f9ccba7de6874245bc0e1cdb8e8acfb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.172199 16390 raft_consensus.cc:740] T f9ccba7de6874245bc0e1cdb8e8acfb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.172307 16390 consensus_queue.cc:260] T f9ccba7de6874245bc0e1cdb8e8acfb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.172376 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85c7748077184fdda472821a0826cd77" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.172436 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85c7748077184fdda472821a0826cd77" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.172482 15112 raft_consensus.cc:2468] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.172711 16390 ts_tablet_manager.cc:1434] T f9ccba7de6874245bc0e1cdb8e8acfb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:31.172802 15185 leader_election.cc:304] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.172861 16390 tablet_bootstrap.cc:492] T 55db2958c76e4886b807fdb237f9b2a9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.172930 16572 raft_consensus.cc:2804] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.172993 16572 raft_consensus.cc:493] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.173032 16572 raft_consensus.cc:3060] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:31.173094 15183 leader_election.cc:343] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.173936 16572 raft_consensus.cc:515] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.174284 16572 leader_election.cc:290] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:31.174535 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85c7748077184fdda472821a0826cd77" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.174628 15112 raft_consensus.cc:3060] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.175614 16390 tablet_bootstrap.cc:654] T 55db2958c76e4886b807fdb237f9b2a9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.175601 15112 raft_consensus.cc:2468] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
W20251025 08:02:31.175874 15048 leader_election.cc:343] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.175933 15048 leader_election.cc:304] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.176003 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85c7748077184fdda472821a0826cd77" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.176064 16582 raft_consensus.cc:2749] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:31.176789 15183 leader_election.cc:343] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:31.177351 16946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20251025 08:02:31.177594 16946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20251025 08:02:31.177655 16946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20251025 08:02:31.180392 15185 leader_election.cc:304] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:31.180634 15384 raft_consensus.cc:2804] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.180702 15384 raft_consensus.cc:697] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.180800 15384 consensus_queue.cc:237] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
W20251025 08:02:31.185819 16946 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20251025 08:02:31.185925 16946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20251025 08:02:31.185992 16946 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20251025 08:02:31.186065 16946 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20251025 08:02:31.186753 16572 consensus_queue.cc:1048] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.191473 16391 tablet_bootstrap.cc:492] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.191565 16391 ts_tablet_manager.cc:1403] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.000s
I20251025 08:02:31.191984 16391 raft_consensus.cc:359] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.192088 16391 raft_consensus.cc:385] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.192126 16391 raft_consensus.cc:740] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.192242 16391 consensus_queue.cc:260] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.192277 16946 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.14.70.20:37905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.14.70.62:39499,127.14.70.61:44347,127.14.70.60:34453
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.14.70.61:44347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.14.70.61
--webserver_port=41597
--never_fsync=true
--heap_profile_path=/tmp/kudu.16946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.19.0-SNAPSHOT
revision 1d0cb013a5aad754f2ed06c25f5ec3d8a1873622
build type DEBUG
built by None at 25 Oct 2025 07:43:14 UTC on 24a791456cd2
build id 8706
I20251025 08:02:31.192575 16391 ts_tablet_manager.cc:1434] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.192790 16391 tablet_bootstrap.cc:492] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.193955 16946 env_posix.cc:2264] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20251025 08:02:31.194394 16391 tablet_bootstrap.cc:654] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.195459 16946 file_cache.cc:492] Constructed file cache file cache with capacity 419430
I20251025 08:02:31.200304 16391 tablet_bootstrap.cc:492] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.200377 16391 ts_tablet_manager.cc:1403] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20251025 08:02:31.200784 16391 raft_consensus.cc:359] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.200866 16391 raft_consensus.cc:385] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.200894 16391 raft_consensus.cc:740] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.201026 16391 consensus_queue.cc:260] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.201422 16391 ts_tablet_manager.cc:1434] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:31.202260 16391 tablet_bootstrap.cc:492] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.203323 16391 tablet_bootstrap.cc:654] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.210281 15864 raft_consensus.cc:493] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.210358 15864 raft_consensus.cc:515] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.210683 15864 leader_election.cc:290] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.211229 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ab6b9d8278045ae92043ada5ce6dd71" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.211342 15238 raft_consensus.cc:2468] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:31.211575 14914 leader_election.cc:304] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.211632 15384 consensus_queue.cc:1048] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.211799 15864 raft_consensus.cc:2804] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.211850 15864 raft_consensus.cc:493] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.211889 15864 raft_consensus.cc:3060] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.212714 16390 tablet_bootstrap.cc:492] T 55db2958c76e4886b807fdb237f9b2a9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.212780 16390 ts_tablet_manager.cc:1403] T 55db2958c76e4886b807fdb237f9b2a9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.001s
I20251025 08:02:31.212926 15864 raft_consensus.cc:515] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.213156 16390 raft_consensus.cc:359] T 55db2958c76e4886b807fdb237f9b2a9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.213219 15864 leader_election.cc:290] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.213248 16390 raft_consensus.cc:385] T 55db2958c76e4886b807fdb237f9b2a9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.213295 16390 raft_consensus.cc:740] T 55db2958c76e4886b807fdb237f9b2a9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.213395 16390 consensus_queue.cc:260] T 55db2958c76e4886b807fdb237f9b2a9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.213403 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ab6b9d8278045ae92043ada5ce6dd71" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.213522 15111 raft_consensus.cc:2468] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:31.213650 16390 ts_tablet_manager.cc:1434] T 55db2958c76e4886b807fdb237f9b2a9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.213835 16390 tablet_bootstrap.cc:492] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.214499 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ab6b9d8278045ae92043ada5ce6dd71" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:31.214603 15238 raft_consensus.cc:3060] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.214649 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ab6b9d8278045ae92043ada5ce6dd71" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.214757 15111 raft_consensus.cc:3060] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.215543 15238 raft_consensus.cc:2468] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:31.215678 15111 raft_consensus.cc:2468] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:31.216027 14915 leader_election.cc:304] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:31.216104 16391 tablet_bootstrap.cc:492] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.216185 16391 ts_tablet_manager.cc:1403] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.002s
I20251025 08:02:31.216318 15864 raft_consensus.cc:2804] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.216394 15864 raft_consensus.cc:697] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:31.216508 15864 consensus_queue.cc:237] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.216816 16391 raft_consensus.cc:359] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.216904 16391 raft_consensus.cc:385] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.216935 16391 raft_consensus.cc:740] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.217043 16391 consensus_queue.cc:260] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.217252 16390 tablet_bootstrap.cc:654] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.217314 16391 ts_tablet_manager.cc:1434] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:31.217471 16391 tablet_bootstrap.cc:492] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.218158 16390 tablet_bootstrap.cc:492] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.218258 16390 ts_tablet_manager.cc:1403] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:31.218773 16390 raft_consensus.cc:359] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.218881 16390 raft_consensus.cc:385] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.218914 16390 raft_consensus.cc:740] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.218672 16391 tablet_bootstrap.cc:654] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.219097 16390 consensus_queue.cc:260] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.219398 16390 ts_tablet_manager.cc:1434] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.219600 16390 tablet_bootstrap.cc:492] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.222633 16390 tablet_bootstrap.cc:654] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.223631 16390 tablet_bootstrap.cc:492] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.223711 16390 ts_tablet_manager.cc:1403] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:31.224097 16390 raft_consensus.cc:359] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.224192 16390 raft_consensus.cc:385] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.224228 16390 raft_consensus.cc:740] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.224340 16390 consensus_queue.cc:260] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.224623 16390 ts_tablet_manager.cc:1434] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:31.224785 16390 tablet_bootstrap.cc:492] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.224814 15864 raft_consensus.cc:493] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.224884 15864 raft_consensus.cc:515] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.225198 15864 leader_election.cc:290] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.225634 16390 tablet_bootstrap.cc:654] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.225975 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a3ec64b273d4e8c92b1e24061ac7336" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.226600 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6a3ec64b273d4e8c92b1e24061ac7336" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.226747 14973 raft_consensus.cc:3060] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.227833 14915 leader_election.cc:304] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.228000 15864 raft_consensus.cc:2749] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.228264 16199 consensus_queue.cc:1048] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.228994 16390 tablet_bootstrap.cc:492] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.229086 16390 ts_tablet_manager.cc:1403] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:31.229631 16390 raft_consensus.cc:359] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.229723 16390 raft_consensus.cc:385] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.229756 16390 raft_consensus.cc:740] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.229857 16390 consensus_queue.cc:260] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.230108 16390 ts_tablet_manager.cc:1434] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.230291 16390 tablet_bootstrap.cc:492] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.231104 16390 tablet_bootstrap.cc:654] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.235982 16390 tablet_bootstrap.cc:492] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.236090 16390 ts_tablet_manager.cc:1403] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:31.236506 16390 raft_consensus.cc:359] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.236599 16390 raft_consensus.cc:385] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.236658 16390 raft_consensus.cc:740] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.236760 16390 consensus_queue.cc:260] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.237010 16390 ts_tablet_manager.cc:1434] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.237172 16390 tablet_bootstrap.cc:492] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.237983 15909 raft_consensus.cc:493] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.238027 16570 raft_consensus.cc:493] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.238055 15909 raft_consensus.cc:515] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.238099 16570 raft_consensus.cc:515] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.238402 16570 leader_election.cc:290] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.238385 15909 leader_election.cc:290] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:31.238898 16390 tablet_bootstrap.cc:654] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.239085 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "89eda91ab00245418389e614550f20c1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.239182 15111 raft_consensus.cc:2468] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.239344 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b866fc38e3444514b834f7876fb700ed" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.239444 15113 raft_consensus.cc:2468] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.239461 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b866fc38e3444514b834f7876fb700ed" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.239579 14975 raft_consensus.cc:2468] T b866fc38e3444514b834f7876fb700ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.239461 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "89eda91ab00245418389e614550f20c1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.240005 15185 leader_election.cc:304] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.240207 15185 leader_election.cc:304] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.240296 16199 raft_consensus.cc:2804] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.240347 16199 raft_consensus.cc:493] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.240384 16199 raft_consensus.cc:3060] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.240396 16572 raft_consensus.cc:2804] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.240445 16572 raft_consensus.cc:493] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.240486 16572 raft_consensus.cc:3060] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.241276 16199 raft_consensus.cc:515] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.241530 16572 raft_consensus.cc:515] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.241580 16199 leader_election.cc:290] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.241822 16572 leader_election.cc:290] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:31.241935 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "89eda91ab00245418389e614550f20c1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
W20251025 08:02:31.242007 15183 leader_election.cc:343] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.242036 15113 raft_consensus.cc:3060] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.242457 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "89eda91ab00245418389e614550f20c1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.242648 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b866fc38e3444514b834f7876fb700ed" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.242718 14975 raft_consensus.cc:3060] T b866fc38e3444514b834f7876fb700ed P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:31.242712 15183 leader_election.cc:343] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.243000 15113 raft_consensus.cc:2468] T 89eda91ab00245418389e614550f20c1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.243505 15185 leader_election.cc:304] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:31.243561 14975 raft_consensus.cc:2468] T b866fc38e3444514b834f7876fb700ed P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.243628 16572 raft_consensus.cc:2804] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.243702 16572 raft_consensus.cc:697] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.243817 16572 consensus_queue.cc:237] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.244010 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b866fc38e3444514b834f7876fb700ed" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.244098 15113 raft_consensus.cc:3060] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.244889 15113 raft_consensus.cc:2468] T b866fc38e3444514b834f7876fb700ed P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.245299 15185 leader_election.cc:304] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.245426 15909 raft_consensus.cc:2804] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.245503 15909 raft_consensus.cc:697] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.245605 15909 consensus_queue.cc:237] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.245736 16390 tablet_bootstrap.cc:492] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.245811 16390 ts_tablet_manager.cc:1403] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:31.246340 16390 raft_consensus.cc:359] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.246430 16390 raft_consensus.cc:385] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.246462 16390 raft_consensus.cc:740] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.246552 16390 consensus_queue.cc:260] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.246799 16390 ts_tablet_manager.cc:1434] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:31.246958 16390 tablet_bootstrap.cc:492] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.248322 15497 raft_consensus.cc:493] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.248397 15497 raft_consensus.cc:515] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.248730 15497 leader_election.cc:290] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.248950 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1019d033e1f24ab596309462cbeb9c73" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:31.249238 15048 leader_election.cc:343] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.249491 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1019d033e1f24ab596309462cbeb9c73" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.249567 16572 raft_consensus.cc:493] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.249639 16572 raft_consensus.cc:515] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.249924 16390 tablet_bootstrap.cc:654] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.249982 16572 leader_election.cc:290] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:31.250243 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f4add8060af4a9da95c3e78567f871f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
W20251025 08:02:31.250308 15049 leader_election.cc:343] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.250344 15113 raft_consensus.cc:2468] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.250358 15049 leader_election.cc:304] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.250463 15497 raft_consensus.cc:2749] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.250771 15185 leader_election.cc:304] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.250806 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f4add8060af4a9da95c3e78567f871f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.250897 14975 raft_consensus.cc:2468] T 1f4add8060af4a9da95c3e78567f871f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.251066 16572 raft_consensus.cc:2804] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.251127 16572 raft_consensus.cc:493] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.251171 16572 raft_consensus.cc:3060] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.251166 17015 consensus_queue.cc:1048] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.253934 16572 raft_consensus.cc:515] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.254276 16572 leader_election.cc:290] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:31.254930 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f4add8060af4a9da95c3e78567f871f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.255038 15113 raft_consensus.cc:3060] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.255246 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1f4add8060af4a9da95c3e78567f871f" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.255332 14975 raft_consensus.cc:3060] T 1f4add8060af4a9da95c3e78567f871f P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:31.255550 17122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:31.255859 15113 raft_consensus.cc:2468] T 1f4add8060af4a9da95c3e78567f871f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.256119 16390 tablet_bootstrap.cc:492] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.256204 16390 ts_tablet_manager.cc:1403] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251025 08:02:31.256271 14975 raft_consensus.cc:2468] T 1f4add8060af4a9da95c3e78567f871f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.256279 15185 leader_election.cc:304] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.256657 16390 raft_consensus.cc:359] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.256752 16390 raft_consensus.cc:385] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251025 08:02:31.256762 17125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:31.256784 16390 raft_consensus.cc:740] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.256875 16390 consensus_queue.cc:260] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.257169 16390 ts_tablet_manager.cc:1434] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.257342 16390 tablet_bootstrap.cc:492] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.258287 16570 raft_consensus.cc:2804] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.258368 16570 raft_consensus.cc:697] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.258496 16570 consensus_queue.cc:237] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.259052 17015 consensus_queue.cc:1048] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.259281 16390 tablet_bootstrap.cc:654] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:31.259557 17123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20251025 08:02:31.259894 16199 raft_consensus.cc:493] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.259975 16199 raft_consensus.cc:515] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.260303 16199 leader_election.cc:290] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.260550 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47c5c768eafa494db9a0110bf5625451" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.260617 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47c5c768eafa494db9a0110bf5625451" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.260653 15113 raft_consensus.cc:2468] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.260946 15185 leader_election.cc:304] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.261121 16572 raft_consensus.cc:2804] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.261184 16572 raft_consensus.cc:493] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.261231 16572 raft_consensus.cc:3060] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:31.261273 15183 leader_election.cc:343] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.262075 16572 raft_consensus.cc:515] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.262457 16572 leader_election.cc:290] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.262717 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47c5c768eafa494db9a0110bf5625451" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.262799 15113 raft_consensus.cc:3060] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.263538 15113 raft_consensus.cc:2468] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.263819 15185 leader_election.cc:304] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.264341 16572 raft_consensus.cc:2804] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.264423 16572 raft_consensus.cc:697] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.264535 16572 consensus_queue.cc:237] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.265888 16946 server_base.cc:1047] running on GCE node
I20251025 08:02:31.266731 16946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20251025 08:02:31.267129 16857 raft_consensus.cc:493] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.267228 16857 raft_consensus.cc:515] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.267553 16857 leader_election.cc:290] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.267874 16946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20251025 08:02:31.267853 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce5ae591c86c4455a1dd3704f1c95d1c" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.267967 15249 raft_consensus.cc:2468] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:31.268110 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce5ae591c86c4455a1dd3704f1c95d1c" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.268215 15111 raft_consensus.cc:2468] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:31.268537 14915 leader_election.cc:304] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:31.268683 16857 raft_consensus.cc:2804] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.268729 16857 raft_consensus.cc:493] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.268767 16857 raft_consensus.cc:3060] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.268793 16390 tablet_bootstrap.cc:492] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.268857 16390 ts_tablet_manager.cc:1403] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20251025 08:02:31.269244 16390 raft_consensus.cc:359] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.269354 16390 raft_consensus.cc:385] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.269389 16390 raft_consensus.cc:740] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.269488 16390 consensus_queue.cc:260] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.269721 16390 ts_tablet_manager.cc:1434] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.269743 16857 raft_consensus.cc:515] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.269886 16390 tablet_bootstrap.cc:492] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.270169 16857 leader_election.cc:290] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.270566 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce5ae591c86c4455a1dd3704f1c95d1c" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.270656 15111 raft_consensus.cc:3060] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.270911 16390 tablet_bootstrap.cc:654] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.271400 16199 consensus_queue.cc:1048] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.271518 15111 raft_consensus.cc:2468] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:31.271700 15497 consensus_queue.cc:1048] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.271776 14915 leader_election.cc:304] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:31.271907 16857 raft_consensus.cc:2804] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.271919 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ce5ae591c86c4455a1dd3704f1c95d1c" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:31.271972 16857 raft_consensus.cc:697] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:31.272042 15249 raft_consensus.cc:3060] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.272073 16857 consensus_queue.cc:237] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.272845 15249 raft_consensus.cc:2468] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:31.276526 17043 consensus_queue.cc:1048] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.279582 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47c5c768eafa494db9a0110bf5625451" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.287257 16391 tablet_bootstrap.cc:492] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.287336 16391 ts_tablet_manager.cc:1403] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.070s user 0.001s sys 0.000s
I20251025 08:02:31.287758 16391 raft_consensus.cc:359] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.287842 16391 raft_consensus.cc:385] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.287874 16391 raft_consensus.cc:740] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.287995 16391 consensus_queue.cc:260] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.288290 16391 ts_tablet_manager.cc:1434] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.288492 16391 tablet_bootstrap.cc:492] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.287662 16908 catalog_manager.cc:6033] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Loaded TSK: 0
I20251025 08:02:31.289475 16391 tablet_bootstrap.cc:654] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.294476 16390 tablet_bootstrap.cc:492] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.294551 16390 ts_tablet_manager.cc:1403] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20251025 08:02:31.294934 16390 raft_consensus.cc:359] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.295027 16390 raft_consensus.cc:385] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.295056 16390 raft_consensus.cc:740] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.295151 16390 consensus_queue.cc:260] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.295431 16390 ts_tablet_manager.cc:1434] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.295603 16390 tablet_bootstrap.cc:492] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.296674 16390 tablet_bootstrap.cc:654] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.298902 16199 consensus_queue.cc:1048] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:31.299971 15183 leader_election.cc:343] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.300266 16199 raft_consensus.cc:493] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.300343 16199 raft_consensus.cc:515] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.300585 16199 leader_election.cc:290] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.300654 16199 consensus_queue.cc:1048] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.300731 16572 consensus_queue.cc:1048] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.300961 16199 consensus_queue.cc:1048] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.301016 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f426e93af38e4e17b30cd01eea12dcac" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.301128 15112 raft_consensus.cc:2468] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.301365 15185 leader_election.cc:304] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.301491 15909 raft_consensus.cc:2804] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.301532 15909 raft_consensus.cc:493] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.301568 15909 raft_consensus.cc:3060] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.302107 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f426e93af38e4e17b30cd01eea12dcac" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.302418 15909 raft_consensus.cc:515] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.302685 15909 leader_election.cc:290] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.303540 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f426e93af38e4e17b30cd01eea12dcac" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:31.303557 15183 leader_election.cc:343] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.303848 16570 consensus_queue.cc:1048] T 8b69d792862540b6ad1b5d56dea17499 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.303936 15642 consensus_queue.cc:1048] T 36cb8c32d8cb4fbb9be18767c0336506 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.304227 16946 hybrid_clock.cc:648] HybridClock initialized: now 1761379351301737 us; error 2495 us; skew 500 ppm
W20251025 08:02:31.304308 15183 leader_election.cc:343] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.305992 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f426e93af38e4e17b30cd01eea12dcac" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.306082 15111 raft_consensus.cc:3060] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.306998 15111 raft_consensus.cc:2468] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.307082 16946 webserver.cc:492] Webserver started at http://127.14.70.61:41597/ using document root <none> and password file <none>
I20251025 08:02:31.307793 16946 fs_manager.cc:362] Metadata directory not provided
I20251025 08:02:31.307857 16946 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20251025 08:02:31.308461 15185 leader_election.cc:304] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:31.308724 16572 raft_consensus.cc:2804] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.308808 16572 raft_consensus.cc:697] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.308913 16572 consensus_queue.cc:237] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.314718 16946 fs_manager.cc:714] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20251025 08:02:31.315084 15909 consensus_queue.cc:1048] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.317333 15864 consensus_queue.cc:1048] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.318931 17043 raft_consensus.cc:493] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.319036 17043 raft_consensus.cc:515] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.319401 17043 leader_election.cc:290] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.319635 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4d1c652b6a4420a81e03cd58c6dbc69" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.308260 16908 catalog_manager.cc:1524] Initializing in-progress tserver states...
I20251025 08:02:31.322724 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4d1c652b6a4420a81e03cd58c6dbc69" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.322857 15113 raft_consensus.cc:2393] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:31.323087 14915 leader_election.cc:304] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.323215 17043 raft_consensus.cc:3060] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.323915 17043 raft_consensus.cc:2749] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.326975 16572 consensus_queue.cc:1048] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.334777 16391 tablet_bootstrap.cc:492] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.334877 16391 ts_tablet_manager.cc:1403] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.000s
I20251025 08:02:31.335433 16391 raft_consensus.cc:359] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.335541 16391 raft_consensus.cc:385] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.335615 16391 raft_consensus.cc:740] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.335729 16391 consensus_queue.cc:260] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.336071 16391 ts_tablet_manager.cc:1434] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.336272 16391 tablet_bootstrap.cc:492] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.336804 16572 raft_consensus.cc:493] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.336874 16572 raft_consensus.cc:515] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.337141 16572 leader_election.cc:290] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.337461 16391 tablet_bootstrap.cc:654] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.337549 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "454a76de5e2c421ab035e6cf1a958c11" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.337659 15111 raft_consensus.cc:2468] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.337956 15185 leader_election.cc:304] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.338171 16572 raft_consensus.cc:2804] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.338243 16572 raft_consensus.cc:493] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.338276 16572 raft_consensus.cc:3060] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.339058 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "454a76de5e2c421ab035e6cf1a958c11" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.339165 16572 raft_consensus.cc:515] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:31.339443 15183 leader_election.cc:343] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.339941 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "454a76de5e2c421ab035e6cf1a958c11" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.340050 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "454a76de5e2c421ab035e6cf1a958c11" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.340140 15111 raft_consensus.cc:3060] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:31.340240 15183 leader_election.cc:343] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.340950 15111 raft_consensus.cc:2468] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.339447 16572 leader_election.cc:290] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.341256 15185 leader_election.cc:304] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:31.342334 16572 raft_consensus.cc:2804] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.342418 16572 raft_consensus.cc:697] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.342566 16572 consensus_queue.cc:237] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.347079 16391 tablet_bootstrap.cc:492] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.347164 16391 ts_tablet_manager.cc:1403] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.001s
I20251025 08:02:31.347352 15909 consensus_queue.cc:1048] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.347697 16391 raft_consensus.cc:359] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.347810 16391 raft_consensus.cc:385] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.347846 16391 raft_consensus.cc:740] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.347946 16391 consensus_queue.cc:260] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.348327 16391 ts_tablet_manager.cc:1434] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.348528 16391 tablet_bootstrap.cc:492] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.350103 16391 tablet_bootstrap.cc:654] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.356060 16285 catalog_manager.cc:5649] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.356742 16285 catalog_manager.cc:5649] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.357010 16285 catalog_manager.cc:5649] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.358697 15026 heartbeater.cc:499] Master 127.14.70.62:39499 was elected leader, sending a full tablet report...
I20251025 08:02:31.359680 17164 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20251025 08:02:31.368254 16946 fs_manager.cc:730] Time spent opening block manager: real 0.052s user 0.001s sys 0.000s
I20251025 08:02:31.368368 16946 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data,/tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/wal
uuid: "33b7e3c702ec44079d8b76a0ce6bae97"
format_stamp: "Formatted at 2025-10-25 08:02:21 on dist-test-slave-2g2p"
I20251025 08:02:31.368820 16946 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20251025 08:02:31.377084 16391 tablet_bootstrap.cc:492] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.377177 16391 ts_tablet_manager.cc:1403] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20251025 08:02:31.377432 17043 raft_consensus.cc:493] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.377529 17043 raft_consensus.cc:515] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.377722 16391 raft_consensus.cc:359] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.377846 17043 leader_election.cc:290] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.377846 16391 raft_consensus.cc:385] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.377923 16391 raft_consensus.cc:740] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.378054 16391 consensus_queue.cc:260] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.378412 16391 ts_tablet_manager.cc:1434] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20251025 08:02:31.378623 16391 tablet_bootstrap.cc:492] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.379825 16391 tablet_bootstrap.cc:654] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.380463 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85c7748077184fdda472821a0826cd77" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.380954 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "85c7748077184fdda472821a0826cd77" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.381093 15111 raft_consensus.cc:2393] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:31.384276 16391 tablet_bootstrap.cc:492] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.384413 16391 ts_tablet_manager.cc:1403] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s
I20251025 08:02:31.363430 16282 master_service.cc:954] ReplaceTablet: received request to replace tablet 399d6b0459864b1586aa99948c56baea from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:31.385074 16391 raft_consensus.cc:359] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.385237 16391 raft_consensus.cc:385] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.385309 16391 raft_consensus.cc:740] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.385489 16391 consensus_queue.cc:260] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.362761 16283 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_142559297ae1426890d283339068330a" } modify_external_catalogs: true
I20251025 08:02:31.385843 16283 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_142559297ae1426890d283339068330a" } modify_external_catalogs: true
I20251025 08:02:31.386415 16391 ts_tablet_manager.cc:1434] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:31.386895 14915 leader_election.cc:304] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.387065 16420 raft_consensus.cc:3060] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.387945 16420 raft_consensus.cc:2749] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.363538 16281 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_401f8def453c48a19fc90b04a3294a16" } modify_external_catalogs: true
I20251025 08:02:31.388160 16281 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_401f8def453c48a19fc90b04a3294a16" } modify_external_catalogs: true
I20251025 08:02:31.388273 16391 tablet_bootstrap.cc:492] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.389597 16391 tablet_bootstrap.cc:654] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.364665 16280 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_1294a307080744bd964b420814ae843f" } modify_external_catalogs: true
I20251025 08:02:31.389837 16280 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_1294a307080744bd964b420814ae843f" } modify_external_catalogs: true
I20251025 08:02:31.364872 16279 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_789c5c7cc2df43f4b7c5c63316f47042" } new_table_name: "default.Table_83bb382534b740f383e0ddc24667d244" modify_external_catalogs: true
I20251025 08:02:31.363692 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_e7ff1f77ca4f48b2afa289c6672bcafd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:31.392254 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7ff1f77ca4f48b2afa289c6672bcafd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:31.392292 15864 raft_consensus.cc:493] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.392349 15864 raft_consensus.cc:515] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:31.392644 15864 leader_election.cc:290] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.393919 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "212ccfb58f964d7bae31e5af110b4079" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.394052 15112 raft_consensus.cc:2393] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:31.395998 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "212ccfb58f964d7bae31e5af110b4079" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.396399 14914 leader_election.cc:304] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.396636 17015 raft_consensus.cc:3060] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.397692 17015 raft_consensus.cc:2749] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.398280 16391 tablet_bootstrap.cc:492] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.398353 16391 ts_tablet_manager.cc:1403] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:31.398805 16391 raft_consensus.cc:359] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.398887 16391 raft_consensus.cc:385] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.398921 16391 raft_consensus.cc:740] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.399083 16391 consensus_queue.cc:260] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.399348 16391 ts_tablet_manager.cc:1434] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.400579 16391 tablet_bootstrap.cc:492] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.401494 16391 tablet_bootstrap.cc:654] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.364073 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_15d9c5aa50e643adb2dae30a80b6fcd4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:31.365527 16287 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_cc90154d79cc47bd82be7afaff1b0186" } new_table_name: "default.Table_434df4d622c74c6f89f7b7373096fb5f" modify_external_catalogs: true
W20251025 08:02:31.404296 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_15d9c5aa50e643adb2dae30a80b6fcd4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:31.405964 16390 tablet_bootstrap.cc:492] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.406059 16390 ts_tablet_manager.cc:1403] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.110s user 0.002s sys 0.000s
I20251025 08:02:31.406611 16390 raft_consensus.cc:359] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.406718 16390 raft_consensus.cc:385] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.406752 16390 raft_consensus.cc:740] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.406858 16390 consensus_queue.cc:260] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.407148 16390 ts_tablet_manager.cc:1434] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.407382 16390 tablet_bootstrap.cc:492] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.408340 16390 tablet_bootstrap.cc:654] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.411960 16391 tablet_bootstrap.cc:492] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.412045 16391 ts_tablet_manager.cc:1403] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20251025 08:02:31.412429 16391 raft_consensus.cc:359] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.412519 16391 raft_consensus.cc:385] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.412556 16391 raft_consensus.cc:740] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.412662 16391 consensus_queue.cc:260] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.412909 16391 ts_tablet_manager.cc:1434] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.413057 16391 tablet_bootstrap.cc:492] T 89eda91ab00245418389e614550f20c1 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.413901 16391 tablet_bootstrap.cc:654] T 89eda91ab00245418389e614550f20c1 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.416810 16282 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 399d6b0459864b1586aa99948c56baea
I20251025 08:02:31.417929 16282 catalog_manager.cc:6719] ReplaceTablet: tablet 399d6b0459864b1586aa99948c56baea deleted and replaced by tablet 47b0f93bac664a44989534097be9fd73
I20251025 08:02:31.420624 16391 tablet_bootstrap.cc:492] T 89eda91ab00245418389e614550f20c1 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.420688 16391 ts_tablet_manager.cc:1403] T 89eda91ab00245418389e614550f20c1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.002s
I20251025 08:02:31.421066 16391 raft_consensus.cc:359] T 89eda91ab00245418389e614550f20c1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.421144 16391 raft_consensus.cc:385] T 89eda91ab00245418389e614550f20c1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.421168 16391 raft_consensus.cc:740] T 89eda91ab00245418389e614550f20c1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.421283 16391 consensus_queue.cc:260] T 89eda91ab00245418389e614550f20c1 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.421520 16391 ts_tablet_manager.cc:1434] T 89eda91ab00245418389e614550f20c1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:31.422443 16391 tablet_bootstrap.cc:492] T 4ff32cab636840bc86a54aa6c91e9456 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.423316 16391 tablet_bootstrap.cc:654] T 4ff32cab636840bc86a54aa6c91e9456 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.429297 16391 tablet_bootstrap.cc:492] T 4ff32cab636840bc86a54aa6c91e9456 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.429389 16391 ts_tablet_manager.cc:1403] T 4ff32cab636840bc86a54aa6c91e9456 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20251025 08:02:31.429795 16391 raft_consensus.cc:359] T 4ff32cab636840bc86a54aa6c91e9456 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.429910 16391 raft_consensus.cc:385] T 4ff32cab636840bc86a54aa6c91e9456 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.429986 16391 raft_consensus.cc:740] T 4ff32cab636840bc86a54aa6c91e9456 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.430089 16391 consensus_queue.cc:260] T 4ff32cab636840bc86a54aa6c91e9456 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.430389 16391 ts_tablet_manager.cc:1434] T 4ff32cab636840bc86a54aa6c91e9456 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.430557 16391 tablet_bootstrap.cc:492] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.430940 16286 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_3ad0d85469a7485ba556f83ce20cecdf" } modify_external_catalogs: true
I20251025 08:02:31.431069 16286 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_3ad0d85469a7485ba556f83ce20cecdf" } modify_external_catalogs: true
I20251025 08:02:31.431521 16391 tablet_bootstrap.cc:654] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.432797 16420 raft_consensus.cc:493] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.432868 16420 raft_consensus.cc:515] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.433177 16420 leader_election.cc:290] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.433447 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6cca70bc3c48bf9c2396fdfdb8e42c" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.433583 15111 raft_consensus.cc:2393] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:31.436388 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0d6cca70bc3c48bf9c2396fdfdb8e42c" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.436699 14914 leader_election.cc:304] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.436957 15374 raft_consensus.cc:3060] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.437983 15374 raft_consensus.cc:2749] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.439090 16288 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_911ed9daff7b411c80d61a5a6ca9c623" } modify_external_catalogs: true
I20251025 08:02:31.439177 16288 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_911ed9daff7b411c80d61a5a6ca9c623" } modify_external_catalogs: true
I20251025 08:02:31.440095 15161 heartbeater.cc:499] Master 127.14.70.62:39499 was elected leader, sending a full tablet report...
I20251025 08:02:31.442235 15374 raft_consensus.cc:493] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.442305 15374 raft_consensus.cc:515] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.442589 15374 leader_election.cc:290] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.442900 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9ccba7de6874245bc0e1cdb8e8acfb1" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.443008 15249 raft_consensus.cc:2468] T f9ccba7de6874245bc0e1cdb8e8acfb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:31.443447 14914 leader_election.cc:304] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.443857 15374 raft_consensus.cc:2804] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.443907 15374 raft_consensus.cc:493] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.443944 15374 raft_consensus.cc:3060] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.444778 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 399d6b0459864b1586aa99948c56baea with delete_type TABLET_DATA_DELETED (replaced by tablet 47b0f93bac664a44989534097be9fd73) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:31.444797 15374 raft_consensus.cc:515] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.445139 15374 leader_election.cc:290] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.445421 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9ccba7de6874245bc0e1cdb8e8acfb1" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.445533 15112 raft_consensus.cc:3060] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.446509 15112 raft_consensus.cc:2468] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:31.446764 14915 leader_election.cc:304] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:31.446930 15374 raft_consensus.cc:2804] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.447008 15374 raft_consensus.cc:697] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:31.447141 15374 consensus_queue.cc:237] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.447206 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9ccba7de6874245bc0e1cdb8e8acfb1" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:31.447216 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f9ccba7de6874245bc0e1cdb8e8acfb1" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.447230 16946 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20251025 08:02:31.447285 15249 raft_consensus.cc:3060] T f9ccba7de6874245bc0e1cdb8e8acfb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.447324 15111 raft_consensus.cc:2376] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1. Re-sending same reply.
I20251025 08:02:31.448066 16391 tablet_bootstrap.cc:492] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.448175 16391 ts_tablet_manager.cc:1403] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251025 08:02:31.448280 15249 raft_consensus.cc:2468] T f9ccba7de6874245bc0e1cdb8e8acfb1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:31.448671 16391 raft_consensus.cc:359] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.448812 16391 raft_consensus.cc:385] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.448860 16391 raft_consensus.cc:740] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.448974 16391 consensus_queue.cc:260] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.449267 16391 ts_tablet_manager.cc:1434] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.453272 16288 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet 05df39a0910f406082e7864a321b46cf
I20251025 08:02:31.453938 16391 tablet_bootstrap.cc:492] T 174daf21bc41408d825ebe926af39c1b P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.454809 16391 tablet_bootstrap.cc:654] T 174daf21bc41408d825ebe926af39c1b P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.456571 16570 consensus_queue.cc:1048] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.458072 17194 tablet_replica.cc:333] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:31.458273 17194 raft_consensus.cc:2243] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:31.458572 17194 raft_consensus.cc:2272] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.459064 17194 ts_tablet_manager.cc:1916] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.459249 14973 raft_consensus.cc:3060] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.461109 16946 env_posix.cc:2264] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20251025 08:02:31.461117 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 399d6b0459864b1586aa99948c56baea with delete_type TABLET_DATA_DELETED (replaced by tablet 47b0f93bac664a44989534097be9fd73) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:31.461382 16946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20251025 08:02:31.461688 16390 tablet_bootstrap.cc:492] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.461788 16390 ts_tablet_manager.cc:1403] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.054s user 0.001s sys 0.000s
I20251025 08:02:31.462234 17194 ts_tablet_manager.cc:1929] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.462282 16390 raft_consensus.cc:359] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.462380 16390 raft_consensus.cc:385] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.462414 16390 raft_consensus.cc:740] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.462523 16390 consensus_queue.cc:260] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.462353 17194 log.cc:1199] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/399d6b0459864b1586aa99948c56baea
I20251025 08:02:31.462750 16570 consensus_queue.cc:1048] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.462833 16390 ts_tablet_manager.cc:1434] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.463020 16390 tablet_bootstrap.cc:492] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.463199 17194 ts_tablet_manager.cc:1950] T 399d6b0459864b1586aa99948c56baea P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:31.463923 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 399d6b0459864b1586aa99948c56baea (table default.Table_2c042f0ac6454365ae570c2cd26b31ca [id=d656394d725244dbbe22b0cfb8e4c89f]) successfully deleted
I20251025 08:02:31.464061 16390 tablet_bootstrap.cc:654] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.471149 16946 rpc_server.cc:307] RPC server started. Bound to: 127.14.70.61:44347
I20251025 08:02:31.471822 16570 raft_consensus.cc:493] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.471927 16570 raft_consensus.cc:515] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.472306 16570 leader_election.cc:290] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.472585 16946 server_base.cc:1179] Dumped server information to /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/master-1/data/info.pb
I20251025 08:02:31.473821 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7dd513b6c7a24dffb91f66c32acc7696" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:31.474592 15183 leader_election.cc:343] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.475361 17248 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.70.61:44347 every 8 connection(s)
I20251025 08:02:31.475492 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7dd513b6c7a24dffb91f66c32acc7696" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.475628 15112 raft_consensus.cc:2468] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.475943 15185 leader_election.cc:304] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:31.476173 16570 raft_consensus.cc:2804] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.476243 16570 raft_consensus.cc:493] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.476298 16570 raft_consensus.cc:3060] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.476872 14616 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskbKFzMV/build/debug/bin/kudu as pid 16946
I20251025 08:02:31.477476 16570 raft_consensus.cc:515] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.477897 16570 leader_election.cc:290] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.478616 15909 raft_consensus.cc:493] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.478706 15909 raft_consensus.cc:515] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.478790 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7dd513b6c7a24dffb91f66c32acc7696" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.479019 15909 leader_election.cc:290] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.479368 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7bb3d7d89674b7e825868c17495bbb3" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.479490 15113 raft_consensus.cc:2468] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.479763 15185 leader_election.cc:304] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.479923 15909 raft_consensus.cc:2804] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.480031 15909 raft_consensus.cc:493] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251025 08:02:31.480067 15183 leader_election.cc:343] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.480083 15909 raft_consensus.cc:3060] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.480682 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7bb3d7d89674b7e825868c17495bbb3" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.481026 15909 raft_consensus.cc:515] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.481148 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7dd513b6c7a24dffb91f66c32acc7696" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.481280 15112 raft_consensus.cc:3060] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.481349 15909 leader_election.cc:290] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.482417 17249 sys_catalog.cc:263] Verifying existing consensus state
I20251025 08:02:31.482421 15112 raft_consensus.cc:2468] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.483171 15185 leader_election.cc:304] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:31.483367 15909 raft_consensus.cc:2804] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.483464 15909 raft_consensus.cc:697] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.483572 15909 consensus_queue.cc:237] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.483824 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7bb3d7d89674b7e825868c17495bbb3" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.483927 15113 raft_consensus.cc:3060] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.484972 15113 raft_consensus.cc:2468] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.485363 15185 leader_election.cc:304] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.485555 16572 raft_consensus.cc:2804] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.485631 16572 raft_consensus.cc:697] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.485791 17249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Bootstrap starting.
I20251025 08:02:31.485759 16572 consensus_queue.cc:237] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:31.487450 15183 leader_election.cc:343] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.488343 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7bb3d7d89674b7e825868c17495bbb3" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.489717 16572 consensus_queue.cc:1048] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:31.490918 15183 leader_election.cc:343] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.500072 16282 catalog_manager.cc:5649] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.500383 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet bfdc6022cc5747439edcb8aa865b9437 (table default.Table_5bc70f62257c438bb0c52926674f2bdf [id=e62c2aba4e5546e2bd881c5f2ae3abd4]). Expected version 2 got 0
I20251025 08:02:31.500906 16282 catalog_manager.cc:5649] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.501181 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 17e61bb1e9c94b949361b2ca152eb3d4 (table default.Table_9d8c68374942454a8e7c869e8cef206f [id=b228e3c8480f475ca877713e168bcba8]). Expected version 1 got 0
I20251025 08:02:31.501578 16282 catalog_manager.cc:5649] T 327c7f7679dd469cb6f5a9b346c40671 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.501886 16282 catalog_manager.cc:5649] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.502115 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet a941ba28528d41699390e9db80f25594 (table default.Table_155857795087477392a338e28fb60afc [id=b58927a3527c45cb946d1fcc0681d6bf]). Expected version 1 got 0
I20251025 08:02:31.502296 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 (table default.Table_05bac665c2114dacac7804da6adfc06e [id=9aee333b5b9f4e1daba6449f643ea43a]). Expected version 1 got 0
I20251025 08:02:31.502439 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet cc676245d2984363b4af1e817b444c3d (table default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8]). Expected version 1 got 0
I20251025 08:02:31.506424 15374 raft_consensus.cc:493] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.506501 15374 raft_consensus.cc:515] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.506821 15374 leader_election.cc:290] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.507544 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f426e93af38e4e17b30cd01eea12dcac" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.507620 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 399d6b0459864b1586aa99948c56baea with delete_type TABLET_DATA_DELETED (replaced by tablet 47b0f93bac664a44989534097be9fd73) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:31.508765 16390 tablet_bootstrap.cc:492] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.508848 16390 ts_tablet_manager.cc:1403] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.000s
I20251025 08:02:31.509286 16390 raft_consensus.cc:359] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.509383 16390 raft_consensus.cc:385] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.509415 16390 raft_consensus.cc:740] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.509516 16390 consensus_queue.cc:260] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.509773 16390 ts_tablet_manager.cc:1434] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.509960 16390 tablet_bootstrap.cc:492] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.510988 16390 tablet_bootstrap.cc:654] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.512179 16391 tablet_bootstrap.cc:492] T 174daf21bc41408d825ebe926af39c1b P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.512262 16391 ts_tablet_manager.cc:1403] T 174daf21bc41408d825ebe926af39c1b P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.058s user 0.001s sys 0.000s
I20251025 08:02:31.512516 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f426e93af38e4e17b30cd01eea12dcac" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.512708 15112 raft_consensus.cc:2393] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:31.512701 16391 raft_consensus.cc:359] T 174daf21bc41408d825ebe926af39c1b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.512805 16391 raft_consensus.cc:385] T 174daf21bc41408d825ebe926af39c1b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.512842 16391 raft_consensus.cc:740] T 174daf21bc41408d825ebe926af39c1b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.512943 16391 consensus_queue.cc:260] T 174daf21bc41408d825ebe926af39c1b P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.513197 16391 ts_tablet_manager.cc:1434] T 174daf21bc41408d825ebe926af39c1b P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:31.513345 16391 tablet_bootstrap.cc:492] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.513453 14915 leader_election.cc:304] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.513720 15374 raft_consensus.cc:3060] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.514497 16391 tablet_bootstrap.cc:654] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.514894 15374 raft_consensus.cc:2749] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.516012 16199 consensus_queue.cc:1048] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.518033 15162 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:31.518308 15297 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:31.522296 15374 raft_consensus.cc:493] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.522506 15374 raft_consensus.cc:515] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.522871 15374 leader_election.cc:290] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.523629 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d16499315044408ad4bc1dca6341ed5" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.523727 17198 tablet_replica.cc:333] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:31.523751 15240 raft_consensus.cc:2468] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:31.523871 17198 raft_consensus.cc:2243] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:31.524008 17198 raft_consensus.cc:2272] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.524111 14914 leader_election.cc:304] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.524411 15864 raft_consensus.cc:2804] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.524470 15864 raft_consensus.cc:493] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.524516 15864 raft_consensus.cc:3060] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.525602 15864 raft_consensus.cc:515] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.525904 15864 leader_election.cc:290] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.525902 17043 raft_consensus.cc:493] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.526049 17043 raft_consensus.cc:515] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.526386 17043 leader_election.cc:290] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.526535 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d16499315044408ad4bc1dca6341ed5" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.526639 15110 raft_consensus.cc:3060] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.527587 17198 ts_tablet_manager.cc:1916] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.527716 15110 raft_consensus.cc:2468] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:31.527822 17258 tablet_replica.cc:333] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:31.527884 15027 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:31.527968 17258 raft_consensus.cc:2243] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:31.528137 17258 raft_consensus.cc:2272] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.503070 16284 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_ec7c18f36d434e0b9d294354387082e6" } new_table_name: "default.Table_5e5050bacd5543229399a2924609ae9c" modify_external_catalogs: true
I20251025 08:02:31.529603 17198 ts_tablet_manager.cc:1929] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.529664 17198 log.cc:1199] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/399d6b0459864b1586aa99948c56baea
I20251025 08:02:31.530103 15909 raft_consensus.cc:493] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.530200 15909 raft_consensus.cc:515] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.530499 15909 leader_election.cc:290] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.531594 14915 leader_election.cc:304] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:31.531906 16420 raft_consensus.cc:2804] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.531994 16420 raft_consensus.cc:697] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:31.531975 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0cc4859d32a4e119b413e1cbbb52834" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.531952 16282 catalog_manager.cc:5649] T 1dd5a31508964130828ee0367a3317ed P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:31.532123 15110 raft_consensus.cc:2393] T e0cc4859d32a4e119b413e1cbbb52834 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:31.532099 16420 consensus_queue.cc:237] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.532459 16282 catalog_manager.cc:5649] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.532641 16282 catalog_manager.cc:5649] T 3c119ac81d35496cad2630c19f15ea21 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.532832 16282 catalog_manager.cc:5649] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.532991 16282 catalog_manager.cc:5649] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.533123 16282 catalog_manager.cc:5649] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.533279 16282 catalog_manager.cc:5649] T 06c159c643804acfb0c3b82190a7a02f P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.533510 16282 catalog_manager.cc:5649] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.533640 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 42e8a5ee7d6a42aaaf95c33617abff3f (table default.Table_5d847a37cb0c456294cb5137046f80bb [id=1f6784494d0b4b98b46077a0af6c2ea8]). Expected version 1 got 0
I20251025 08:02:31.533739 16282 catalog_manager.cc:5649] T 36cb8c32d8cb4fbb9be18767c0336506 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.533864 16282 catalog_manager.cc:5649] T 8b69d792862540b6ad1b5d56dea17499 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.534035 16282 catalog_manager.cc:5649] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.534204 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet b7bb3d7d89674b7e825868c17495bbb3 (table default.Table_c6928dca846645b8887db36cc7cb9675 [id=9d1a6ae0121b45cda008d5dda6ea7e35]). Expected version 1 got 0
I20251025 08:02:31.534312 16282 catalog_manager.cc:5649] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.534512 16282 catalog_manager.cc:5649] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.534658 16282 catalog_manager.cc:5649] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:31.534749 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet d162f3ee21bd40ce9a9c74b7863a3878 (table default.Table_a6c6f65ea3444858aa562a65d71c4e77 [id=2ef2d72066f446619f9045da34df7814]). Expected version 1 got 0
I20251025 08:02:31.534829 16282 catalog_manager.cc:5649] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.534987 16282 catalog_manager.cc:5649] T 75d0c5e694734b37848c4127c4e97085 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.535136 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 86b1873446154249a80fa67b99496545 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]). Expected version 1 got 0
I20251025 08:02:31.535251 16282 catalog_manager.cc:5649] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.535403 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 6d1979a4f43a4659976b0cd6d1b888ef (table default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95]). Expected version 1 got 0
I20251025 08:02:31.535530 16282 catalog_manager.cc:5649] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.535727 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet ce5ae591c86c4455a1dd3704f1c95d1c (table default.Table_9c7e0359120c415cba47b89251b0be94 [id=4510ebbcd6ee43babe7ee133a0ce6ae5]). Expected version 1 got 0
I20251025 08:02:31.536428 16390 tablet_bootstrap.cc:492] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.536509 16390 ts_tablet_manager.cc:1403] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.000s
I20251025 08:02:31.537029 16390 raft_consensus.cc:359] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.537147 16390 raft_consensus.cc:385] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.537184 16390 raft_consensus.cc:740] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.537361 16390 consensus_queue.cc:260] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.537644 16390 ts_tablet_manager.cc:1434] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.537822 16390 tablet_bootstrap.cc:492] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.538060 17198 ts_tablet_manager.cc:1950] T 399d6b0459864b1586aa99948c56baea P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:31.538746 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e0cc4859d32a4e119b413e1cbbb52834" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.538873 16390 tablet_bootstrap.cc:654] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.539099 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 399d6b0459864b1586aa99948c56baea (table default.Table_2c042f0ac6454365ae570c2cd26b31ca [id=d656394d725244dbbe22b0cfb8e4c89f]) successfully deleted
I20251025 08:02:31.539597 14914 leader_election.cc:304] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.540015 17258 ts_tablet_manager.cc:1916] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.540019 16420 raft_consensus.cc:3060] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.541098 16420 raft_consensus.cc:2749] T e0cc4859d32a4e119b413e1cbbb52834 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.541492 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73cdd9616b9c460f8fcd4a40e4a3ccc8" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.541625 15110 raft_consensus.cc:2468] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.542001 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d16499315044408ad4bc1dca6341ed5" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:31.542130 15240 raft_consensus.cc:3060] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.543174 15240 raft_consensus.cc:2468] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:31.544531 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2d16499315044408ad4bc1dca6341ed5" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.544878 15112 raft_consensus.cc:2376] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1. Re-sending same reply.
I20251025 08:02:31.545660 15185 leader_election.cc:304] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.546530 16572 raft_consensus.cc:2804] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.546594 16572 raft_consensus.cc:493] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.546638 16572 raft_consensus.cc:3060] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.546917 17258 ts_tablet_manager.cc:1929] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.546991 17258 log.cc:1199] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/399d6b0459864b1586aa99948c56baea
I20251025 08:02:31.547263 17258 ts_tablet_manager.cc:1950] T 399d6b0459864b1586aa99948c56baea P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:31.547616 16572 raft_consensus.cc:515] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.547902 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 399d6b0459864b1586aa99948c56baea (table default.Table_2c042f0ac6454365ae570c2cd26b31ca [id=d656394d725244dbbe22b0cfb8e4c89f]) successfully deleted
I20251025 08:02:31.547972 16572 leader_election.cc:290] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.548517 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73cdd9616b9c460f8fcd4a40e4a3ccc8" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.548630 15110 raft_consensus.cc:3060] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.549532 15110 raft_consensus.cc:2468] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.554533 15374 raft_consensus.cc:493] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.554685 16390 tablet_bootstrap.cc:492] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.554668 15374 raft_consensus.cc:515] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.554775 16390 ts_tablet_manager.cc:1403] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20251025 08:02:31.555128 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73cdd9616b9c460f8fcd4a40e4a3ccc8" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.555527 15374 leader_election.cc:290] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.555682 16390 raft_consensus.cc:359] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.555866 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "73cdd9616b9c460f8fcd4a40e4a3ccc8" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.555778 16390 raft_consensus.cc:385] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.556070 16390 raft_consensus.cc:740] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.556236 16390 consensus_queue.cc:260] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.556557 16390 ts_tablet_manager.cc:1434] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:31.556928 16282 catalog_manager.cc:5649] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:31.557221 16282 catalog_manager.cc:5649] T 0488062b11994f03a1af2e52db492977 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.557350 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 0488062b11994f03a1af2e52db492977 (table default.Table_96ffee6ed67048c5bc78a91d739e8a02 [id=194a3dd184f4450da0604a85ace48fe9]). Expected version 1 got 0
I20251025 08:02:31.557442 16282 catalog_manager.cc:5649] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.557623 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55db2958c76e4886b807fdb237f9b2a9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.557644 16282 catalog_manager.cc:5649] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.557726 15249 raft_consensus.cc:2468] T 55db2958c76e4886b807fdb237f9b2a9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:31.557884 16282 catalog_manager.cc:5649] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.558020 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet cb3569ec2cdd4736b264b00abf1fa36a (table default.Table_08073379da334076bcc5503770a32982 [id=1ee33ee129d749d0bd7f26dc49fca0fe]). Expected version 4 got 0
I20251025 08:02:31.557955 15185 leader_election.cc:304] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.558121 16282 catalog_manager.cc:5649] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:31.558266 16572 raft_consensus.cc:2804] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.558341 16572 raft_consensus.cc:697] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.558452 16572 consensus_queue.cc:237] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.558657 16282 catalog_manager.cc:5649] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:31.559582 16282 catalog_manager.cc:5649] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:31.559791 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 2562325ea1c9436a85e1d675574c0a6c (table default.Table_beff096618394ac1b31db74a94a9f991 [id=8a0e4fe9e4544c539cb23b0279c1deaf]). Expected version 2 got 0
I20251025 08:02:31.559799 14914 leader_election.cc:304] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.559953 16420 raft_consensus.cc:2804] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.560011 16420 raft_consensus.cc:493] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.560045 16420 raft_consensus.cc:3060] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.560070 16282 catalog_manager.cc:5649] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:31.560264 16282 catalog_manager.cc:5649] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.560443 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 2f64072c416f4a77b1c81855d7db8f01 (table default.Table_b9669fd414104dcca80167117a5b0ed7 [id=431195fe6a3847caa5b39d62cb399ffb]). Expected version 1 got 0
I20251025 08:02:31.560535 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 090117a75882489d84687e41b50616e9 (table default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e]). Expected version 1 got 0
I20251025 08:02:31.560671 16282 catalog_manager.cc:5649] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.560856 16420 raft_consensus.cc:515] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.560894 16282 catalog_manager.cc:5649] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.561079 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]). Expected version 1 got 0
I20251025 08:02:31.561158 16420 leader_election.cc:290] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.561471 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55db2958c76e4886b807fdb237f9b2a9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.561584 15113 raft_consensus.cc:3060] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.562750 15113 raft_consensus.cc:2468] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:31.563036 14915 leader_election.cc:304] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:31.565652 17043 raft_consensus.cc:2804] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.565747 17043 raft_consensus.cc:697] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:31.565872 17043 consensus_queue.cc:237] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.566319 16282 catalog_manager.cc:5649] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:31.566480 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 09fccf0770604812940dd63106f7d993 (table default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056]). Expected version 5 got 0
I20251025 08:02:31.566617 16282 catalog_manager.cc:5649] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } }
I20251025 08:02:31.567132 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55db2958c76e4886b807fdb237f9b2a9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:31.567157 15384 consensus_queue.cc:1048] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.567252 15249 raft_consensus.cc:3060] T 55db2958c76e4886b807fdb237f9b2a9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.568125 15249 raft_consensus.cc:2468] T 55db2958c76e4886b807fdb237f9b2a9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:31.568197 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "55db2958c76e4886b807fdb237f9b2a9" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.568295 15110 raft_consensus.cc:2376] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1. Re-sending same reply.
I20251025 08:02:31.569744 15384 consensus_queue.cc:1048] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:31.570413 15183 leader_election.cc:343] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.570628 15384 consensus_queue.cc:1048] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:31.572131 15183 leader_election.cc:343] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.573843 16391 tablet_bootstrap.cc:492] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.573920 16391 ts_tablet_manager.cc:1403] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.000s
I20251025 08:02:31.574352 16391 raft_consensus.cc:359] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.574436 16391 raft_consensus.cc:385] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.574465 16391 raft_consensus.cc:740] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.574563 16391 consensus_queue.cc:260] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.574795 16391 ts_tablet_manager.cc:1434] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.574965 16391 tablet_bootstrap.cc:492] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.575845 16391 tablet_bootstrap.cc:654] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.582080 15384 consensus_queue.cc:1048] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.585414 15297 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:31.593354 17249 log.cc:826] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Log is configured to *not* fsync() on all Append() calls
I20251025 08:02:31.616550 15909 consensus_queue.cc:1048] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.619982 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet bfdc6022cc5747439edcb8aa865b9437 (table default.Table_5bc70f62257c438bb0c52926674f2bdf [id=e62c2aba4e5546e2bd881c5f2ae3abd4]). Expected version 2 got 0
I20251025 08:02:31.620188 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 17e61bb1e9c94b949361b2ca152eb3d4 (table default.Table_9d8c68374942454a8e7c869e8cef206f [id=b228e3c8480f475ca877713e168bcba8]). Expected version 1 got 0
I20251025 08:02:31.620553 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet cc676245d2984363b4af1e817b444c3d (table default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8]). Expected version 1 got 0
I20251025 08:02:31.621230 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 42e8a5ee7d6a42aaaf95c33617abff3f (table default.Table_5d847a37cb0c456294cb5137046f80bb [id=1f6784494d0b4b98b46077a0af6c2ea8]). Expected version 1 got 0
I20251025 08:02:31.621498 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet b7bb3d7d89674b7e825868c17495bbb3 (table default.Table_c6928dca846645b8887db36cc7cb9675 [id=9d1a6ae0121b45cda008d5dda6ea7e35]). Expected version 1 got 0
I20251025 08:02:31.621649 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet d162f3ee21bd40ce9a9c74b7863a3878 (table default.Table_a6c6f65ea3444858aa562a65d71c4e77 [id=2ef2d72066f446619f9045da34df7814]). Expected version 1 got 0
I20251025 08:02:31.621789 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 86b1873446154249a80fa67b99496545 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]). Expected version 1 got 0
I20251025 08:02:31.621989 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 6d1979a4f43a4659976b0cd6d1b888ef (table default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95]). Expected version 1 got 0
I20251025 08:02:31.622152 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet ce5ae591c86c4455a1dd3704f1c95d1c (table default.Table_9c7e0359120c415cba47b89251b0be94 [id=4510ebbcd6ee43babe7ee133a0ce6ae5]). Expected version 1 got 0
I20251025 08:02:31.622550 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 0488062b11994f03a1af2e52db492977 (table default.Table_96ffee6ed67048c5bc78a91d739e8a02 [id=194a3dd184f4450da0604a85ace48fe9]). Expected version 1 got 0
I20251025 08:02:31.623093 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet a941ba28528d41699390e9db80f25594 (table default.Table_155857795087477392a338e28fb60afc [id=b58927a3527c45cb946d1fcc0681d6bf]). Expected version 1 got 0
I20251025 08:02:31.623230 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 (table default.Table_05bac665c2114dacac7804da6adfc06e [id=9aee333b5b9f4e1daba6449f643ea43a]). Expected version 1 got 0
I20251025 08:02:31.623386 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet cb3569ec2cdd4736b264b00abf1fa36a (table default.Table_08073379da334076bcc5503770a32982 [id=1ee33ee129d749d0bd7f26dc49fca0fe]). Expected version 4 got 0
I20251025 08:02:31.623660 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 2562325ea1c9436a85e1d675574c0a6c (table default.Table_beff096618394ac1b31db74a94a9f991 [id=8a0e4fe9e4544c539cb23b0279c1deaf]). Expected version 2 got 0
I20251025 08:02:31.624387 15374 consensus_queue.cc:1048] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.624466 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 2f64072c416f4a77b1c81855d7db8f01 (table default.Table_b9669fd414104dcca80167117a5b0ed7 [id=431195fe6a3847caa5b39d62cb399ffb]). Expected version 1 got 0
I20251025 08:02:31.624637 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 090117a75882489d84687e41b50616e9 (table default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e]). Expected version 1 got 0
I20251025 08:02:31.625041 15909 consensus_queue.cc:1048] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.625109 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]). Expected version 1 got 0
I20251025 08:02:31.625197 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 09fccf0770604812940dd63106f7d993 (table default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056]). Expected version 5 got 0
I20251025 08:02:31.625190 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 519f631918c144ff8edcfc7127ca23dc (DEFAULT_TABLE table=default.Table_13374d55596a48c493e555af032ca1ff [id=fa967d72a93f477e86f08e71a6810d0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.625423 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519f631918c144ff8edcfc7127ca23dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.626513 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 519f631918c144ff8edcfc7127ca23dc (DEFAULT_TABLE table=default.Table_13374d55596a48c493e555af032ca1ff [id=fa967d72a93f477e86f08e71a6810d0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.626852 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519f631918c144ff8edcfc7127ca23dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.634820 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 519f631918c144ff8edcfc7127ca23dc (DEFAULT_TABLE table=default.Table_13374d55596a48c493e555af032ca1ff [id=fa967d72a93f477e86f08e71a6810d0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.635052 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 519f631918c144ff8edcfc7127ca23dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.637058 16390 tablet_bootstrap.cc:492] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.637926 16390 tablet_bootstrap.cc:654] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:31.638962 16287 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e967a52212164b8cb6f9c39f207024a1 consensus state has no leader
I20251025 08:02:31.639186 16287 master_service.cc:954] ReplaceTablet: received request to replace tablet 1ab6b9d8278045ae92043ada5ce6dd71 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:31.639703 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet bcf414d04305456b80b2ec5dd8fb0ba7
I20251025 08:02:31.640050 16283 master_service.cc:954] ReplaceTablet: received request to replace tablet 0769fe05ef364f8e80786bded1ec44cf from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:31.640462 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet bcf414d04305456b80b2ec5dd8fb0ba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:31.640597 17194 tablet_replica.cc:333] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:31.640748 17194 raft_consensus.cc:2243] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:31.640851 17194 raft_consensus.cc:2272] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.641047 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet bcf414d04305456b80b2ec5dd8fb0ba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:31.641191 17198 tablet_replica.cc:333] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:31.641232 17194 ts_tablet_manager.cc:1916] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.641314 17198 raft_consensus.cc:2243] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:31.641337 14973 raft_consensus.cc:3060] T 89eda91ab00245418389e614550f20c1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.641517 17198 raft_consensus.cc:2272] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.641826 17198 ts_tablet_manager.cc:1916] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.641937 15384 consensus_queue.cc:1048] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.642655 15384 consensus_queue.cc:1048] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.643342 17194 ts_tablet_manager.cc:1929] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:31.643430 17194 log.cc:1199] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/bcf414d04305456b80b2ec5dd8fb0ba7
I20251025 08:02:31.643684 17194 ts_tablet_manager.cc:1950] T bcf414d04305456b80b2ec5dd8fb0ba7 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:31.643791 17198 ts_tablet_manager.cc:1929] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:31.643853 17198 log.cc:1199] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/bcf414d04305456b80b2ec5dd8fb0ba7
I20251025 08:02:31.644129 17198 ts_tablet_manager.cc:1950] T bcf414d04305456b80b2ec5dd8fb0ba7 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:31.644694 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet bcf414d04305456b80b2ec5dd8fb0ba7 (table default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24]) successfully deleted
I20251025 08:02:31.644834 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet bcf414d04305456b80b2ec5dd8fb0ba7 (table default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24]) successfully deleted
I20251025 08:02:31.645095 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet bcf414d04305456b80b2ec5dd8fb0ba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:31.645262 17258 tablet_replica.cc:333] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:31.645378 17258 raft_consensus.cc:2243] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:31.645471 17258 raft_consensus.cc:2272] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.645779 17258 ts_tablet_manager.cc:1916] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.647601 17258 ts_tablet_manager.cc:1929] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:31.647675 17258 log.cc:1199] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/bcf414d04305456b80b2ec5dd8fb0ba7
I20251025 08:02:31.647900 17258 ts_tablet_manager.cc:1950] T bcf414d04305456b80b2ec5dd8fb0ba7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:31.648296 15384 raft_consensus.cc:493] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.648362 15384 raft_consensus.cc:515] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.648646 15384 leader_election.cc:290] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.648684 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet bcf414d04305456b80b2ec5dd8fb0ba7 (table default.Table_142559297ae1426890d283339068330a [id=3ea3c2c7b6ca44f0b7907ffc4c7d1b24]) successfully deleted
I20251025 08:02:31.648955 16280 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 446194cf013c4b6499deb00fab8db42a
W20251025 08:02:31.648972 16284 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1019d033e1f24ab596309462cbeb9c73 consensus state has no leader
I20251025 08:02:31.649137 16284 master_service.cc:954] ReplaceTablet: received request to replace tablet fba2914feb95475fbbfc5cef5a653408 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:31.649139 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6d1979a4f43a4659976b0cd6d1b888ef" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.649236 15113 raft_consensus.cc:2468] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.649360 16280 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_43ee60a808814bf287008fd5a89bf0fe"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:31.649472 15185 leader_election.cc:304] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
W20251025 08:02:31.649729 16280 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_43ee60a808814bf287008fd5a89bf0fe in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:31.649927 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 446194cf013c4b6499deb00fab8db42a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:31.649928 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6d1979a4f43a4659976b0cd6d1b888ef" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:31.650240 15183 leader_election.cc:343] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.650352 15909 raft_consensus.cc:2804] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.650419 15909 raft_consensus.cc:493] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.650465 15909 raft_consensus.cc:3060] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.650807 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_67b66eb11d834963b9bfe650c7627ec3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:31.651096 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_67b66eb11d834963b9bfe650c7627ec3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:31.651273 15909 raft_consensus.cc:515] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.651580 15909 leader_election.cc:290] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.652029 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6d1979a4f43a4659976b0cd6d1b888ef" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.652133 15113 raft_consensus.cc:3060] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.652314 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6d1979a4f43a4659976b0cd6d1b888ef" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.652515 17258 tablet_replica.cc:333] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:31.652683 17258 raft_consensus.cc:2243] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:31.652897 17258 raft_consensus.cc:2272] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.653131 15113 raft_consensus.cc:2468] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.653344 17258 ts_tablet_manager.cc:1916] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:31.653775 15183 leader_election.cc:343] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.655197 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 446194cf013c4b6499deb00fab8db42a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:31.655365 17194 tablet_replica.cc:333] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:31.655480 17194 raft_consensus.cc:2243] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:31.655565 17194 raft_consensus.cc:2272] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.655731 17258 ts_tablet_manager.cc:1929] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.655788 17258 log.cc:1199] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/446194cf013c4b6499deb00fab8db42a
I20251025 08:02:31.656056 17194 ts_tablet_manager.cc:1916] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.656275 15296 heartbeater.cc:499] Master 127.14.70.62:39499 was elected leader, sending a full tablet report...
I20251025 08:02:31.656967 15185 leader_election.cc:304] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:31.657706 16570 raft_consensus.cc:2804] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.657799 16570 raft_consensus.cc:697] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.657867 17194 ts_tablet_manager.cc:1929] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.657944 17194 log.cc:1199] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/446194cf013c4b6499deb00fab8db42a
I20251025 08:02:31.657912 16570 consensus_queue.cc:237] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.658176 17194 ts_tablet_manager.cc:1950] T 446194cf013c4b6499deb00fab8db42a P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:31.658272 16391 tablet_bootstrap.cc:492] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.658334 16391 ts_tablet_manager.cc:1403] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.083s user 0.002s sys 0.000s
I20251025 08:02:31.658762 16391 raft_consensus.cc:359] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.658846 16391 raft_consensus.cc:385] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.658869 16391 raft_consensus.cc:740] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.658977 16391 consensus_queue.cc:260] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.659216 16391 ts_tablet_manager.cc:1434] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.659363 16391 tablet_bootstrap.cc:492] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.660310 16391 tablet_bootstrap.cc:654] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.660341 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_2723d06acdad494093ca794f37a40c63"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:31.660597 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2723d06acdad494093ca794f37a40c63 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:31.662396 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 446194cf013c4b6499deb00fab8db42a (table default.Table_1294a307080744bd964b420814ae843f [id=8be0a7e83b634a6b90b3bf1bb535585c]) successfully deleted
I20251025 08:02:31.664709 17258 ts_tablet_manager.cc:1950] T 446194cf013c4b6499deb00fab8db42a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:31.665625 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 446194cf013c4b6499deb00fab8db42a (table default.Table_1294a307080744bd964b420814ae843f [id=8be0a7e83b634a6b90b3bf1bb535585c]) successfully deleted
I20251025 08:02:31.666982 15374 consensus_queue.cc:1048] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.668368 16285 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_96ffee6ed67048c5bc78a91d739e8a02" } new_table_name: "default.Table_172a223c749e4f5f844e515a18e0522f" modify_external_catalogs: true
I20251025 08:02:31.669422 16572 consensus_queue.cc:1048] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:31.671197 16270 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet e967a52212164b8cb6f9c39f207024a1 (table default.Table_434df4d622c74c6f89f7b7373096fb5f [id=0a4629613477421ba329364dbb42a8b6], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e967a52212164b8cb6f9c39f207024a1 consensus state has no leader
I20251025 08:02:31.671300 15909 consensus_queue.cc:1048] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.673702 16570 raft_consensus.cc:493] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.673779 16570 raft_consensus.cc:515] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.674088 16570 leader_election.cc:290] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.674501 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86b1873446154249a80fa67b99496545" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.674607 15109 raft_consensus.cc:2468] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.674880 15185 leader_election.cc:304] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.675251 16570 raft_consensus.cc:2804] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.675307 16570 raft_consensus.cc:493] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.675347 16570 raft_consensus.cc:3060] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.675313 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86b1873446154249a80fa67b99496545" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:31.675679 15183 leader_election.cc:343] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.676290 16570 raft_consensus.cc:515] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.676615 16570 leader_election.cc:290] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.676889 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86b1873446154249a80fa67b99496545" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.676977 15109 raft_consensus.cc:3060] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.677274 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 446194cf013c4b6499deb00fab8db42a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:31.677886 15109 raft_consensus.cc:2468] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.678323 15185 leader_election.cc:304] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.678470 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86b1873446154249a80fa67b99496545" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.678542 15909 raft_consensus.cc:2804] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.678609 15909 raft_consensus.cc:697] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.678714 15909 consensus_queue.cc:237] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.679265 15374 raft_consensus.cc:493] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.679337 15374 raft_consensus.cc:515] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.679615 15374 leader_election.cc:290] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.679940 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47c5c768eafa494db9a0110bf5625451" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.680088 15114 raft_consensus.cc:2393] T 47c5c768eafa494db9a0110bf5625451 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:31.680205 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47c5c768eafa494db9a0110bf5625451" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.680529 14914 leader_election.cc:304] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.680809 15374 raft_consensus.cc:3060] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.681066 17198 tablet_replica.cc:333] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:31.681268 17198 raft_consensus.cc:2243] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:31.681474 17198 raft_consensus.cc:2272] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.681715 15374 raft_consensus.cc:2749] T 47c5c768eafa494db9a0110bf5625451 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.682049 17198 ts_tablet_manager.cc:1916] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.683558 16572 consensus_queue.cc:1048] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.683573 16199 raft_consensus.cc:493] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.683888 16199 raft_consensus.cc:515] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.684247 16199 leader_election.cc:290] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.684273 17198 ts_tablet_manager.cc:1929] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.684332 17198 log.cc:1199] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/446194cf013c4b6499deb00fab8db42a
I20251025 08:02:31.684557 17198 ts_tablet_manager.cc:1950] T 446194cf013c4b6499deb00fab8db42a P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:31.685715 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 446194cf013c4b6499deb00fab8db42a (table default.Table_1294a307080744bd964b420814ae843f [id=8be0a7e83b634a6b90b3bf1bb535585c]) successfully deleted
W20251025 08:02:31.687901 15183 leader_election.cc:343] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.689827 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1019d033e1f24ab596309462cbeb9c73" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.689955 15109 raft_consensus.cc:2468] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.690342 15185 leader_election.cc:304] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.690363 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1019d033e1f24ab596309462cbeb9c73" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.690583 16572 raft_consensus.cc:2804] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.690632 16572 raft_consensus.cc:493] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.690667 16572 raft_consensus.cc:3060] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.691558 16572 raft_consensus.cc:515] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.691828 16572 leader_election.cc:290] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.692781 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1019d033e1f24ab596309462cbeb9c73" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.692879 15111 raft_consensus.cc:3060] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.693691 15111 raft_consensus.cc:2468] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.694794 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 0769fe05ef364f8e80786bded1ec44cf
I20251025 08:02:31.695082 16283 catalog_manager.cc:6719] ReplaceTablet: tablet 0769fe05ef364f8e80786bded1ec44cf deleted and replaced by tablet be8d6685c70c4219947df30f023a59b8
I20251025 08:02:31.695183 16572 consensus_queue.cc:1048] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.695271 16283 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_1068ad8fb18a4d21954bb70b20fd5760" } new_table_name: "default.Table_22425928df99434c8c133707c8a809ef" modify_external_catalogs: true
I20251025 08:02:31.695498 15185 leader_election.cc:304] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.695602 16572 raft_consensus.cc:2804] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.695655 16572 raft_consensus.cc:697] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.695742 16572 consensus_queue.cc:237] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.696267 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 0769fe05ef364f8e80786bded1ec44cf with delete_type TABLET_DATA_DELETED (replaced by tablet be8d6685c70c4219947df30f023a59b8) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:31.696414 17258 tablet_replica.cc:333] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:31.696540 17258 raft_consensus.cc:2243] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:31.696689 17258 raft_consensus.cc:2272] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.697005 17258 ts_tablet_manager.cc:1916] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.697299 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1019d033e1f24ab596309462cbeb9c73" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:31.697902 15183 leader_election.cc:343] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:31.698220 15183 leader_election.cc:343] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.698807 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 0769fe05ef364f8e80786bded1ec44cf with delete_type TABLET_DATA_DELETED (replaced by tablet be8d6685c70c4219947df30f023a59b8) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:31.698959 17194 tablet_replica.cc:333] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:31.699085 17194 raft_consensus.cc:2243] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:31.699184 17194 raft_consensus.cc:2272] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.699350 17258 ts_tablet_manager.cc:1929] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.699409 17258 log.cc:1199] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/0769fe05ef364f8e80786bded1ec44cf
I20251025 08:02:31.699510 17194 ts_tablet_manager.cc:1916] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.699651 17258 ts_tablet_manager.cc:1950] T 0769fe05ef364f8e80786bded1ec44cf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:31.700327 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 0769fe05ef364f8e80786bded1ec44cf (table default.Table_165ff894c5ab455e8daf5d1cf318b785 [id=325e0a7553e840c58179c04253e874dc]) successfully deleted
I20251025 08:02:31.701402 16572 raft_consensus.cc:493] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.701429 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 0769fe05ef364f8e80786bded1ec44cf with delete_type TABLET_DATA_DELETED (replaced by tablet be8d6685c70c4219947df30f023a59b8) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:31.701481 16572 raft_consensus.cc:515] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.701532 17194 ts_tablet_manager.cc:1929] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.701587 17194 log.cc:1199] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/0769fe05ef364f8e80786bded1ec44cf
I20251025 08:02:31.701817 16572 leader_election.cc:290] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.701841 17194 ts_tablet_manager.cc:1950] T 0769fe05ef364f8e80786bded1ec44cf P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:31.702852 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 0769fe05ef364f8e80786bded1ec44cf (table default.Table_165ff894c5ab455e8daf5d1cf318b785 [id=325e0a7553e840c58179c04253e874dc]) successfully deleted
I20251025 08:02:31.702852 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "174daf21bc41408d825ebe926af39c1b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.702956 15109 raft_consensus.cc:2468] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.703235 15185 leader_election.cc:304] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.703404 16572 raft_consensus.cc:2804] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.703456 16572 raft_consensus.cc:493] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.703512 16572 raft_consensus.cc:3060] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.704738 16572 raft_consensus.cc:515] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.705199 16572 leader_election.cc:290] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.705531 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "174daf21bc41408d825ebe926af39c1b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.705627 15114 raft_consensus.cc:3060] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.706524 15114 raft_consensus.cc:2468] T 174daf21bc41408d825ebe926af39c1b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.707008 17198 tablet_replica.cc:333] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:31.707036 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "174daf21bc41408d825ebe926af39c1b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.707149 14975 raft_consensus.cc:2468] T 174daf21bc41408d825ebe926af39c1b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.707290 17198 raft_consensus.cc:2243] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:31.707432 17198 raft_consensus.cc:2272] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.707466 15185 leader_election.cc:304] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.707674 16572 raft_consensus.cc:2804] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.707849 16572 raft_consensus.cc:697] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.707887 17198 ts_tablet_manager.cc:1916] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.707971 16572 consensus_queue.cc:237] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.708667 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "174daf21bc41408d825ebe926af39c1b" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.708762 14975 raft_consensus.cc:3060] T 174daf21bc41408d825ebe926af39c1b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.709591 14975 raft_consensus.cc:2468] T 174daf21bc41408d825ebe926af39c1b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.709928 17198 ts_tablet_manager.cc:1929] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.710065 17198 log.cc:1199] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/0769fe05ef364f8e80786bded1ec44cf
I20251025 08:02:31.710870 14944 tablet_service.cc:1505] Processing CreateTablet for tablet f6082b299bb44d31b567f70d8da7f0ac (DEFAULT_TABLE table=default.Table_c5c036d7c66344eba94e15be432088bc [id=ebfa83131bd946d0897b32ef3c188c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.711122 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6082b299bb44d31b567f70d8da7f0ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.711160 15088 tablet_service.cc:1505] Processing CreateTablet for tablet f6082b299bb44d31b567f70d8da7f0ac (DEFAULT_TABLE table=default.Table_c5c036d7c66344eba94e15be432088bc [id=ebfa83131bd946d0897b32ef3c188c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.711370 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6082b299bb44d31b567f70d8da7f0ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.713786 17043 consensus_queue.cc:1048] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.718796 16287 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 1ab6b9d8278045ae92043ada5ce6dd71
I20251025 08:02:31.719055 16287 catalog_manager.cc:6719] ReplaceTablet: tablet 1ab6b9d8278045ae92043ada5ce6dd71 deleted and replaced by tablet adb2c77ec9b84fe8846084cddc23888a
I20251025 08:02:31.719269 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_0d996ce6118b41598999853934f369f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:31.719504 15909 raft_consensus.cc:493] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251025 08:02:31.719580 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d996ce6118b41598999853934f369f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:31.719585 15909 raft_consensus.cc:515] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.719858 15909 leader_election.cc:290] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.720479 16199 raft_consensus.cc:493] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.720556 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 1ab6b9d8278045ae92043ada5ce6dd71 with delete_type TABLET_DATA_DELETED (replaced by tablet adb2c77ec9b84fe8846084cddc23888a) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:31.720548 16199 raft_consensus.cc:515] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.720829 16199 leader_election.cc:290] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.721148 17258 tablet_replica.cc:333] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:31.721131 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 1ab6b9d8278045ae92043ada5ce6dd71 with delete_type TABLET_DATA_DELETED (replaced by tablet adb2c77ec9b84fe8846084cddc23888a) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:31.721293 17194 tablet_replica.cc:333] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:31.721283 17258 raft_consensus.cc:2243] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:31.721383 17258 raft_consensus.cc:2272] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.721415 17194 raft_consensus.cc:2243] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:31.721557 17194 raft_consensus.cc:2272] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.722113 17194 ts_tablet_manager.cc:1916] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.722950 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 1ab6b9d8278045ae92043ada5ce6dd71 with delete_type TABLET_DATA_DELETED (replaced by tablet adb2c77ec9b84fe8846084cddc23888a) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:31.723439 15108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e967a52212164b8cb6f9c39f207024a1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.723534 15108 raft_consensus.cc:2468] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.723984 17194 ts_tablet_manager.cc:1929] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.723955 15108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4ff32cab636840bc86a54aa6c91e9456" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.724040 17194 log.cc:1199] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/1ab6b9d8278045ae92043ada5ce6dd71
I20251025 08:02:31.724063 15108 raft_consensus.cc:2468] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.724293 17194 ts_tablet_manager.cc:1950] T 1ab6b9d8278045ae92043ada5ce6dd71 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:31.724869 15185 leader_election.cc:304] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.725026 15185 leader_election.cc:304] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.725145 15909 raft_consensus.cc:2804] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.725183 15909 raft_consensus.cc:493] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.725225 15909 raft_consensus.cc:3060] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.725919 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 1ab6b9d8278045ae92043ada5ce6dd71 (table default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]) successfully deleted
I20251025 08:02:31.726063 15909 raft_consensus.cc:515] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.726405 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_64c962f064d64350a1fb6d539603c572"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:31.726543 15909 leader_election.cc:290] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.726655 15909 raft_consensus.cc:2804] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.726699 15909 raft_consensus.cc:493] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251025 08:02:31.726707 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_64c962f064d64350a1fb6d539603c572 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:31.726745 15909 raft_consensus.cc:3060] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.728029 15909 raft_consensus.cc:515] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.728447 15909 leader_election.cc:290] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.730672 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e967a52212164b8cb6f9c39f207024a1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.730770 15114 raft_consensus.cc:3060] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.731040 15108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4ff32cab636840bc86a54aa6c91e9456" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.731119 15108 raft_consensus.cc:3060] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.731611 15114 raft_consensus.cc:2468] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.731875 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_4c7bc0e29c4d40a2956a7b86660de862"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:31.732045 15108 raft_consensus.cc:2468] T 4ff32cab636840bc86a54aa6c91e9456 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
W20251025 08:02:31.732172 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4c7bc0e29c4d40a2956a7b86660de862 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:31.734829 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e967a52212164b8cb6f9c39f207024a1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.734933 14975 raft_consensus.cc:2468] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.736399 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4ff32cab636840bc86a54aa6c91e9456" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.736495 14975 raft_consensus.cc:2468] T 4ff32cab636840bc86a54aa6c91e9456 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.738277 15384 raft_consensus.cc:493] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.738354 15384 raft_consensus.cc:515] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.738628 15384 leader_election.cc:290] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.739420 17258 ts_tablet_manager.cc:1916] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.742106 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_b6d6ebb6a2ec45c5b4ff41770356102c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:31.742388 17258 ts_tablet_manager.cc:1929] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.742494 17258 log.cc:1199] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/1ab6b9d8278045ae92043ada5ce6dd71
W20251025 08:02:31.742519 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b6d6ebb6a2ec45c5b4ff41770356102c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:31.743083 17258 ts_tablet_manager.cc:1950] T 1ab6b9d8278045ae92043ada5ce6dd71 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:31.743677 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 1ab6b9d8278045ae92043ada5ce6dd71 (table default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]) successfully deleted
I20251025 08:02:31.745081 15108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d81b65e094a34703ac47897d9bfa4c7c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.745208 15108 raft_consensus.cc:2468] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.746580 15185 leader_election.cc:304] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.746771 15384 raft_consensus.cc:2804] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.746860 15384 raft_consensus.cc:697] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.746982 15384 consensus_queue.cc:237] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.747074 15185 leader_election.cc:304] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.747202 15909 raft_consensus.cc:2804] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.747258 15909 raft_consensus.cc:697] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.747370 15909 consensus_queue.cc:237] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.747609 16287 master_service.cc:954] ReplaceTablet: received request to replace tablet 60c49b70f8f44dd3aec433206b897843 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:31.747833 15185 leader_election.cc:304] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.748019 17198 ts_tablet_manager.cc:1950] T 0769fe05ef364f8e80786bded1ec44cf P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:31.748142 15909 raft_consensus.cc:2804] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.748235 15909 raft_consensus.cc:493] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.748314 15909 raft_consensus.cc:3060] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.748700 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 0769fe05ef364f8e80786bded1ec44cf (table default.Table_165ff894c5ab455e8daf5d1cf318b785 [id=325e0a7553e840c58179c04253e874dc]) successfully deleted
I20251025 08:02:31.749248 15909 raft_consensus.cc:515] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.749562 15909 leader_election.cc:290] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.749539 15225 tablet_service.cc:1505] Processing CreateTablet for tablet f6082b299bb44d31b567f70d8da7f0ac (DEFAULT_TABLE table=default.Table_c5c036d7c66344eba94e15be432088bc [id=ebfa83131bd946d0897b32ef3c188c19]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.749823 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6082b299bb44d31b567f70d8da7f0ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.750106 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e967a52212164b8cb6f9c39f207024a1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.750277 14975 raft_consensus.cc:3060] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.751154 14975 raft_consensus.cc:2468] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.751562 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "4ff32cab636840bc86a54aa6c91e9456" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.751644 14975 raft_consensus.cc:3060] T 4ff32cab636840bc86a54aa6c91e9456 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.752313 14944 tablet_service.cc:1505] Processing CreateTablet for tablet c043ab70d7364e05b0b352ac5c416db1 (DEFAULT_TABLE table=default.Table_21b4f92893424716afe86f9c67b6a691 [id=db6654cc26a348709c7f0577b91f18af]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.752573 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c043ab70d7364e05b0b352ac5c416db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.752899 15225 tablet_service.cc:1505] Processing CreateTablet for tablet c043ab70d7364e05b0b352ac5c416db1 (DEFAULT_TABLE table=default.Table_21b4f92893424716afe86f9c67b6a691 [id=db6654cc26a348709c7f0577b91f18af]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.753146 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c043ab70d7364e05b0b352ac5c416db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.752549 14975 raft_consensus.cc:2468] T 4ff32cab636840bc86a54aa6c91e9456 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.755404 15384 consensus_queue.cc:1048] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.755636 15384 consensus_queue.cc:1048] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.755851 15088 tablet_service.cc:1505] Processing CreateTablet for tablet c043ab70d7364e05b0b352ac5c416db1 (DEFAULT_TABLE table=default.Table_21b4f92893424716afe86f9c67b6a691 [id=db6654cc26a348709c7f0577b91f18af]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.756397 16391 tablet_bootstrap.cc:492] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.756502 16391 ts_tablet_manager.cc:1403] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.097s user 0.002s sys 0.000s
I20251025 08:02:31.756950 16391 raft_consensus.cc:359] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.757045 16391 raft_consensus.cc:385] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.757076 16391 raft_consensus.cc:740] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.757166 16391 consensus_queue.cc:260] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.757423 16391 ts_tablet_manager.cc:1434] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.757580 16391 tablet_bootstrap.cc:492] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.758584 16391 tablet_bootstrap.cc:654] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.759613 16284 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet fba2914feb95475fbbfc5cef5a653408
I20251025 08:02:31.759889 16284 catalog_manager.cc:6719] ReplaceTablet: tablet fba2914feb95475fbbfc5cef5a653408 deleted and replaced by tablet cfe93efc1a0c4dda95b5c2e58cdcec82
I20251025 08:02:31.760068 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_e7c8eba2db5e4b09a8e56d75ad203fbf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:31.760327 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7c8eba2db5e4b09a8e56d75ad203fbf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:31.761709 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet fba2914feb95475fbbfc5cef5a653408 with delete_type TABLET_DATA_DELETED (replaced by tablet cfe93efc1a0c4dda95b5c2e58cdcec82) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:31.761855 17194 tablet_replica.cc:333] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:31.761862 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet fba2914feb95475fbbfc5cef5a653408 with delete_type TABLET_DATA_DELETED (replaced by tablet cfe93efc1a0c4dda95b5c2e58cdcec82) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:31.761991 17194 raft_consensus.cc:2243] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:31.762094 17194 raft_consensus.cc:2272] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.762687 17194 ts_tablet_manager.cc:1916] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.764858 17194 ts_tablet_manager.cc:1929] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.764926 17194 log.cc:1199] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/fba2914feb95475fbbfc5cef5a653408
I20251025 08:02:31.765192 17194 ts_tablet_manager.cc:1950] T fba2914feb95475fbbfc5cef5a653408 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:31.765970 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet fba2914feb95475fbbfc5cef5a653408 (table default.Table_cce271e6706043dabfbd2c4b55bf198b [id=3a6e3a35c29b486b9ed32bc6fe1ec042]) successfully deleted
I20251025 08:02:31.766445 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_08013ca351ee49df9acad855462d7507"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:31.766709 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_08013ca351ee49df9acad855462d7507 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:31.767059 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet fba2914feb95475fbbfc5cef5a653408 with delete_type TABLET_DATA_DELETED (replaced by tablet cfe93efc1a0c4dda95b5c2e58cdcec82) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:31.768939 17258 tablet_replica.cc:333] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:31.769131 17258 raft_consensus.cc:2243] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:31.769332 17258 raft_consensus.cc:2272] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.769822 17258 ts_tablet_manager.cc:1916] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.771600 17258 ts_tablet_manager.cc:1929] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.771704 17258 log.cc:1199] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/fba2914feb95475fbbfc5cef5a653408
I20251025 08:02:31.771783 16284 master_service.cc:954] ReplaceTablet: received request to replace tablet 6cedb44483cf4f62acf52b90b6708dfb from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:31.771972 17258 ts_tablet_manager.cc:1950] T fba2914feb95475fbbfc5cef5a653408 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:31.775306 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet fba2914feb95475fbbfc5cef5a653408 (table default.Table_cce271e6706043dabfbd2c4b55bf198b [id=3a6e3a35c29b486b9ed32bc6fe1ec042]) successfully deleted
I20251025 08:02:31.778833 16857 raft_consensus.cc:493] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.778926 16857 raft_consensus.cc:515] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.779325 16857 leader_election.cc:290] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.780647 16199 consensus_queue.cc:1048] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.780633 16857 consensus_queue.cc:1048] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.782653 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 878883a39db14b2dac25abacdc3dd0eb (DEFAULT_TABLE table=default.Table_37a4fd748a93467eb24cd79ee89df4ef [id=d785bc9e4c3b4e4c856d280eeba182e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.782874 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878883a39db14b2dac25abacdc3dd0eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.783214 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 878883a39db14b2dac25abacdc3dd0eb (DEFAULT_TABLE table=default.Table_37a4fd748a93467eb24cd79ee89df4ef [id=d785bc9e4c3b4e4c856d280eeba182e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.783425 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878883a39db14b2dac25abacdc3dd0eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.783893 15085 tablet_service.cc:1505] Processing CreateTablet for tablet 878883a39db14b2dac25abacdc3dd0eb (DEFAULT_TABLE table=default.Table_37a4fd748a93467eb24cd79ee89df4ef [id=d785bc9e4c3b4e4c856d280eeba182e6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.786075 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d81b65e094a34703ac47897d9bfa4c7c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.786204 15109 raft_consensus.cc:3060] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.786550 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d81b65e094a34703ac47897d9bfa4c7c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.787179 15109 raft_consensus.cc:2468] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.787513 15108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "454a76de5e2c421ab035e6cf1a958c11" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.787628 15108 raft_consensus.cc:2393] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:31.787875 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 878883a39db14b2dac25abacdc3dd0eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.789964 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c043ab70d7364e05b0b352ac5c416db1. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:31.791913 15183 leader_election.cc:343] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.792125 15384 consensus_queue.cc:1048] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.792834 17198 tablet_replica.cc:333] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:31.792992 17198 raft_consensus.cc:2243] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:31.793092 17198 raft_consensus.cc:2272] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.793112 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d81b65e094a34703ac47897d9bfa4c7c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.793736 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "454a76de5e2c421ab035e6cf1a958c11" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.794471 17198 ts_tablet_manager.cc:1916] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.797040 17198 ts_tablet_manager.cc:1929] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.797158 17198 log.cc:1199] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/1ab6b9d8278045ae92043ada5ce6dd71
I20251025 08:02:31.797449 17198 ts_tablet_manager.cc:1950] T 1ab6b9d8278045ae92043ada5ce6dd71 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:31.798048 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 1ab6b9d8278045ae92043ada5ce6dd71 (table default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]) successfully deleted
I20251025 08:02:31.798373 17274 tablet_bootstrap.cc:492] T 519f631918c144ff8edcfc7127ca23dc P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:31.799561 17274 tablet_bootstrap.cc:654] T 519f631918c144ff8edcfc7127ca23dc P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.800588 14914 leader_election.cc:304] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.800953 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 47b0f93bac664a44989534097be9fd73 (DEFAULT_TABLE table=default.Table_2c042f0ac6454365ae570c2cd26b31ca [id=d656394d725244dbbe22b0cfb8e4c89f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.800992 16857 raft_consensus.cc:3060] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.801417 15384 raft_consensus.cc:493] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.801481 15384 raft_consensus.cc:515] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.801492 15185 leader_election.cc:304] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:31.801746 15384 leader_election.cc:290] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.801826 15384 consensus_queue.cc:1048] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.801929 16572 raft_consensus.cc:2804] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.802070 16857 raft_consensus.cc:2749] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.802241 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 47b0f93bac664a44989534097be9fd73 (DEFAULT_TABLE table=default.Table_2c042f0ac6454365ae570c2cd26b31ca [id=d656394d725244dbbe22b0cfb8e4c89f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.802778 16572 raft_consensus.cc:697] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.802815 16390 tablet_bootstrap.cc:492] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.802934 16390 ts_tablet_manager.cc:1403] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.166s user 0.002s sys 0.000s
I20251025 08:02:31.803320 16390 raft_consensus.cc:359] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.803399 16390 raft_consensus.cc:385] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.803426 16390 raft_consensus.cc:740] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.803508 16390 consensus_queue.cc:260] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.803741 16390 ts_tablet_manager.cc:1434] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.803746 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 47b0f93bac664a44989534097be9fd73 (DEFAULT_TABLE table=default.Table_2c042f0ac6454365ae570c2cd26b31ca [id=d656394d725244dbbe22b0cfb8e4c89f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.803900 16390 tablet_bootstrap.cc:492] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.803996 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b0f93bac664a44989534097be9fd73. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.804944 16390 tablet_bootstrap.cc:654] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.804944 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b0f93bac664a44989534097be9fd73. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.805518 16572 consensus_queue.cc:237] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
W20251025 08:02:31.806763 15183 leader_election.cc:343] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.806838 15085 tablet_service.cc:1505] Processing CreateTablet for tablet d116fbec0c6149938b8f6c19af9607af (DEFAULT_TABLE table=default.Table_85ecb3ae3f1a4810b5abcb29f861e881 [id=c1cc91015b38477f93e56504bf700ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.807487 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17339d7c0a4b40a78b3252d17481c192" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.808171 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 34c330b5dd544ae686f741cdd85d023d (DEFAULT_TABLE table=default.Table_aa5c70a86540451b8a07688d25edc3b7 [id=bd246e92f35b47a2864b5da042da3232]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.808176 14942 tablet_service.cc:1505] Processing CreateTablet for tablet 34c330b5dd544ae686f741cdd85d023d (DEFAULT_TABLE table=default.Table_aa5c70a86540451b8a07688d25edc3b7 [id=bd246e92f35b47a2864b5da042da3232]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.808393 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c330b5dd544ae686f741cdd85d023d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.808470 14944 tablet_service.cc:1505] Processing CreateTablet for tablet d116fbec0c6149938b8f6c19af9607af (DEFAULT_TABLE table=default.Table_85ecb3ae3f1a4810b5abcb29f861e881 [id=c1cc91015b38477f93e56504bf700ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.808655 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d116fbec0c6149938b8f6c19af9607af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.811249 16391 tablet_bootstrap.cc:492] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.811331 16391 ts_tablet_manager.cc:1403] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.054s user 0.000s sys 0.002s
I20251025 08:02:31.811822 16391 raft_consensus.cc:359] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.811916 16391 raft_consensus.cc:385] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.811950 16391 raft_consensus.cc:740] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.812053 16391 consensus_queue.cc:260] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.812322 16391 ts_tablet_manager.cc:1434] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:31.812472 16391 tablet_bootstrap.cc:492] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.813400 16391 tablet_bootstrap.cc:654] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.815209 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet bfdc6022cc5747439edcb8aa865b9437 (table default.Table_5bc70f62257c438bb0c52926674f2bdf [id=e62c2aba4e5546e2bd881c5f2ae3abd4]). Expected version 2 got 0
I20251025 08:02:31.815675 16280 catalog_manager.cc:5649] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:31.816129 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet a941ba28528d41699390e9db80f25594 (table default.Table_155857795087477392a338e28fb60afc [id=b58927a3527c45cb946d1fcc0681d6bf]). Expected version 1 got 0
I20251025 08:02:31.816304 16280 catalog_manager.cc:5649] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:31.816576 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 (table default.Table_05bac665c2114dacac7804da6adfc06e [id=9aee333b5b9f4e1daba6449f643ea43a]). Expected version 1 got 0
I20251025 08:02:31.816746 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet cc676245d2984363b4af1e817b444c3d (table default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8]). Expected version 1 got 0
I20251025 08:02:31.816967 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 09fccf0770604812940dd63106f7d993 (table default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056]). Expected version 5 got 0
I20251025 08:02:31.817251 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 17e61bb1e9c94b949361b2ca152eb3d4 (table default.Table_9d8c68374942454a8e7c869e8cef206f [id=b228e3c8480f475ca877713e168bcba8]). Expected version 1 got 0
I20251025 08:02:31.817447 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]). Expected version 1 got 0
I20251025 08:02:31.817646 16280 catalog_manager.cc:5649] T 442d83935a0a41658508e3022f4b557f P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:31.817919 16280 catalog_manager.cc:5649] T 47c5c768eafa494db9a0110bf5625451 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:31.818920 17274 tablet_bootstrap.cc:492] T 519f631918c144ff8edcfc7127ca23dc P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:31.819059 17274 ts_tablet_manager.cc:1403] T 519f631918c144ff8edcfc7127ca23dc P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20251025 08:02:31.819519 17274 raft_consensus.cc:359] T 519f631918c144ff8edcfc7127ca23dc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.819671 17274 raft_consensus.cc:385] T 519f631918c144ff8edcfc7127ca23dc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.819749 17274 raft_consensus.cc:740] T 519f631918c144ff8edcfc7127ca23dc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.819923 17274 consensus_queue.cc:260] T 519f631918c144ff8edcfc7127ca23dc P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.820298 17274 ts_tablet_manager.cc:1434] T 519f631918c144ff8edcfc7127ca23dc P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.821991 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 8b6ae6527fd64c3bb5999dec97db861d (DEFAULT_TABLE table=default.Table_599c0d46a95d45b4aa9bab3b54b52470 [id=b8e6ffed1a2e442db3c9ee5ac1a6ff3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.822252 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6ae6527fd64c3bb5999dec97db861d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.823770 15384 consensus_queue.cc:1048] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.808000 15225 tablet_service.cc:1505] Processing CreateTablet for tablet d116fbec0c6149938b8f6c19af9607af (DEFAULT_TABLE table=default.Table_85ecb3ae3f1a4810b5abcb29f861e881 [id=c1cc91015b38477f93e56504bf700ffb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.814859 16390 tablet_bootstrap.cc:492] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.821554 15214 tablet_service.cc:1505] Processing CreateTablet for tablet 34c330b5dd544ae686f741cdd85d023d (DEFAULT_TABLE table=default.Table_aa5c70a86540451b8a07688d25edc3b7 [id=bd246e92f35b47a2864b5da042da3232]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.824469 16390 ts_tablet_manager.cc:1403] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20251025 08:02:31.824666 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c330b5dd544ae686f741cdd85d023d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.825001 16390 raft_consensus.cc:359] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.825083 16390 raft_consensus.cc:385] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.825111 16390 raft_consensus.cc:740] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.825197 16390 consensus_queue.cc:260] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.825448 16390 ts_tablet_manager.cc:1434] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.825611 16390 tablet_bootstrap.cc:492] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.826438 16390 tablet_bootstrap.cc:654] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.826680 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 8b6ae6527fd64c3bb5999dec97db861d (DEFAULT_TABLE table=default.Table_599c0d46a95d45b4aa9bab3b54b52470 [id=b8e6ffed1a2e442db3c9ee5ac1a6ff3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.826864 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6ae6527fd64c3bb5999dec97db861d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.828680 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 8b6ae6527fd64c3bb5999dec97db861d (DEFAULT_TABLE table=default.Table_599c0d46a95d45b4aa9bab3b54b52470 [id=b8e6ffed1a2e442db3c9ee5ac1a6ff3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.829348 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d116fbec0c6149938b8f6c19af9607af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.830760 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 8362e26d86d44e9780d3c78c6a468556 (DEFAULT_TABLE table=default.Table_5a29e7dba4ba43dfbd0c27981080a1ac [id=8611464429b848fbb277f6a03557cd0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.830987 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8362e26d86d44e9780d3c78c6a468556. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.833700 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 8362e26d86d44e9780d3c78c6a468556 (DEFAULT_TABLE table=default.Table_5a29e7dba4ba43dfbd0c27981080a1ac [id=8611464429b848fbb277f6a03557cd0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.833784 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17339d7c0a4b40a78b3252d17481c192" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.833879 15110 raft_consensus.cc:2468] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:31.835994 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34c330b5dd544ae686f741cdd85d023d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.836045 17198 tablet_replica.cc:333] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:31.836205 17198 raft_consensus.cc:2243] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:31.836992 14944 tablet_service.cc:1505] Processing CreateTablet for tablet d049bf946c744664aba74d7a12fa4ff1 (DEFAULT_TABLE table=default.Table_fe4cbb31d8584609ab3669f24baa8c27 [id=33bbe4605d924011b9002a939a73203d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.837195 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d049bf946c744664aba74d7a12fa4ff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.838066 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b6ae6527fd64c3bb5999dec97db861d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.839836 16391 tablet_bootstrap.cc:492] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.839901 16391 ts_tablet_manager.cc:1403] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.027s user 0.001s sys 0.000s
I20251025 08:02:31.840267 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d116fbec0c6149938b8f6c19af9607af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.841341 16391 raft_consensus.cc:359] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.841423 16391 raft_consensus.cc:385] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.841449 16391 raft_consensus.cc:740] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.841553 16391 consensus_queue.cc:260] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.841996 16391 ts_tablet_manager.cc:1434] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:31.842128 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8362e26d86d44e9780d3c78c6a468556. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.842224 16391 tablet_bootstrap.cc:492] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.843080 16390 tablet_bootstrap.cc:492] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.843142 16390 ts_tablet_manager.cc:1403] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20251025 08:02:31.843166 16391 tablet_bootstrap.cc:654] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.843727 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47b0f93bac664a44989534097be9fd73. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.846479 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 56ef6eeb5739448ebeb42d0de38512a7 (DEFAULT_TABLE table=default.Table_87199a6b9d0a48909e5a74fb64314424 [id=4620fcb32741453f9d1ae07209213d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.846747 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56ef6eeb5739448ebeb42d0de38512a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.848694 15027 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:31.849676 16390 raft_consensus.cc:359] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.849725 15088 tablet_service.cc:1505] Processing CreateTablet for tablet d049bf946c744664aba74d7a12fa4ff1 (DEFAULT_TABLE table=default.Table_fe4cbb31d8584609ab3669f24baa8c27 [id=33bbe4605d924011b9002a939a73203d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.849772 16390 raft_consensus.cc:385] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.849807 16390 raft_consensus.cc:740] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.849900 16390 consensus_queue.cc:260] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.850271 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d049bf946c744664aba74d7a12fa4ff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.850100 15212 tablet_service.cc:1505] Processing CreateTablet for tablet d049bf946c744664aba74d7a12fa4ff1 (DEFAULT_TABLE table=default.Table_fe4cbb31d8584609ab3669f24baa8c27 [id=33bbe4605d924011b9002a939a73203d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.850212 16390 ts_tablet_manager.cc:1434] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20251025 08:02:31.850575 15909 consensus_queue.cc:1048] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.850766 16390 tablet_bootstrap.cc:492] T 878883a39db14b2dac25abacdc3dd0eb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.850847 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d049bf946c744664aba74d7a12fa4ff1. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:31.851082 15183 leader_election.cc:343] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.851661 16390 tablet_bootstrap.cc:654] T 878883a39db14b2dac25abacdc3dd0eb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.852205 17198 raft_consensus.cc:2272] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:31.852486 16280 catalog_manager.cc:5649] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:31.852751 16280 catalog_manager.cc:5649] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:31.853075 16280 catalog_manager.cc:5649] T 89eda91ab00245418389e614550f20c1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:31.853277 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 42e8a5ee7d6a42aaaf95c33617abff3f (table default.Table_5d847a37cb0c456294cb5137046f80bb [id=1f6784494d0b4b98b46077a0af6c2ea8]). Expected version 1 got 0
I20251025 08:02:31.854272 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 56ef6eeb5739448ebeb42d0de38512a7 (DEFAULT_TABLE table=default.Table_87199a6b9d0a48909e5a74fb64314424 [id=4620fcb32741453f9d1ae07209213d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.854755 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56ef6eeb5739448ebeb42d0de38512a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.854821 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 56ef6eeb5739448ebeb42d0de38512a7 (DEFAULT_TABLE table=default.Table_87199a6b9d0a48909e5a74fb64314424 [id=4620fcb32741453f9d1ae07209213d59]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.855021 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56ef6eeb5739448ebeb42d0de38512a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.855439 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 8362e26d86d44e9780d3c78c6a468556 (DEFAULT_TABLE table=default.Table_5a29e7dba4ba43dfbd0c27981080a1ac [id=8611464429b848fbb277f6a03557cd0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.855556 17198 ts_tablet_manager.cc:1916] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:31.855621 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8362e26d86d44e9780d3c78c6a468556. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.857429 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 77f04f445b5d47d2a78fdac0641a7372 (DEFAULT_TABLE table=default.Table_3d5f1adc46e8481386de4051dd453445 [id=7481684b10d946299ea5a1f0918a2407]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.857791 17274 tablet_bootstrap.cc:492] T f6082b299bb44d31b567f70d8da7f0ac P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:31.858865 17274 tablet_bootstrap.cc:654] T f6082b299bb44d31b567f70d8da7f0ac P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.859058 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 77f04f445b5d47d2a78fdac0641a7372 (DEFAULT_TABLE table=default.Table_3d5f1adc46e8481386de4051dd453445 [id=7481684b10d946299ea5a1f0918a2407]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.859270 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f04f445b5d47d2a78fdac0641a7372. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.861084 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 77f04f445b5d47d2a78fdac0641a7372 (DEFAULT_TABLE table=default.Table_3d5f1adc46e8481386de4051dd453445 [id=7481684b10d946299ea5a1f0918a2407]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.861348 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f04f445b5d47d2a78fdac0641a7372. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.862308 16280 catalog_manager.cc:5649] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.862900 14942 tablet_service.cc:1505] Processing CreateTablet for tablet 82b93b7537c047aea430658ae2c2654b (DEFAULT_TABLE table=default.Table_0ac9d6fdd08b48f0b70da65d5f7a722a [id=7c9a46c4cada46ad916b89605c18190f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.863091 15384 consensus_queue.cc:1048] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.863265 16280 catalog_manager.cc:5649] T 1f4add8060af4a9da95c3e78567f871f P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:31.863344 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 82b93b7537c047aea430658ae2c2654b (DEFAULT_TABLE table=default.Table_0ac9d6fdd08b48f0b70da65d5f7a722a [id=7c9a46c4cada46ad916b89605c18190f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.863530 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b93b7537c047aea430658ae2c2654b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.863497 16280 catalog_manager.cc:5649] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.863634 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet b7bb3d7d89674b7e825868c17495bbb3 (table default.Table_c6928dca846645b8887db36cc7cb9675 [id=9d1a6ae0121b45cda008d5dda6ea7e35]). Expected version 1 got 0
I20251025 08:02:31.863809 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet d162f3ee21bd40ce9a9c74b7863a3878 (table default.Table_a6c6f65ea3444858aa562a65d71c4e77 [id=2ef2d72066f446619f9045da34df7814]). Expected version 1 got 0
I20251025 08:02:31.863956 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 86b1873446154249a80fa67b99496545 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]). Expected version 1 got 0
I20251025 08:02:31.864092 16280 catalog_manager.cc:5649] T b866fc38e3444514b834f7876fb700ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:31.864276 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet ce5ae591c86c4455a1dd3704f1c95d1c (table default.Table_9c7e0359120c415cba47b89251b0be94 [id=4510ebbcd6ee43babe7ee133a0ce6ae5]). Expected version 1 got 0
I20251025 08:02:31.864327 15384 consensus_queue.cc:1048] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.864408 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 6d1979a4f43a4659976b0cd6d1b888ef (table default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95]). Expected version 1 got 0
I20251025 08:02:31.864477 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 1019d033e1f24ab596309462cbeb9c73 (table default.Table_5e5050bacd5543229399a2924609ae9c [id=4644ba57f12f4ad4bf7e89f80c4cd161]). Expected version 1 got 0
I20251025 08:02:31.864578 16280 catalog_manager.cc:5649] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.865592 17274 tablet_bootstrap.cc:492] T f6082b299bb44d31b567f70d8da7f0ac P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:31.865672 17274 ts_tablet_manager.cc:1403] T f6082b299bb44d31b567f70d8da7f0ac P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20251025 08:02:31.865911 15185 leader_election.cc:304] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:31.865942 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 82b93b7537c047aea430658ae2c2654b (DEFAULT_TABLE table=default.Table_0ac9d6fdd08b48f0b70da65d5f7a722a [id=7c9a46c4cada46ad916b89605c18190f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.866037 15384 raft_consensus.cc:2804] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.866096 15384 raft_consensus.cc:493] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.866137 15384 raft_consensus.cc:3060] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.866168 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b93b7537c047aea430658ae2c2654b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.866752 17274 raft_consensus.cc:359] T f6082b299bb44d31b567f70d8da7f0ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.866900 17274 raft_consensus.cc:385] T f6082b299bb44d31b567f70d8da7f0ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.866974 17274 raft_consensus.cc:740] T f6082b299bb44d31b567f70d8da7f0ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.866954 15384 raft_consensus.cc:515] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.867165 17274 consensus_queue.cc:260] T f6082b299bb44d31b567f70d8da7f0ac P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.867535 17274 ts_tablet_manager.cc:1434] T f6082b299bb44d31b567f70d8da7f0ac P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:31.867749 17274 tablet_bootstrap.cc:492] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:31.868974 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b93b7537c047aea430658ae2c2654b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.868989 14952 tablet_service.cc:1505] Processing CreateTablet for tablet f3f42babc0b2421fa80b265997effe36 (DEFAULT_TABLE table=default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.869180 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f42babc0b2421fa80b265997effe36. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.870275 15384 leader_election.cc:290] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.870690 17274 tablet_bootstrap.cc:654] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.872419 17198 ts_tablet_manager.cc:1929] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:31.872524 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77f04f445b5d47d2a78fdac0641a7372. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.872880 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17339d7c0a4b40a78b3252d17481c192" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:31.877600 15110 raft_consensus.cc:3060] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.878055 15087 tablet_service.cc:1505] Processing CreateTablet for tablet f3f42babc0b2421fa80b265997effe36 (DEFAULT_TABLE table=default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.878288 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f42babc0b2421fa80b265997effe36. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.878446 15110 raft_consensus.cc:2468] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:31.878517 15225 tablet_service.cc:1505] Processing CreateTablet for tablet f3f42babc0b2421fa80b265997effe36 (DEFAULT_TABLE table=default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.878821 17198 log.cc:1199] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/fba2914feb95475fbbfc5cef5a653408
I20251025 08:02:31.878919 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f42babc0b2421fa80b265997effe36. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.879135 17198 ts_tablet_manager.cc:1950] T fba2914feb95475fbbfc5cef5a653408 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:31.880056 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17339d7c0a4b40a78b3252d17481c192" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:31.880882 17274 tablet_bootstrap.cc:492] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:31.881115 17274 ts_tablet_manager.cc:1403] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20251025 08:02:31.881533 17274 raft_consensus.cc:359] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.881626 17274 raft_consensus.cc:385] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.881664 17274 raft_consensus.cc:740] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.881778 17274 consensus_queue.cc:260] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.882081 17274 ts_tablet_manager.cc:1434] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:31.881964 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 658a20d894c5444a820ce6bd33e4fdf0 (DEFAULT_TABLE table=default.Table_25e0298aad614dba82f598191e458567 [id=7edb1b5b68864e54b6366186a8915fcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.882243 17274 tablet_bootstrap.cc:492] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:31.882540 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658a20d894c5444a820ce6bd33e4fdf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.883055 17274 tablet_bootstrap.cc:654] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.883280 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 658a20d894c5444a820ce6bd33e4fdf0 (DEFAULT_TABLE table=default.Table_25e0298aad614dba82f598191e458567 [id=7edb1b5b68864e54b6366186a8915fcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.883478 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658a20d894c5444a820ce6bd33e4fdf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.884814 15384 consensus_queue.cc:1048] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:31.885290 15183 leader_election.cc:343] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.887718 15185 leader_election.cc:304] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:31.887912 15909 raft_consensus.cc:2804] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.887987 15909 raft_consensus.cc:697] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:31.888084 15909 consensus_queue.cc:237] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.888958 16199 raft_consensus.cc:493] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.889036 16199 raft_consensus.cc:515] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.889289 16199 leader_election.cc:290] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.890211 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet fba2914feb95475fbbfc5cef5a653408 (table default.Table_cce271e6706043dabfbd2c4b55bf198b [id=3a6e3a35c29b486b9ed32bc6fe1ec042]) successfully deleted
I20251025 08:02:31.891163 14952 tablet_service.cc:1505] Processing CreateTablet for tablet f5f72ca8cfb94178a21619ddc9fc0352 (DEFAULT_TABLE table=default.Table_75b0519af19a461d8dd5bdfd0c7a50c5 [id=b73d5c5cd3824129b9efc54f3aa7c304]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.891376 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f72ca8cfb94178a21619ddc9fc0352. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.892210 15087 tablet_service.cc:1505] Processing CreateTablet for tablet f5f72ca8cfb94178a21619ddc9fc0352 (DEFAULT_TABLE table=default.Table_75b0519af19a461d8dd5bdfd0c7a50c5 [id=b73d5c5cd3824129b9efc54f3aa7c304]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.892442 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f72ca8cfb94178a21619ddc9fc0352. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.892829 14942 tablet_service.cc:1505] Processing CreateTablet for tablet 45a22457031a4eff8e82fa232b6f05bb (DEFAULT_TABLE table=default.Table_ddaa9d9bb575414e95d302ba39e4df09 [id=34a3343e709b46128ae84467e02e48de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.893009 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a22457031a4eff8e82fa232b6f05bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.893435 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 45a22457031a4eff8e82fa232b6f05bb (DEFAULT_TABLE table=default.Table_ddaa9d9bb575414e95d302ba39e4df09 [id=34a3343e709b46128ae84467e02e48de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.893605 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a22457031a4eff8e82fa232b6f05bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.893811 14947 tablet_service.cc:1505] Processing CreateTablet for tablet 736f75f26af142e59e7996c2ebb80868 (DEFAULT_TABLE table=default.Table_d77beb2fdfdd42e5b1a16072888cfcac [id=6a04bdbf8b9046c59dc87dd393367134]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.894009 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736f75f26af142e59e7996c2ebb80868. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.894208 15085 tablet_service.cc:1505] Processing CreateTablet for tablet 736f75f26af142e59e7996c2ebb80868 (DEFAULT_TABLE table=default.Table_d77beb2fdfdd42e5b1a16072888cfcac [id=6a04bdbf8b9046c59dc87dd393367134]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.894412 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736f75f26af142e59e7996c2ebb80868. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.894466 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c043ab70d7364e05b0b352ac5c416db1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.894802 14943 tablet_service.cc:1505] Processing CreateTablet for tablet e5e907ec8e7c420d8d6d68a954cc8beb (DEFAULT_TABLE table=default.Table_85a7a7da077848fe960699e536360b41 [id=76245c883dcd4a6d8526bfc7ac12f4cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.895023 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5e907ec8e7c420d8d6d68a954cc8beb. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:31.895072 15185 leader_election.cc:343] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.896387 16390 tablet_bootstrap.cc:492] T 878883a39db14b2dac25abacdc3dd0eb P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.896351 14948 tablet_service.cc:1505] Processing CreateTablet for tablet c84d6bed24444dcfab1920efad849932 (DEFAULT_TABLE table=default.Table_67238f79fb2446bd9c19c32182814dd0 [id=3c97ef2101a945cd900b30a00a1c8459]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.896456 16390 ts_tablet_manager.cc:1403] T 878883a39db14b2dac25abacdc3dd0eb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.000s
I20251025 08:02:31.896549 14948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84d6bed24444dcfab1920efad849932. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.896838 15091 tablet_service.cc:1505] Processing CreateTablet for tablet e5e907ec8e7c420d8d6d68a954cc8beb (DEFAULT_TABLE table=default.Table_85a7a7da077848fe960699e536360b41 [id=76245c883dcd4a6d8526bfc7ac12f4cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.896835 16390 raft_consensus.cc:359] T 878883a39db14b2dac25abacdc3dd0eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.896919 16390 raft_consensus.cc:385] T 878883a39db14b2dac25abacdc3dd0eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.896946 16390 raft_consensus.cc:740] T 878883a39db14b2dac25abacdc3dd0eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.897042 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5e907ec8e7c420d8d6d68a954cc8beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.897029 16390 consensus_queue.cc:260] T 878883a39db14b2dac25abacdc3dd0eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.897286 16390 ts_tablet_manager.cc:1434] T 878883a39db14b2dac25abacdc3dd0eb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.897436 16390 tablet_bootstrap.cc:492] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.897584 15216 tablet_service.cc:1505] Processing CreateTablet for tablet c84d6bed24444dcfab1920efad849932 (DEFAULT_TABLE table=default.Table_67238f79fb2446bd9c19c32182814dd0 [id=3c97ef2101a945cd900b30a00a1c8459]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.897769 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84d6bed24444dcfab1920efad849932. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.898327 16390 tablet_bootstrap.cc:654] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.898366 15214 tablet_service.cc:1505] Processing CreateTablet for tablet 45a22457031a4eff8e82fa232b6f05bb (DEFAULT_TABLE table=default.Table_ddaa9d9bb575414e95d302ba39e4df09 [id=34a3343e709b46128ae84467e02e48de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.898554 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45a22457031a4eff8e82fa232b6f05bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.900434 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 736f75f26af142e59e7996c2ebb80868 (DEFAULT_TABLE table=default.Table_d77beb2fdfdd42e5b1a16072888cfcac [id=6a04bdbf8b9046c59dc87dd393367134]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.900626 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736f75f26af142e59e7996c2ebb80868. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.900714 16280 catalog_manager.cc:5649] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.900991 16280 catalog_manager.cc:5649] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:31.901229 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 0488062b11994f03a1af2e52db492977 (table default.Table_96ffee6ed67048c5bc78a91d739e8a02 [id=194a3dd184f4450da0604a85ace48fe9]). Expected version 1 got 0
I20251025 08:02:31.901367 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet e967a52212164b8cb6f9c39f207024a1 (table default.Table_434df4d622c74c6f89f7b7373096fb5f [id=0a4629613477421ba329364dbb42a8b6]). Expected version 1 got 0
I20251025 08:02:31.901484 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet cb3569ec2cdd4736b264b00abf1fa36a (table default.Table_08073379da334076bcc5503770a32982 [id=1ee33ee129d749d0bd7f26dc49fca0fe]). Expected version 4 got 0
I20251025 08:02:31.901612 16280 catalog_manager.cc:5649] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.901927 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 2562325ea1c9436a85e1d675574c0a6c (table default.Table_beff096618394ac1b31db74a94a9f991 [id=8a0e4fe9e4544c539cb23b0279c1deaf]). Expected version 2 got 0
I20251025 08:02:31.902029 16280 catalog_manager.cc:5649] T e0cc4859d32a4e119b413e1cbbb52834 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:31.902326 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 2f64072c416f4a77b1c81855d7db8f01 (table default.Table_b9669fd414104dcca80167117a5b0ed7 [id=431195fe6a3847caa5b39d62cb399ffb]). Expected version 1 got 0
I20251025 08:02:31.902441 16280 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 090117a75882489d84687e41b50616e9 (table default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e]). Expected version 1 got 0
I20251025 08:02:31.902735 15222 tablet_service.cc:1505] Processing CreateTablet for tablet e5e907ec8e7c420d8d6d68a954cc8beb (DEFAULT_TABLE table=default.Table_85a7a7da077848fe960699e536360b41 [id=76245c883dcd4a6d8526bfc7ac12f4cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.902925 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5e907ec8e7c420d8d6d68a954cc8beb. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:31.903079 16285 catalog_manager.cc:5101] could not convert tablet's 0488062b11994f03a1af2e52db492977 schema from PB: OK
I20251025 08:02:31.903412 16285 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_2c042f0ac6454365ae570c2cd26b31ca" } modify_external_catalogs: true
I20251025 08:02:31.903514 16285 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_2c042f0ac6454365ae570c2cd26b31ca" } modify_external_catalogs: true
I20251025 08:02:31.905565 14953 tablet_service.cc:1505] Processing CreateTablet for tablet ed2036a8ebd74ab18c0bbd6d9aa67ef0 (DEFAULT_TABLE table=default.Table_0517aaafe6e64827b84bb99171d2ad75 [id=a8e0504bc08744b4915157fa63d2226e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.905766 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2036a8ebd74ab18c0bbd6d9aa67ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.907816 15212 tablet_service.cc:1505] Processing CreateTablet for tablet f5f72ca8cfb94178a21619ddc9fc0352 (DEFAULT_TABLE table=default.Table_75b0519af19a461d8dd5bdfd0c7a50c5 [id=b73d5c5cd3824129b9efc54f3aa7c304]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.908022 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5f72ca8cfb94178a21619ddc9fc0352. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.908378 17274 tablet_bootstrap.cc:492] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:31.908448 17274 ts_tablet_manager.cc:1403] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.000s
I20251025 08:02:31.908855 17274 raft_consensus.cc:359] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.908941 17274 raft_consensus.cc:385] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.908986 17274 raft_consensus.cc:740] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.909092 17274 consensus_queue.cc:260] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.909354 17274 ts_tablet_manager.cc:1434] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.909492 17274 tablet_bootstrap.cc:492] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:31.910310 15085 tablet_service.cc:1505] Processing CreateTablet for tablet c84d6bed24444dcfab1920efad849932 (DEFAULT_TABLE table=default.Table_67238f79fb2446bd9c19c32182814dd0 [id=3c97ef2101a945cd900b30a00a1c8459]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.910504 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c84d6bed24444dcfab1920efad849932. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.910619 17274 tablet_bootstrap.cc:654] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.911181 16285 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 47b0f93bac664a44989534097be9fd73
I20251025 08:02:31.911638 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_9985b6eb72284cb583313ce952774b40"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:31.911962 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9985b6eb72284cb583313ce952774b40 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:31.913355 14945 tablet_service.cc:1552] Processing DeleteTablet for tablet 47b0f93bac664a44989534097be9fd73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
W20251025 08:02:31.913862 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 47b0f93bac664a44989534097be9fd73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47b0f93bac664a44989534097be9fd73 already in progress: creating tablet
I20251025 08:02:31.914901 16390 tablet_bootstrap.cc:492] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.914971 16390 ts_tablet_manager.cc:1403] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251025 08:02:31.918835 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c043ab70d7364e05b0b352ac5c416db1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:31.919442 17274 tablet_bootstrap.cc:492] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:31.919525 17274 ts_tablet_manager.cc:1403] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20251025 08:02:31.919981 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet 47b0f93bac664a44989534097be9fd73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:31.920261 16391 tablet_bootstrap.cc:492] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:31.920331 16391 ts_tablet_manager.cc:1403] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.078s user 0.002s sys 0.000s
I20251025 08:02:31.920720 16391 raft_consensus.cc:359] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.920806 16391 raft_consensus.cc:385] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.920837 16391 raft_consensus.cc:740] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.920970 16391 consensus_queue.cc:260] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.921267 16391 ts_tablet_manager.cc:1434] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:31.921422 16391 tablet_bootstrap.cc:492] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.922390 16391 tablet_bootstrap.cc:654] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.922693 17274 raft_consensus.cc:359] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.922832 17274 raft_consensus.cc:385] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.922886 17274 raft_consensus.cc:740] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.923043 17274 consensus_queue.cc:260] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.923326 17274 ts_tablet_manager.cc:1434] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:31.923511 17274 tablet_bootstrap.cc:492] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:31.924480 17274 tablet_bootstrap.cc:654] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.926244 17094 raft_consensus.cc:493] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.926326 17094 raft_consensus.cc:515] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.926644 17094 leader_election.cc:290] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.927085 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "878883a39db14b2dac25abacdc3dd0eb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:31.927420 15048 leader_election.cc:343] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.927677 16391 tablet_bootstrap.cc:492] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
W20251025 08:02:31.927696 16272 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 47b0f93bac664a44989534097be9fd73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47b0f93bac664a44989534097be9fd73 already in progress: creating tablet
I20251025 08:02:31.927795 16391 ts_tablet_manager.cc:1403] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251025 08:02:31.928395 16285 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_ebce5278d348458e8ab930ddd6088775" } modify_external_catalogs: true
I20251025 08:02:31.928493 16285 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_ebce5278d348458e8ab930ddd6088775" } modify_external_catalogs: true
I20251025 08:02:31.928560 16391 raft_consensus.cc:359] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.928642 16391 raft_consensus.cc:385] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.928668 16391 raft_consensus.cc:740] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.928766 16391 consensus_queue.cc:260] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.929032 16391 ts_tablet_manager.cc:1434] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:31.929178 16391 tablet_bootstrap.cc:492] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:31.930212 16391 tablet_bootstrap.cc:654] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.931118 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 47b0f93bac664a44989534097be9fd73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:42704
W20251025 08:02:31.931559 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 47b0f93bac664a44989534097be9fd73 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 47b0f93bac664a44989534097be9fd73 already in progress: creating tablet
I20251025 08:02:31.931720 16390 raft_consensus.cc:359] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.931821 16390 raft_consensus.cc:385] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.931855 16390 raft_consensus.cc:740] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.931902 17321 tablet.cc:1722] T 0488062b11994f03a1af2e52db492977 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:31.931962 16390 consensus_queue.cc:260] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.932338 16390 ts_tablet_manager.cc:1434] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.017s user 0.001s sys 0.000s
I20251025 08:02:31.932483 16390 tablet_bootstrap.cc:492] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.933562 16390 tablet_bootstrap.cc:654] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.934727 16420 consensus_queue.cc:1048] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.937795 15909 consensus_queue.cc:1048] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.939030 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "878883a39db14b2dac25abacdc3dd0eb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.939138 15240 raft_consensus.cc:2468] T 878883a39db14b2dac25abacdc3dd0eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:31.939877 16420 raft_consensus.cc:493] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.939981 16420 raft_consensus.cc:515] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.940270 16420 leader_election.cc:290] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.941336 16420 raft_consensus.cc:493] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.941413 16420 raft_consensus.cc:515] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:31.941704 16420 leader_election.cc:290] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:31.941967 16420 raft_consensus.cc:493] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:31.942032 16420 raft_consensus.cc:515] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.942324 16420 leader_election.cc:290] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.942896 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7bb3d7d89674b7e825868c17495bbb3" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.943012 15107 raft_consensus.cc:2393] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:31.943295 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1019d033e1f24ab596309462cbeb9c73" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.943400 15107 raft_consensus.cc:2393] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:31.943746 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6d1979a4f43a4659976b0cd6d1b888ef" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:31.943857 15107 raft_consensus.cc:2393] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:31.947547 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 658a20d894c5444a820ce6bd33e4fdf0 (DEFAULT_TABLE table=default.Table_25e0298aad614dba82f598191e458567 [id=7edb1b5b68864e54b6366186a8915fcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:31.948473 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b7bb3d7d89674b7e825868c17495bbb3" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.948544 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658a20d894c5444a820ce6bd33e4fdf0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:31.948768 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1019d033e1f24ab596309462cbeb9c73" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.948856 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6d1979a4f43a4659976b0cd6d1b888ef" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:31.949069 16572 consensus_queue.cc:1048] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.949409 14914 leader_election.cc:304] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.949608 14914 leader_election.cc:304] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.949795 14914 leader_election.cc:304] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:31.950049 16857 raft_consensus.cc:3060] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.950923 16857 raft_consensus.cc:2749] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.951035 16857 raft_consensus.cc:3060] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.951839 16857 raft_consensus.cc:2749] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.951933 16857 raft_consensus.cc:3060] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.952611 16857 raft_consensus.cc:2749] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:31.947710 15183 leader_election.cc:343] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.956681 15183 leader_election.cc:304] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:31.956851 16572 raft_consensus.cc:2749] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:31.957564 16283 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_9f2128ef54374befaec2adc1a1295f27" } new_table_name: "default.Table_a4851ecc90f640e9a09f6dd4c9b68f1e" modify_external_catalogs: true
I20251025 08:02:31.957684 16572 consensus_queue.cc:1048] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.959465 15049 leader_election.cc:304] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:31.959725 15642 raft_consensus.cc:2804] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:31.959776 15642 raft_consensus.cc:493] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:31.959815 15642 raft_consensus.cc:3060] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.960731 15642 raft_consensus.cc:515] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.961081 15642 leader_election.cc:290] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:31.961310 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "878883a39db14b2dac25abacdc3dd0eb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:31.961604 15048 leader_election.cc:343] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:31.961882 16420 consensus_queue.cc:1048] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.963704 17320 tablet.cc:1722] T 0488062b11994f03a1af2e52db492977 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:31.974713 17274 tablet_bootstrap.cc:492] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:31.974804 17274 ts_tablet_manager.cc:1403] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.000s
I20251025 08:02:31.975289 17274 raft_consensus.cc:359] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.975328 16279 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_075d43596a3d4f1e889c2cd50b615157" } new_table_name: "default.Table_a1c2dd3168ad45ffb213e55c47a2d0d3" modify_external_catalogs: true
I20251025 08:02:31.975427 17274 raft_consensus.cc:385] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.975464 17274 raft_consensus.cc:740] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.975593 17274 consensus_queue.cc:260] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.975862 17274 ts_tablet_manager.cc:1434] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.976019 17274 tablet_bootstrap.cc:492] T d116fbec0c6149938b8f6c19af9607af P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:31.976830 15183 consensus_peers.cc:597] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:31.976902 17274 tablet_bootstrap.cc:654] T d116fbec0c6149938b8f6c19af9607af P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.977984 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "878883a39db14b2dac25abacdc3dd0eb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:31.978091 15240 raft_consensus.cc:3060] T 878883a39db14b2dac25abacdc3dd0eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:31.978996 15240 raft_consensus.cc:2468] T 878883a39db14b2dac25abacdc3dd0eb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:31.981330 16282 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064] alter complete (version 2)
I20251025 08:02:31.982599 16283 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_d77beb2fdfdd42e5b1a16072888cfcac" } modify_external_catalogs: true
I20251025 08:02:31.982694 16283 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_d77beb2fdfdd42e5b1a16072888cfcac" } modify_external_catalogs: true
I20251025 08:02:31.982896 16390 tablet_bootstrap.cc:492] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:31.982967 16390 ts_tablet_manager.cc:1403] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.051s user 0.002s sys 0.000s
I20251025 08:02:31.983386 16390 raft_consensus.cc:359] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.983485 16390 raft_consensus.cc:385] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.983518 16390 raft_consensus.cc:740] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.983623 16390 consensus_queue.cc:260] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.983968 16390 ts_tablet_manager.cc:1434] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:31.984129 16390 tablet_bootstrap.cc:492] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:31.985112 16390 tablet_bootstrap.cc:654] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.988530 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 736f75f26af142e59e7996c2ebb80868
I20251025 08:02:31.988967 16283 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_a76b5a9d0bcb445a93fc08720b6cf78d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:31.989303 16283 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a76b5a9d0bcb445a93fc08720b6cf78d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:31.991331 17274 tablet_bootstrap.cc:492] T d116fbec0c6149938b8f6c19af9607af P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:31.991441 17274 ts_tablet_manager.cc:1403] T d116fbec0c6149938b8f6c19af9607af P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.001s
I20251025 08:02:31.991899 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 736f75f26af142e59e7996c2ebb80868 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
W20251025 08:02:31.992486 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 736f75f26af142e59e7996c2ebb80868 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 736f75f26af142e59e7996c2ebb80868 already in progress: creating tablet
I20251025 08:02:31.992614 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 736f75f26af142e59e7996c2ebb80868 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:31.993144 17274 raft_consensus.cc:359] T d116fbec0c6149938b8f6c19af9607af P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.993309 17274 raft_consensus.cc:385] T d116fbec0c6149938b8f6c19af9607af P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:31.993391 17274 raft_consensus.cc:740] T d116fbec0c6149938b8f6c19af9607af P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:31.993556 17274 consensus_queue.cc:260] T d116fbec0c6149938b8f6c19af9607af P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.993577 17043 consensus_queue.cc:1048] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:31.993731 16272 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 736f75f26af142e59e7996c2ebb80868 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 736f75f26af142e59e7996c2ebb80868 already in progress: creating tablet
I20251025 08:02:31.993930 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 736f75f26af142e59e7996c2ebb80868 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:31.994040 15049 leader_election.cc:304] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:31.994340 15497 raft_consensus.cc:2804] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:31.994423 15497 raft_consensus.cc:697] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
W20251025 08:02:31.994488 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 736f75f26af142e59e7996c2ebb80868 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 736f75f26af142e59e7996c2ebb80868 already in progress: creating tablet
I20251025 08:02:31.994540 15497 consensus_queue.cc:237] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:31.995208 17274 ts_tablet_manager.cc:1434] T d116fbec0c6149938b8f6c19af9607af P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:31.995393 17274 tablet_bootstrap.cc:492] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:31.996438 17274 tablet_bootstrap.cc:654] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:31.997113 17043 consensus_queue.cc:1048] T f9ccba7de6874245bc0e1cdb8e8acfb1 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:31.997907 16283 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_0e6c61f9e83f4f7db9789897a5016f7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:31.998339 16283 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0e6c61f9e83f4f7db9789897a5016f7c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.000026 17043 consensus_queue.cc:1048] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.004316 16390 tablet_bootstrap.cc:492] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.004456 16390 ts_tablet_manager.cc:1403] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20251025 08:02:32.004859 16390 raft_consensus.cc:359] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.005036 16390 raft_consensus.cc:385] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.005086 16390 raft_consensus.cc:740] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.005220 16390 consensus_queue.cc:260] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.005220 16283 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_325d514d7f504bf48182f9cab97df8b0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:32.005571 16390 ts_tablet_manager.cc:1434] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.005738 16390 tablet_bootstrap.cc:492] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.006439 15909 consensus_queue.cc:1048] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.006939 16390 tablet_bootstrap.cc:654] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:32.007035 16283 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_325d514d7f504bf48182f9cab97df8b0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.008253 17332 tablet.cc:1722] T 0488062b11994f03a1af2e52db492977 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:32.012876 16283 master_service.cc:954] ReplaceTablet: received request to replace tablet d162f3ee21bd40ce9a9c74b7863a3878 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.016239 14979 raft_consensus.cc:3060] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.016744 16281 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 2d16499315044408ad4bc1dca6341ed5
I20251025 08:02:32.017192 16281 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_501f3c298af041b9aec232c1957e77eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:32.017323 17321 tablet.cc:1722] T c2415c51234f482ca295cc71a74e7cab P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:32.017473 16281 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_501f3c298af041b9aec232c1957e77eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.018378 17320 tablet.cc:1722] T c2415c51234f482ca295cc71a74e7cab P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.018958 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 2d16499315044408ad4bc1dca6341ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.019111 17258 tablet_replica.cc:333] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.019248 17258 raft_consensus.cc:2243] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.019345 17258 raft_consensus.cc:2272] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.020418 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 2d16499315044408ad4bc1dca6341ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.021109 16572 consensus_queue.cc:1048] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.022264 17258 ts_tablet_manager.cc:1916] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.022464 16281 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_b78d203377614f379975983098c188da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:32.022732 17094 raft_consensus.cc:493] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251025 08:02:32.022750 16281 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b78d203377614f379975983098c188da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.022805 17094 raft_consensus.cc:515] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.023124 17094 leader_election.cc:290] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.023514 16390 tablet_bootstrap.cc:492] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.023595 16390 ts_tablet_manager.cc:1403] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251025 08:02:32.024040 16390 raft_consensus.cc:359] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.024135 16390 raft_consensus.cc:385] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.024163 16390 raft_consensus.cc:740] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.024257 16390 consensus_queue.cc:260] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.024537 16390 ts_tablet_manager.cc:1434] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:32.024708 16390 tablet_bootstrap.cc:492] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.024787 17258 ts_tablet_manager.cc:1929] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.024897 17258 log.cc:1199] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/2d16499315044408ad4bc1dca6341ed5
I20251025 08:02:32.025506 17258 ts_tablet_manager.cc:1950] T 2d16499315044408ad4bc1dca6341ed5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.026008 16390 tablet_bootstrap.cc:654] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.026379 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 2d16499315044408ad4bc1dca6341ed5 (table default.Table_401f8def453c48a19fc90b04a3294a16 [id=db8975b3e7bf43ffbd8b23ba666ffdd6]) successfully deleted
I20251025 08:02:32.027151 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6ae6527fd64c3bb5999dec97db861d" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:32.027436 15048 leader_election.cc:343] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.027607 17332 tablet.cc:1722] T c2415c51234f482ca295cc71a74e7cab P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.027670 15909 consensus_queue.cc:1048] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.027860 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6ae6527fd64c3bb5999dec97db861d" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.027976 15240 raft_consensus.cc:2468] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:32.028568 16281 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_d7bd713b44f4437ea22edf08c629ecb3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:32.028723 15049 leader_election.cc:304] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
W20251025 08:02:32.028834 16281 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d7bd713b44f4437ea22edf08c629ecb3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.028956 15642 raft_consensus.cc:2804] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.029006 15642 raft_consensus.cc:493] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.029040 15642 raft_consensus.cc:3060] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.030018 17316 consensus_queue.cc:1048] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.033309 17043 consensus_queue.cc:1048] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.033715 17198 tablet_replica.cc:333] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.033856 17198 raft_consensus.cc:2243] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.033963 17198 raft_consensus.cc:2272] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.034430 17274 tablet_bootstrap.cc:492] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:32.034500 17274 ts_tablet_manager.cc:1403] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.001s
I20251025 08:02:32.034833 17274 raft_consensus.cc:359] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.034909 17274 raft_consensus.cc:385] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.034934 17274 raft_consensus.cc:740] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.035526 16281 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_665ec5662cd24651897362288ed8ae87"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.035763 16281 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_665ec5662cd24651897362288ed8ae87 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.035753 15642 raft_consensus.cc:515] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.036056 15642 leader_election.cc:290] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.036268 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6ae6527fd64c3bb5999dec97db861d" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:32.036314 17274 consensus_queue.cc:260] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.036499 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8b6ae6527fd64c3bb5999dec97db861d" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:32.036581 15237 raft_consensus.cc:3060] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.036587 17274 ts_tablet_manager.cc:1434] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
W20251025 08:02:32.036600 15048 leader_election.cc:343] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.036753 17274 tablet_bootstrap.cc:492] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:32.037439 15237 raft_consensus.cc:2468] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:32.038044 15049 leader_election.cc:304] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:32.038462 17094 raft_consensus.cc:2804] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.038543 17094 raft_consensus.cc:697] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:32.038653 17094 consensus_queue.cc:237] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.039724 17274 tablet_bootstrap.cc:654] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.042675 16281 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_9419360c7ef742d196d6ac96f41241f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.043059 16281 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9419360c7ef742d196d6ac96f41241f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:32.047338 17337 consensus_queue.cc:1175] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e51a2be794f04642b89386067ecbc77e" status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20251025 08:02:32.048254 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 2d16499315044408ad4bc1dca6341ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.048379 17198 ts_tablet_manager.cc:1916] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.048576 16286 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet e87bae31e5e642a5a34a8c170c62fdca
I20251025 08:02:32.049026 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_5f10743381924d79a2225fed0b5db70f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.049314 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f10743381924d79a2225fed0b5db70f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.050489 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet e87bae31e5e642a5a34a8c170c62fdca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.050784 17194 tablet_replica.cc:333] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.051323 17194 raft_consensus.cc:2243] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.051584 17194 raft_consensus.cc:2272] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.052276 17194 ts_tablet_manager.cc:1916] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.054677 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet e87bae31e5e642a5a34a8c170c62fdca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.055827 17043 raft_consensus.cc:493] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.055966 17194 ts_tablet_manager.cc:1929] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.055939 17043 raft_consensus.cc:515] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.056044 17194 log.cc:1199] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/2d16499315044408ad4bc1dca6341ed5
I20251025 08:02:32.055339 17198 ts_tablet_manager.cc:1929] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.056244 17198 log.cc:1199] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/2d16499315044408ad4bc1dca6341ed5
I20251025 08:02:32.056337 17043 leader_election.cc:290] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.056475 17198 ts_tablet_manager.cc:1950] T 2d16499315044408ad4bc1dca6341ed5 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:32.056522 16279 master_service.cc:954] ReplaceTablet: received request to replace tablet ea0d438e99864c57999abf3467edc643 from {username='slave'} at 127.0.0.1:39708
W20251025 08:02:32.057072 14914 leader_election.cc:343] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: e48ddcfccc1340d39d21ce94bec4bf27
I20251025 08:02:32.057334 17194 ts_tablet_manager.cc:1950] T 2d16499315044408ad4bc1dca6341ed5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.057564 16390 tablet_bootstrap.cc:492] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.057643 16390 ts_tablet_manager.cc:1403] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.001s
I20251025 08:02:32.057814 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 2d16499315044408ad4bc1dca6341ed5 (table default.Table_401f8def453c48a19fc90b04a3294a16 [id=db8975b3e7bf43ffbd8b23ba666ffdd6]) successfully deleted
I20251025 08:02:32.057998 17194 tablet_replica.cc:333] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.058125 17194 raft_consensus.cc:2243] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.058233 17194 raft_consensus.cc:2272] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.058270 16390 raft_consensus.cc:359] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.058350 16390 raft_consensus.cc:385] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.058379 16390 raft_consensus.cc:740] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.058494 16390 consensus_queue.cc:260] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.058698 17194 ts_tablet_manager.cc:1916] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.058818 16390 ts_tablet_manager.cc:1434] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:32.058974 16390 tablet_bootstrap.cc:492] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.060139 17258 tablet_replica.cc:333] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.060484 17258 raft_consensus.cc:2243] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.060525 16390 tablet_bootstrap.cc:654] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.060779 17258 raft_consensus.cc:2272] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.061187 17258 ts_tablet_manager.cc:1916] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.062048 16281 master_service.cc:954] ReplaceTablet: received request to replace tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.063181 17258 ts_tablet_manager.cc:1929] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.063292 17258 log.cc:1199] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/e87bae31e5e642a5a34a8c170c62fdca
I20251025 08:02:32.063570 17258 ts_tablet_manager.cc:1950] T e87bae31e5e642a5a34a8c170c62fdca P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.065510 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 2d16499315044408ad4bc1dca6341ed5 (table default.Table_401f8def453c48a19fc90b04a3294a16 [id=db8975b3e7bf43ffbd8b23ba666ffdd6]) successfully deleted
I20251025 08:02:32.066004 17274 tablet_bootstrap.cc:492] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:32.066071 17274 ts_tablet_manager.cc:1403] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.000s
I20251025 08:02:32.066577 17274 raft_consensus.cc:359] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.066677 17274 raft_consensus.cc:385] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.066711 17274 raft_consensus.cc:740] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.066849 17274 consensus_queue.cc:260] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.067202 17274 ts_tablet_manager.cc:1434] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:32.067375 17274 tablet_bootstrap.cc:492] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:32.067837 15085 tablet_service.cc:1505] Processing CreateTablet for tablet ed2036a8ebd74ab18c0bbd6d9aa67ef0 (DEFAULT_TABLE table=default.Table_0517aaafe6e64827b84bb99171d2ad75 [id=a8e0504bc08744b4915157fa63d2226e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.068089 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2036a8ebd74ab18c0bbd6d9aa67ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.068759 15212 tablet_service.cc:1505] Processing CreateTablet for tablet ed2036a8ebd74ab18c0bbd6d9aa67ef0 (DEFAULT_TABLE table=default.Table_0517aaafe6e64827b84bb99171d2ad75 [id=a8e0504bc08744b4915157fa63d2226e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.068991 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed2036a8ebd74ab18c0bbd6d9aa67ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.069162 17274 tablet_bootstrap.cc:654] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.071092 16582 raft_consensus.cc:493] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.071169 16582 raft_consensus.cc:515] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.071475 16582 leader_election.cc:290] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.071554 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet e87bae31e5e642a5a34a8c170c62fdca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.073191 17198 tablet_replica.cc:333] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.073311 17198 raft_consensus.cc:2243] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.073382 17198 raft_consensus.cc:2272] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.073707 17198 ts_tablet_manager.cc:1916] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.075726 17198 ts_tablet_manager.cc:1929] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.075838 17198 log.cc:1199] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/e87bae31e5e642a5a34a8c170c62fdca
I20251025 08:02:32.076148 17198 ts_tablet_manager.cc:1950] T e87bae31e5e642a5a34a8c170c62fdca P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:32.077317 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 95030a851b5d4155b235a4e896250c80 (DEFAULT_TABLE table=default.Table_8001f289cc1341ce83a82f259b0255f1 [id=786fb14e6748434da35e7a7da1289963]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.077750 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95030a851b5d4155b235a4e896250c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.079519 16391 tablet_bootstrap.cc:492] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.079596 16391 ts_tablet_manager.cc:1403] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.150s user 0.001s sys 0.001s
I20251025 08:02:32.080044 17274 tablet_bootstrap.cc:492] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:32.080013 16391 raft_consensus.cc:359] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.080102 16391 raft_consensus.cc:385] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.080116 17274 ts_tablet_manager.cc:1403] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20251025 08:02:32.080132 16391 raft_consensus.cc:740] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.080238 16391 consensus_queue.cc:260] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.080494 16391 ts_tablet_manager.cc:1434] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:32.080521 17274 raft_consensus.cc:359] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.080600 17274 raft_consensus.cc:385] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.080634 17274 raft_consensus.cc:740] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.080869 17274 consensus_queue.cc:260] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.081178 17274 ts_tablet_manager.cc:1434] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:32.081328 17274 tablet_bootstrap.cc:492] T 56ef6eeb5739448ebeb42d0de38512a7 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:32.082348 17274 tablet_bootstrap.cc:654] T 56ef6eeb5739448ebeb42d0de38512a7 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.085011 17332 tablet.cc:1722] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.085275 17320 tablet.cc:1722] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.087109 16287 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 60c49b70f8f44dd3aec433206b897843
I20251025 08:02:32.087236 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c043ab70d7364e05b0b352ac5c416db1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.087392 16287 catalog_manager.cc:6719] ReplaceTablet: tablet 60c49b70f8f44dd3aec433206b897843 deleted and replaced by tablet 54ac551e1e9a4bb1970be52edd04c0d3
I20251025 08:02:32.087666 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 60c49b70f8f44dd3aec433206b897843 with delete_type TABLET_DATA_DELETED (replaced by tablet 54ac551e1e9a4bb1970be52edd04c0d3) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.088022 16285 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 212ccfb58f964d7bae31e5af110b4079
I20251025 08:02:32.088135 16391 tablet_bootstrap.cc:492] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:32.088142 15048 leader_election.cc:343] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.088371 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 95030a851b5d4155b235a4e896250c80 (DEFAULT_TABLE table=default.Table_8001f289cc1341ce83a82f259b0255f1 [id=786fb14e6748434da35e7a7da1289963]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.088582 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95030a851b5d4155b235a4e896250c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.088815 16199 raft_consensus.cc:493] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.088896 16199 raft_consensus.cc:515] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.089013 16391 tablet_bootstrap.cc:654] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.089249 16199 leader_election.cc:290] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.089676 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 212ccfb58f964d7bae31e5af110b4079 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.089836 16281 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c
I20251025 08:02:32.089834 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6082b299bb44d31b567f70d8da7f0ac" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.089928 15113 raft_consensus.cc:2468] T f6082b299bb44d31b567f70d8da7f0ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:32.090431 15185 leader_election.cc:304] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.090474 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c with delete_type TABLET_DATA_DELETED (replaced by tablet 35bddef8fd2d4971a636e0689ac37d3a) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.090474 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c with delete_type TABLET_DATA_DELETED (replaced by tablet 35bddef8fd2d4971a636e0689ac37d3a) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.090593 15909 raft_consensus.cc:2804] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.090638 15909 raft_consensus.cc:493] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.090677 15909 raft_consensus.cc:3060] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.091470 15909 raft_consensus.cc:515] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.091786 15909 leader_election.cc:290] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.092051 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6082b299bb44d31b567f70d8da7f0ac" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:32.092139 15113 raft_consensus.cc:3060] T f6082b299bb44d31b567f70d8da7f0ac P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.092891 15113 raft_consensus.cc:2468] T f6082b299bb44d31b567f70d8da7f0ac P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:32.093147 15185 leader_election.cc:304] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.093997 17194 ts_tablet_manager.cc:1929] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.094097 17194 log.cc:1199] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/e87bae31e5e642a5a34a8c170c62fdca
I20251025 08:02:32.094384 17194 ts_tablet_manager.cc:1950] T e87bae31e5e642a5a34a8c170c62fdca P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.094488 15909 raft_consensus.cc:2804] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.094568 15909 raft_consensus.cc:697] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:32.094681 15909 consensus_queue.cc:237] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.096565 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 95030a851b5d4155b235a4e896250c80 (DEFAULT_TABLE table=default.Table_8001f289cc1341ce83a82f259b0255f1 [id=786fb14e6748434da35e7a7da1289963]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.096822 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95030a851b5d4155b235a4e896250c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.097139 16281 catalog_manager.cc:6719] ReplaceTablet: tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c deleted and replaced by tablet 35bddef8fd2d4971a636e0689ac37d3a
I20251025 08:02:32.099176 17194 tablet_replica.cc:333] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.099347 17194 raft_consensus.cc:2243] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.099536 17194 raft_consensus.cc:2272] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.099911 17194 ts_tablet_manager.cc:1916] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.100286 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet e87bae31e5e642a5a34a8c170c62fdca (table default.Table_3ad0d85469a7485ba556f83ce20cecdf [id=edf9af4acd364a30814a645d32d35224]) successfully deleted
I20251025 08:02:32.100488 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 60c49b70f8f44dd3aec433206b897843 with delete_type TABLET_DATA_DELETED (replaced by tablet 54ac551e1e9a4bb1970be52edd04c0d3) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.100993 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet e87bae31e5e642a5a34a8c170c62fdca (table default.Table_3ad0d85469a7485ba556f83ce20cecdf [id=edf9af4acd364a30814a645d32d35224]) successfully deleted
I20251025 08:02:32.101028 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet e87bae31e5e642a5a34a8c170c62fdca (table default.Table_3ad0d85469a7485ba556f83ce20cecdf [id=edf9af4acd364a30814a645d32d35224]) successfully deleted
I20251025 08:02:32.101202 17258 tablet_replica.cc:333] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.101362 17258 raft_consensus.cc:2243] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.101773 17258 raft_consensus.cc:2272] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.102025 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet bcf414d04305456b80b2ec5dd8fb0ba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.102458 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet d709ecb9ac9a4525985c7d2bf10719f5 with delete_type TABLET_DATA_DELETED (replaced by tablet b7bb3d7d89674b7e825868c17495bbb3) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.103636 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 2069ab40d30c4b8dab9d37c466522ac1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d1979a4f43a4659976b0cd6d1b888ef) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.104032 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet e87bae31e5e642a5a34a8c170c62fdca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.104434 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet e48ddcfccc1340d39d21ce94bec4bf27 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.104809 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet bea55cdfbf454d76920806886c3d2c4e with delete_type TABLET_DATA_DELETED (replaced by tablet 17339d7c0a4b40a78b3252d17481c192) from {username='slave'} at 127.0.0.1:41762
W20251025 08:02:32.105654 16282 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet 86b1873446154249a80fa67b99496545 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 86b1873446154249a80fa67b99496545 consensus state has no leader
W20251025 08:02:32.105736 16282 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet 6d1979a4f43a4659976b0cd6d1b888ef (table default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 6d1979a4f43a4659976b0cd6d1b888ef consensus state has no leader
I20251025 08:02:32.105792 16281 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_9ad25f68a3a040818a9cd919b194b424" } new_table_name: "default.Table_6698a850627e4288bd367296b595759e" modify_external_catalogs: true
I20251025 08:02:32.107298 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 399d6b0459864b1586aa99948c56baea with delete_type TABLET_DATA_DELETED (replaced by tablet 47b0f93bac664a44989534097be9fd73) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.107692 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 93d383e3e2f4493d9cc8a71a4284e107 with delete_type TABLET_DATA_DELETED (replaced by tablet 82b93b7537c047aea430658ae2c2654b) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.108471 17321 tablet.cc:1722] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.108765 17332 tablet.cc:1722] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.115108 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet d162f3ee21bd40ce9a9c74b7863a3878
I20251025 08:02:32.115633 16283 catalog_manager.cc:6719] ReplaceTablet: tablet d162f3ee21bd40ce9a9c74b7863a3878 deleted and replaced by tablet f64222dd274f46e9bf79dba96c5c18b1
I20251025 08:02:32.115653 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet d162f3ee21bd40ce9a9c74b7863a3878 with delete_type TABLET_DATA_DELETED (replaced by tablet f64222dd274f46e9bf79dba96c5c18b1) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.116514 17320 tablet.cc:1722] T b7bb3d7d89674b7e825868c17495bbb3 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.117300 17332 tablet.cc:1722] T b7bb3d7d89674b7e825868c17495bbb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.118522 16279 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet ea0d438e99864c57999abf3467edc643
I20251025 08:02:32.118798 16279 catalog_manager.cc:6719] ReplaceTablet: tablet ea0d438e99864c57999abf3467edc643 deleted and replaced by tablet e0f08e0726a447848747ea33588867eb
I20251025 08:02:32.119671 14948 tablet_service.cc:1552] Processing DeleteTablet for tablet d162f3ee21bd40ce9a9c74b7863a3878 with delete_type TABLET_DATA_DELETED (replaced by tablet f64222dd274f46e9bf79dba96c5c18b1) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.119809 14943 tablet_service.cc:1552] Processing DeleteTablet for tablet ea0d438e99864c57999abf3467edc643 with delete_type TABLET_DATA_DELETED (replaced by tablet e0f08e0726a447848747ea33588867eb) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.120257 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet ea0d438e99864c57999abf3467edc643 with delete_type TABLET_DATA_DELETED (replaced by tablet e0f08e0726a447848747ea33588867eb) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.125901 17321 tablet.cc:1722] T 09fccf0770604812940dd63106f7d993 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20251025 08:02:32.126307 17332 tablet.cc:1722] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:32.126751 17320 tablet.cc:1722] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:32.128080 17194 ts_tablet_manager.cc:1929] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.128161 17194 log.cc:1199] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/60c49b70f8f44dd3aec433206b897843
I20251025 08:02:32.128401 17194 ts_tablet_manager.cc:1950] T 60c49b70f8f44dd3aec433206b897843 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.129523 17332 tablet.cc:1722] T 09fccf0770604812940dd63106f7d993 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20251025 08:02:32.130002 16279 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_8a52f20ffb6e455f9c5bc212cd09c071"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.130347 16279 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8a52f20ffb6e455f9c5bc212cd09c071 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.132280 17380 tablet.cc:1722] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.133005 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet 212ccfb58f964d7bae31e5af110b4079 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.133152 15087 tablet_service.cc:1552] Processing DeleteTablet for tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c with delete_type TABLET_DATA_DELETED (replaced by tablet 35bddef8fd2d4971a636e0689ac37d3a) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.133445 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 31c9e3906dac487e8585daa13d3fe4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.133486 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet e87bae31e5e642a5a34a8c170c62fdca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.133455 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet bcf414d04305456b80b2ec5dd8fb0ba7 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.133589 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 399d6b0459864b1586aa99948c56baea with delete_type TABLET_DATA_DELETED (replaced by tablet 47b0f93bac664a44989534097be9fd73) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.133675 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 2d16499315044408ad4bc1dca6341ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.133780 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 with delete_type TABLET_DATA_DELETED (replaced by tablet e7a34f24b89b4003b6590f8259a57199) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.133817 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 6cedb44483cf4f62acf52b90b6708dfb with delete_type TABLET_DATA_DELETED (replaced by tablet 86b1873446154249a80fa67b99496545) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.133869 15087 tablet_service.cc:1552] Processing DeleteTablet for tablet 2069ab40d30c4b8dab9d37c466522ac1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d1979a4f43a4659976b0cd6d1b888ef) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.133924 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 14b47bf733754b72b34bd74aa033afa3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.134125 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 6dd0f695a2904df5b750b45782a21ce2 with delete_type TABLET_DATA_DELETED (replaced by tablet f3f42babc0b2421fa80b265997effe36) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.134143 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet a3379087113041beba7ddbc6596c3b0a with delete_type TABLET_DATA_DELETED (replaced by tablet bc56844d88604fa5be02cd82b5856cd1) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.134265 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet bea55cdfbf454d76920806886c3d2c4e with delete_type TABLET_DATA_DELETED (replaced by tablet 17339d7c0a4b40a78b3252d17481c192) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.134337 15087 tablet_service.cc:1552] Processing DeleteTablet for tablet 446194cf013c4b6499deb00fab8db42a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.134656 17198 tablet_replica.cc:333] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.134793 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet d5cd481a98514f16bed3fb0bf5003526 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.134863 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet d162f3ee21bd40ce9a9c74b7863a3878 with delete_type TABLET_DATA_DELETED (replaced by tablet f64222dd274f46e9bf79dba96c5c18b1) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.134920 15084 tablet_service.cc:1552] Processing DeleteTablet for tablet ea0d438e99864c57999abf3467edc643 with delete_type TABLET_DATA_DELETED (replaced by tablet e0f08e0726a447848747ea33588867eb) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.135769 17198 raft_consensus.cc:2243] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.136008 17198 raft_consensus.cc:2272] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.136863 17198 ts_tablet_manager.cc:1916] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.139276 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 60c49b70f8f44dd3aec433206b897843 with delete_type TABLET_DATA_DELETED (replaced by tablet 54ac551e1e9a4bb1970be52edd04c0d3) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.139957 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 212ccfb58f964d7bae31e5af110b4079 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.140132 17198 ts_tablet_manager.cc:1929] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.140264 16288 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_67015d2b75d043d3bd2d7f8facd07524" } modify_external_catalogs: true
I20251025 08:02:32.140296 17198 log.cc:1199] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/212ccfb58f964d7bae31e5af110b4079
I20251025 08:02:32.140359 16288 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_67015d2b75d043d3bd2d7f8facd07524" } modify_external_catalogs: true
I20251025 08:02:32.140698 17258 ts_tablet_manager.cc:1916] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.140815 17198 ts_tablet_manager.cc:1950] T 212ccfb58f964d7bae31e5af110b4079 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:32.140985 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 2d16499315044408ad4bc1dca6341ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.141444 17198 tablet_replica.cc:333] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.141449 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 14b47bf733754b72b34bd74aa033afa3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.141577 15082 tablet_service.cc:1552] Processing DeleteTablet for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.141697 15083 tablet_service.cc:1552] Processing DeleteTablet for tablet 93d383e3e2f4493d9cc8a71a4284e107 with delete_type TABLET_DATA_DELETED (replaced by tablet 82b93b7537c047aea430658ae2c2654b) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.141932 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet e762c440cb0947deb7e6a4186deebdc1 with delete_type TABLET_DATA_DELETED (replaced by tablet 14b47bf733754b72b34bd74aa033afa3) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.142340 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 with delete_type TABLET_DATA_DELETED (replaced by tablet e7a34f24b89b4003b6590f8259a57199) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.142700 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 6cedb44483cf4f62acf52b90b6708dfb with delete_type TABLET_DATA_DELETED (replaced by tablet 86b1873446154249a80fa67b99496545) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.143047 17258 ts_tablet_manager.cc:1929] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.143083 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet cfe9add2f8bf450bb6f49ad57be2caae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.143115 17258 log.cc:1199] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/0d6cca70bc3c48bf9c2396fdfdb8e42c
I20251025 08:02:32.143500 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet a3379087113041beba7ddbc6596c3b0a with delete_type TABLET_DATA_DELETED (replaced by tablet bc56844d88604fa5be02cd82b5856cd1) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.143399 17258 ts_tablet_manager.cc:1950] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.144094 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 31c9e3906dac487e8585daa13d3fe4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.144335 17198 raft_consensus.cc:2243] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.144434 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c (table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]) successfully deleted
I20251025 08:02:32.144515 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d with delete_type TABLET_DATA_DELETED (replaced by tablet 1ab6b9d8278045ae92043ada5ce6dd71) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.144572 17198 raft_consensus.cc:2272] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.144994 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 7e90c358ef454760b8317d78724ee377 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.145460 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 6dd0f695a2904df5b750b45782a21ce2 with delete_type TABLET_DATA_DELETED (replaced by tablet f3f42babc0b2421fa80b265997effe36) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.146301 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 446194cf013c4b6499deb00fab8db42a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.146701 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet ae3c8e134d164edd8781f27e7bdc3b92 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.147087 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet e106f20977444dd4a49b6e4ae0f45380 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.148291 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet d5cd481a98514f16bed3fb0bf5003526 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.150609 14972 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6082b299bb44d31b567f70d8da7f0ac" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.151158 14972 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6082b299bb44d31b567f70d8da7f0ac" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:32.152776 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 212ccfb58f964d7bae31e5af110b4079 (table default.Table_ebce5278d348458e8ab930ddd6088775 [id=2de94631eeee41489ea858ed887de8c1]) successfully deleted
I20251025 08:02:32.153478 17320 tablet.cc:1722] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.155359 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41762
W20251025 08:02:32.159981 14915 leader_election.cc:343] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: e48ddcfccc1340d39d21ce94bec4bf27
I20251025 08:02:32.160090 14915 leader_election.cc:304] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:32.160280 15374 raft_consensus.cc:2749] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:32.160230 16281 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_d397fc560379473eaaf32d983dd63291" } new_table_name: "default.Table_a3565262078c4a9a84c70de12fbb9672" modify_external_catalogs: true
I20251025 08:02:32.163620 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c043ab70d7364e05b0b352ac5c416db1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.163722 15238 raft_consensus.cc:2468] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:32.164354 16570 raft_consensus.cc:493] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.164444 16570 raft_consensus.cc:515] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.164788 16570 leader_election.cc:290] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.166594 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d049bf946c744664aba74d7a12fa4ff1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.166716 15107 raft_consensus.cc:2468] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
W20251025 08:02:32.167048 16282 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.14.70.1:54701 (request call id 217) took 803 ms (client timeout 1000 ms). Trace:
W20251025 08:02:32.167182 16282 rpcz_store.cc:269] 1025 08:02:31.364024 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:31.418108 (+ 54084us) service_pool.cc:225] Handling call
1025 08:02:31.575749 (+157641us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:31.575752 (+ 3us) write_op.cc:454] Released schema lock
1025 08:02:31.690988 (+115236us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:31.690994 (+ 6us) write_op.cc:454] Released schema lock
1025 08:02:32.167018 (+476024us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1025 08:02:31.569970 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:31.570067 (+ 97us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:31.570071 (+ 4us) write_op.cc:435] Acquired schema lock
1025 08:02:31.570072 (+ 1us) tablet.cc:660] Decoding operations
1025 08:02:31.570382 (+ 310us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:31.570390 (+ 8us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:31.570394 (+ 4us) tablet.cc:683] Acquiring locks for 36 operations
1025 08:02:31.570683 (+ 289us) tablet.cc:699] Row locks acquired
1025 08:02:31.570686 (+ 3us) write_op.cc:260] PREPARE: finished
1025 08:02:31.570711 (+ 25us) write_op.cc:270] Start()
1025 08:02:31.570735 (+ 24us) write_op.cc:276] Timestamp: P: 1761379351570691 usec, L: 0
1025 08:02:31.570737 (+ 2us) op_driver.cc:348] REPLICATION: starting
1025 08:02:31.570850 (+ 113us) log.cc:844] Serialized 13618 byte log entry
1025 08:02:31.573777 (+ 2927us) op_driver.cc:464] REPLICATION: finished
1025 08:02:31.573863 (+ 86us) write_op.cc:301] APPLY: starting
1025 08:02:31.573877 (+ 14us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:31.573950 (+ 73us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:31.573965 (+ 15us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:31.574245 (+ 280us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:31.574283 (+ 38us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=36
1025 08:02:31.574288 (+ 5us) write_op.cc:312] APPLY: finished
1025 08:02:31.574389 (+ 101us) log.cc:844] Serialized 236 byte log entry
1025 08:02:31.574433 (+ 44us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:31.574457 (+ 24us) write_op.cc:454] Released schema lock
1025 08:02:31.574463 (+ 6us) write_op.cc:341] FINISH: Updating metrics
Related trace 'op':
1025 08:02:31.686888 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:31.686956 (+ 68us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:31.686958 (+ 2us) write_op.cc:435] Acquired schema lock
1025 08:02:31.686959 (+ 1us) tablet.cc:660] Decoding operations
1025 08:02:31.687020 (+ 61us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:31.687026 (+ 6us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:31.687028 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
1025 08:02:31.687057 (+ 29us) tablet.cc:699] Row locks acquired
1025 08:02:31.687058 (+ 1us) write_op.cc:260] PREPARE: finished
1025 08:02:31.687077 (+ 19us) write_op.cc:270] Start()
1025 08:02:31.687093 (+ 16us) write_op.cc:276] Timestamp: P: 1761379351687049 usec, L: 0
1025 08:02:31.687094 (+ 1us) op_driver.cc:348] REPLICATION: starting
1025 08:02:31.687182 (+ 88us) log.cc:844] Serialized 356 byte log entry
1025 08:02:31.689393 (+ 2211us) op_driver.cc:464] REPLICATION: finished
1025 08:02:31.689488 (+ 95us) write_op.cc:301] APPLY: starting
1025 08:02:31.689500 (+ 12us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:31.689520 (+ 20us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:31.689533 (+ 13us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:31.689560 (+ 27us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:31.689580 (+ 20us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
1025 08:02:31.689586 (+ 6us) write_op.cc:312] APPLY: finished
1025 08:02:31.689621 (+ 35us) log.cc:844] Serialized 23 byte log entry
1025 08:02:31.689655 (+ 34us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:31.689662 (+ 7us) write_op.cc:454] Released schema lock
1025 08:02:31.689665 (+ 3us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":124,"child_traces":[["op",{"apply.queue_time_us":43,"apply.run_cpu_time_us":643,"apply.run_wall_time_us":643,"num_ops":36,"prepare.queue_time_us":1735,"prepare.run_cpu_time_us":994,"prepare.run_wall_time_us":994,"raft.queue_time_us":770,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":147,"replication_time_us":3016}],["op",{"apply.queue_time_us":63,"apply.run_cpu_time_us":210,"apply.run_wall_time_us":209,"num_ops":1,"prepare.queue_time_us":72,"prepare.run_cpu_time_us":362,"prepare.run_wall_time_us":362,"raft.queue_time_us":232,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"replication_time_us":2279}]]}
I20251025 08:02:32.170892 17321 tablet.cc:1722] T c6ee2b8cfe7743d29714910fe8060083 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:32.172248 17373 consensus_queue.cc:1048] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.172302 16572 consensus_queue.cc:1048] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.172446 15185 leader_election.cc:304] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.172933 16572 raft_consensus.cc:2804] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.172982 16572 raft_consensus.cc:493] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.173019 16572 raft_consensus.cc:3060] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.173897 16572 raft_consensus.cc:515] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.174219 16572 leader_election.cc:290] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.172605 16199 consensus_queue.cc:1048] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.174564 15106 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d049bf946c744664aba74d7a12fa4ff1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:32.174660 15106 raft_consensus.cc:3060] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.175256 17380 tablet.cc:1722] T c6ee2b8cfe7743d29714910fe8060083 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:32.175578 15106 raft_consensus.cc:2468] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:32.175891 15185 leader_election.cc:304] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.176100 17373 raft_consensus.cc:2804] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.176259 17373 raft_consensus.cc:697] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:32.176393 17373 consensus_queue.cc:237] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.176909 17320 tablet.cc:1722] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.177210 16283 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e7c8eba2db5e4b09a8e56d75ad203fbf" } new_table_name: "default.Table_2f3a2a53312142a797c57248d8d2ad48" modify_external_catalogs: true
I20251025 08:02:32.178355 17320 tablet.cc:1722] T 09fccf0770604812940dd63106f7d993 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 5
I20251025 08:02:32.181079 16199 raft_consensus.cc:493] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.181155 16199 raft_consensus.cc:515] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:32.181447 15183 leader_election.cc:343] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.181458 16199 leader_election.cc:290] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.181500 15049 leader_election.cc:304] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:32.181627 15497 raft_consensus.cc:2804] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.181670 15497 raft_consensus.cc:493] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.181711 15497 raft_consensus.cc:3060] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:32.182418 16283 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc62afd62257471e8590d28e49a50cb2 has no consensus state
I20251025 08:02:32.182588 15497 raft_consensus.cc:515] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.182894 15497 leader_election.cc:290] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.183401 15100 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "519f631918c144ff8edcfc7127ca23dc" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.172148 17198 ts_tablet_manager.cc:1916] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.183496 15100 raft_consensus.cc:2468] T 519f631918c144ff8edcfc7127ca23dc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:32.183739 15185 leader_election.cc:304] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.184011 17369 raft_consensus.cc:2804] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.184095 17369 raft_consensus.cc:493] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.184170 17369 raft_consensus.cc:3060] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.184487 16390 tablet_bootstrap.cc:492] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.184574 16390 ts_tablet_manager.cc:1403] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.126s user 0.001s sys 0.000s
I20251025 08:02:32.185046 16390 raft_consensus.cc:359] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.185137 16390 raft_consensus.cc:385] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.185168 16390 raft_consensus.cc:740] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.185267 16390 consensus_queue.cc:260] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.185536 16390 ts_tablet_manager.cc:1434] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:32.185551 17369 raft_consensus.cc:515] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.186133 17369 leader_election.cc:290] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.185714 16390 tablet_bootstrap.cc:492] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.186784 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "519f631918c144ff8edcfc7127ca23dc" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:32.186872 15113 raft_consensus.cc:3060] T 519f631918c144ff8edcfc7127ca23dc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.187186 16390 tablet_bootstrap.cc:654] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.187660 15113 raft_consensus.cc:2468] T 519f631918c144ff8edcfc7127ca23dc P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:32.187806 16283 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_1ba04ec4ed664c8eaaeddbf2485375ae" } new_table_name: "default.Table_d80d24fe6db14f0da8149898449ae86e" modify_external_catalogs: true
I20251025 08:02:32.187903 15185 leader_election.cc:304] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.188750 17373 raft_consensus.cc:2804] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.189054 17373 raft_consensus.cc:697] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:32.189460 17320 tablet.cc:1722] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.189484 17373 consensus_queue.cc:237] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.190233 17380 tablet.cc:1722] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.191499 16285 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e9a56ee98afd4b14bb77f82f256e8379" } modify_external_catalogs: true
I20251025 08:02:32.191612 16285 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e9a56ee98afd4b14bb77f82f256e8379" } modify_external_catalogs: true
I20251025 08:02:32.196584 17373 raft_consensus.cc:493] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.196704 17373 raft_consensus.cc:515] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.197768 16285 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet b41e092b7f40410a979bcfd5bbc7c225
I20251025 08:02:32.198602 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_b1a5d2a17d6949d8b97b1aa02de7a9e7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:32.199465 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c043ab70d7364e05b0b352ac5c416db1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:32.200179 17373 leader_election.cc:290] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.200441 15099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "34c330b5dd544ae686f741cdd85d023d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.200554 15099 raft_consensus.cc:2468] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:32.200783 15185 leader_election.cc:304] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.200930 17373 raft_consensus.cc:2804] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.201030 17373 raft_consensus.cc:493] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.201118 17373 raft_consensus.cc:3060] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.201308 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet b41e092b7f40410a979bcfd5bbc7c225 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.204295 17373 raft_consensus.cc:515] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.204676 17373 leader_election.cc:290] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:32.205060 15048 leader_election.cc:343] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.205607 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_492cb5cd156a4d1a910aa96ecf028de1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:32.206012 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "34c330b5dd544ae686f741cdd85d023d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:32.206120 15110 raft_consensus.cc:3060] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.206466 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d049bf946c744664aba74d7a12fa4ff1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.206936 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d049bf946c744664aba74d7a12fa4ff1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:32.207199 15110 raft_consensus.cc:2468] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:32.207440 15185 leader_election.cc:304] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.207808 17373 raft_consensus.cc:2804] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.207943 17373 raft_consensus.cc:697] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:32.208089 17405 tablet.cc:1722] T 090117a75882489d84687e41b50616e9 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.208161 17321 tablet.cc:1722] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.208271 17194 tablet_replica.cc:333] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.208493 17194 raft_consensus.cc:2243] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.208753 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 60c49b70f8f44dd3aec433206b897843 (table default.Table_df3848a55c7646b1bd519eb12aa88aa1 [id=5160fad54600448f8b2c5bfc942f60a2]) successfully deleted
I20251025 08:02:32.208918 17194 raft_consensus.cc:2272] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.208958 17373 consensus_queue.cc:237] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.209724 17320 tablet.cc:1722] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.211527 17321 tablet.cc:1722] T 090117a75882489d84687e41b50616e9 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.211879 17332 tablet.cc:1722] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20251025 08:02:32.213263 17258 tablet_replica.cc:333] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.213382 17258 raft_consensus.cc:2243] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.213394 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_45dccafd9b8f494c9fb2c59042be73f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:32.213505 17258 raft_consensus.cc:2272] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.213730 17332 tablet.cc:1722] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.213809 17258 ts_tablet_manager.cc:1916] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.215643 17321 tablet.cc:1722] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.215971 17258 ts_tablet_manager.cc:1929] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.216078 17258 log.cc:1199] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/60c49b70f8f44dd3aec433206b897843
I20251025 08:02:32.216138 17194 ts_tablet_manager.cc:1916] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.216384 17258 ts_tablet_manager.cc:1950] T 60c49b70f8f44dd3aec433206b897843 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.216979 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 60c49b70f8f44dd3aec433206b897843 (table default.Table_df3848a55c7646b1bd519eb12aa88aa1 [id=5160fad54600448f8b2c5bfc942f60a2]) successfully deleted
W20251025 08:02:32.217499 15183 leader_election.cc:343] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.218111 17194 ts_tablet_manager.cc:1929] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.218248 17194 log.cc:1199] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/212ccfb58f964d7bae31e5af110b4079
I20251025 08:02:32.219090 17194 ts_tablet_manager.cc:1950] T 212ccfb58f964d7bae31e5af110b4079 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.219519 17405 tablet.cc:1722] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.219734 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 212ccfb58f964d7bae31e5af110b4079 (table default.Table_ebce5278d348458e8ab930ddd6088775 [id=2de94631eeee41489ea858ed887de8c1]) successfully deleted
I20251025 08:02:32.219777 17321 tablet.cc:1722] T fb4faadd4fc146a5af032ce815bd6cc4 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.220057 17194 tablet_replica.cc:333] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.220227 17194 raft_consensus.cc:2243] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.220911 17320 tablet.cc:1722] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20251025 08:02:32.222258 17320 tablet.cc:1722] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.222985 17380 tablet.cc:1722] T fb4faadd4fc146a5af032ce815bd6cc4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.223832 17320 tablet.cc:1722] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:32.227886 17198 ts_tablet_manager.cc:1929] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.228025 17320 tablet.cc:1722] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.228178 17198 log.cc:1199] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/0d6cca70bc3c48bf9c2396fdfdb8e42c
I20251025 08:02:32.228657 17198 ts_tablet_manager.cc:1950] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
W20251025 08:02:32.229187 15183 consensus_peers.cc:597] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:32.229399 15384 consensus_queue.cc:1048] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:32.229662 15183 leader_election.cc:343] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.229993 16570 consensus_queue.cc:1048] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.231348 17274 tablet_bootstrap.cc:492] T 56ef6eeb5739448ebeb42d0de38512a7 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:32.231426 17274 ts_tablet_manager.cc:1403] T 56ef6eeb5739448ebeb42d0de38512a7 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.150s user 0.000s sys 0.002s
I20251025 08:02:32.231489 17320 tablet.cc:1722] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.231859 17274 raft_consensus.cc:359] T 56ef6eeb5739448ebeb42d0de38512a7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.231949 17274 raft_consensus.cc:385] T 56ef6eeb5739448ebeb42d0de38512a7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.231999 17274 raft_consensus.cc:740] T 56ef6eeb5739448ebeb42d0de38512a7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.232116 17274 consensus_queue.cc:260] T 56ef6eeb5739448ebeb42d0de38512a7 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.232383 17274 ts_tablet_manager.cc:1434] T 56ef6eeb5739448ebeb42d0de38512a7 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:32.232529 17274 tablet_bootstrap.cc:492] T 77f04f445b5d47d2a78fdac0641a7372 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:32.233214 17405 tablet.cc:1722] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.233476 17274 tablet_bootstrap.cc:654] T 77f04f445b5d47d2a78fdac0641a7372 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.235364 17332 tablet.cc:1722] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.236701 17332 tablet.cc:1722] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:32.238171 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45dccafd9b8f494c9fb2c59042be73f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.238391 17332 tablet.cc:1722] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.239151 16285 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_a1c2dd3168ad45ffb213e55c47a2d0d3" } modify_external_catalogs: true
I20251025 08:02:32.239239 16285 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_a1c2dd3168ad45ffb213e55c47a2d0d3" } modify_external_catalogs: true
I20251025 08:02:32.239624 15083 tablet_service.cc:1552] Processing DeleteTablet for tablet b41e092b7f40410a979bcfd5bbc7c225 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
W20251025 08:02:32.240310 15183 leader_election.cc:343] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:32.240568 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b1a5d2a17d6949d8b97b1aa02de7a9e7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:32.240664 15185 consensus_peers.cc:597] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 212ccfb58f964d7bae31e5af110b4079. This is attempt 1: this message will repeat every 5th retry.
W20251025 08:02:32.241153 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_492cb5cd156a4d1a910aa96ecf028de1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.242766 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet b41e092b7f40410a979bcfd5bbc7c225 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.245635 17320 tablet.cc:1722] T c6ee2b8cfe7743d29714910fe8060083 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:32.224496 16391 tablet_bootstrap.cc:492] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.246520 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "519f631918c144ff8edcfc7127ca23dc" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:32.246623 16391 ts_tablet_manager.cc:1403] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.159s user 0.000s sys 0.001s
I20251025 08:02:32.226876 17321 tablet.cc:1722] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.247071 16391 raft_consensus.cc:359] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.247152 16391 raft_consensus.cc:385] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.247192 16391 raft_consensus.cc:740] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.247301 16391 consensus_queue.cc:260] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.242918 15027 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:32.247581 16391 ts_tablet_manager.cc:1434] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.247773 16391 tablet_bootstrap.cc:492] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.247951 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_8d895bf14fe042d7832bde868edc0e61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.248274 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d895bf14fe042d7832bde868edc0e61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.248692 16391 tablet_bootstrap.cc:654] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.243425 17415 raft_consensus.cc:493] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.245416 14970 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "519f631918c144ff8edcfc7127ca23dc" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.249501 17415 raft_consensus.cc:515] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.250075 17415 leader_election.cc:290] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.250131 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7dd513b6c7a24dffb91f66c32acc7696" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.251044 14970 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "34c330b5dd544ae686f741cdd85d023d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.251178 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "34c330b5dd544ae686f741cdd85d023d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:32.251034 17321 tablet.cc:1722] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:32.252465 17321 tablet.cc:1722] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.252983 17198 tablet_replica.cc:333] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.253304 17198 raft_consensus.cc:2243] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.253505 17198 raft_consensus.cc:2272] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.253562 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_6c9870e0994744ba98aace68eba418f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:32.253758 17321 tablet.cc:1722] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:32.253849 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c9870e0994744ba98aace68eba418f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.254380 17194 raft_consensus.cc:2272] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.254905 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_19e7c7e83016475789438a6a289ef69e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:32.255136 17194 ts_tablet_manager.cc:1916] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:32.255187 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_19e7c7e83016475789438a6a289ef69e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.256839 15242 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c043ab70d7364e05b0b352ac5c416db1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:32.256923 15242 raft_consensus.cc:3060] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.257827 15242 raft_consensus.cc:2468] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:32.257975 17380 tablet.cc:1722] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:32.256218 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "7dd513b6c7a24dffb91f66c32acc7696" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.258620 17332 tablet.cc:1722] T 17e61bb1e9c94b949361b2ca152eb3d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.258838 17198 ts_tablet_manager.cc:1916] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.259020 16285 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet fbae08a3a1c34dfda60b1985346e7761
I20251025 08:02:32.259413 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_dd5055250bd34b1cb92185869ef6186c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.259681 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd5055250bd34b1cb92185869ef6186c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.260218 17432 tablet.cc:1722] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.261564 17320 tablet.cc:1722] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.262493 17198 ts_tablet_manager.cc:1929] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.262670 17198 log.cc:1199] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/31c9e3906dac487e8585daa13d3fe4b1
I20251025 08:02:32.262722 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet fbae08a3a1c34dfda60b1985346e7761 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.262918 17426 tablet.cc:1722] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.263021 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c (table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]) successfully deleted
I20251025 08:02:32.264580 17426 tablet.cc:1722] T b7bb3d7d89674b7e825868c17495bbb3 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.265044 17258 tablet_replica.cc:333] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.265336 17258 raft_consensus.cc:2243] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.265413 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet fbae08a3a1c34dfda60b1985346e7761 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.265578 17258 raft_consensus.cc:2272] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.266057 17258 ts_tablet_manager.cc:1916] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.266528 16283 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_21b4f92893424716afe86f9c67b6a691" } modify_external_catalogs: true
I20251025 08:02:32.266623 16283 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_21b4f92893424716afe86f9c67b6a691" } modify_external_catalogs: true
I20251025 08:02:32.266683 17194 ts_tablet_manager.cc:1929] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.266754 17194 log.cc:1199] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/0d6cca70bc3c48bf9c2396fdfdb8e42c
I20251025 08:02:32.267282 17428 tablet.cc:1722] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.268712 17428 tablet.cc:1722] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:32.271198 17430 tablet.cc:1722] T 090117a75882489d84687e41b50616e9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.271431 16286 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_59553db1e7714c3b8a827e02fa059e1e" } new_table_name: "default.Table_400420f05a7a4b4b931b7009853a9f10" modify_external_catalogs: true
I20251025 08:02:32.273850 17194 ts_tablet_manager.cc:1950] T 0d6cca70bc3c48bf9c2396fdfdb8e42c P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.276846 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_f35d0fa958084bb9bb792e93fd367806"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.277139 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f35d0fa958084bb9bb792e93fd367806 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.278234 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_8065852bc26846929a54ba0b632cf16b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.278472 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8065852bc26846929a54ba0b632cf16b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.280642 14915 leader_election.cc:304] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:32.281191 17415 raft_consensus.cc:2749] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:32.281762 16285 master_service.cc:954] ReplaceTablet: received request to replace tablet 080d77feb2a242959fb8e375f07e5a5f from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.285079 17194 tablet_replica.cc:333] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.285213 17194 raft_consensus.cc:2243] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.285399 17194 raft_consensus.cc:2272] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.285626 17321 tablet.cc:1722] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20251025 08:02:32.285713 17194 ts_tablet_manager.cc:1916] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.287036 17321 tablet.cc:1722] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.287665 17194 ts_tablet_manager.cc:1929] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.287727 17194 log.cc:1199] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/d709ecb9ac9a4525985c7d2bf10719f5
I20251025 08:02:32.287979 17194 ts_tablet_manager.cc:1950] T d709ecb9ac9a4525985c7d2bf10719f5 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.288471 17194 tablet_replica.cc:333] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.288594 17194 raft_consensus.cc:2243] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.288676 17194 raft_consensus.cc:2272] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.288968 17194 ts_tablet_manager.cc:1916] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.289000 17321 tablet.cc:1722] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.290241 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c (table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]) successfully deleted
W20251025 08:02:32.290391 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet bcf414d04305456b80b2ec5dd8fb0ba7 because the tablet was not found. No further retry: Not found: Tablet not found: bcf414d04305456b80b2ec5dd8fb0ba7
I20251025 08:02:32.290518 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet d709ecb9ac9a4525985c7d2bf10719f5 (table default.Table_c6928dca846645b8887db36cc7cb9675 [id=9d1a6ae0121b45cda008d5dda6ea7e35]) successfully deleted
I20251025 08:02:32.292196 17194 ts_tablet_manager.cc:1929] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.292341 17194 log.cc:1199] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/2069ab40d30c4b8dab9d37c466522ac1
I20251025 08:02:32.292670 17194 ts_tablet_manager.cc:1950] T 2069ab40d30c4b8dab9d37c466522ac1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.293560 16390 tablet_bootstrap.cc:492] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.293569 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 2069ab40d30c4b8dab9d37c466522ac1 (table default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95]) successfully deleted
I20251025 08:02:32.293641 16390 ts_tablet_manager.cc:1403] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.108s user 0.001s sys 0.000s
W20251025 08:02:32.294082 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet e87bae31e5e642a5a34a8c170c62fdca because the tablet was not found. No further retry: Not found: Tablet not found: e87bae31e5e642a5a34a8c170c62fdca
I20251025 08:02:32.294099 16390 raft_consensus.cc:359] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.294195 16390 raft_consensus.cc:385] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.294234 16390 raft_consensus.cc:740] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.294344 16390 consensus_queue.cc:260] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.294656 16390 ts_tablet_manager.cc:1434] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.294831 16390 tablet_bootstrap.cc:492] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.295981 16390 tablet_bootstrap.cc:654] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.296707 17194 tablet_replica.cc:333] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.297128 17194 raft_consensus.cc:2243] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.298496 17194 raft_consensus.cc:2272] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.269335 17320 tablet.cc:1722] T fb4faadd4fc146a5af032ce815bd6cc4 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.270692 15049 leader_election.cc:304] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:32.298880 17426 tablet.cc:1722] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.299329 17390 raft_consensus.cc:2804] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.299423 17390 raft_consensus.cc:697] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:32.272174 17274 tablet_bootstrap.cc:492] T 77f04f445b5d47d2a78fdac0641a7372 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:32.299528 17274 ts_tablet_manager.cc:1403] T 77f04f445b5d47d2a78fdac0641a7372 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.067s user 0.000s sys 0.002s
I20251025 08:02:32.299546 17390 consensus_queue.cc:237] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.299909 17274 raft_consensus.cc:359] T 77f04f445b5d47d2a78fdac0641a7372 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.299996 17274 raft_consensus.cc:385] T 77f04f445b5d47d2a78fdac0641a7372 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.300035 17274 raft_consensus.cc:740] T 77f04f445b5d47d2a78fdac0641a7372 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.300133 17274 consensus_queue.cc:260] T 77f04f445b5d47d2a78fdac0641a7372 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.300403 17274 ts_tablet_manager.cc:1434] T 77f04f445b5d47d2a78fdac0641a7372 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:32.291414 15083 tablet_service.cc:1552] Processing DeleteTablet for tablet fbae08a3a1c34dfda60b1985346e7761 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.300289 17194 ts_tablet_manager.cc:1916] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.300642 17198 ts_tablet_manager.cc:1950] T 31c9e3906dac487e8585daa13d3fe4b1 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:32.301680 16391 tablet_bootstrap.cc:492] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.301774 16391 ts_tablet_manager.cc:1403] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.054s user 0.001s sys 0.001s
I20251025 08:02:32.301824 17274 tablet_bootstrap.cc:492] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:32.302218 16391 raft_consensus.cc:359] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.302300 16391 raft_consensus.cc:385] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.302325 16391 raft_consensus.cc:740] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.302412 16391 consensus_queue.cc:260] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.302623 16391 ts_tablet_manager.cc:1434] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.302747 16391 tablet_bootstrap.cc:492] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.302779 17274 tablet_bootstrap.cc:654] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.303520 16391 tablet_bootstrap.cc:654] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.305233 17194 ts_tablet_manager.cc:1929] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:32.305393 17194 log.cc:1199] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/e48ddcfccc1340d39d21ce94bec4bf27
I20251025 08:02:32.305744 17258 ts_tablet_manager.cc:1929] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:32.305841 17258 log.cc:1199] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/d162f3ee21bd40ce9a9c74b7863a3878
I20251025 08:02:32.305810 17194 ts_tablet_manager.cc:1950] T e48ddcfccc1340d39d21ce94bec4bf27 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.306098 17258 ts_tablet_manager.cc:1950] T d162f3ee21bd40ce9a9c74b7863a3878 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.306706 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet e48ddcfccc1340d39d21ce94bec4bf27 (table default.Table_52aa8e04fcc241078c3c06f3157a5e4b [id=c571a9bdb4d14249a27b401b9c02f644]) successfully deleted
I20251025 08:02:32.306815 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet d162f3ee21bd40ce9a9c74b7863a3878 (table default.Table_a6c6f65ea3444858aa562a65d71c4e77 [id=2ef2d72066f446619f9045da34df7814]) successfully deleted
I20251025 08:02:32.307008 17194 tablet_replica.cc:333] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.307039 17258 tablet_replica.cc:333] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.307139 16284 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_0d996ce6118b41598999853934f369f1" } modify_external_catalogs: true
I20251025 08:02:32.307197 17258 raft_consensus.cc:2243] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.307232 16284 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_0d996ce6118b41598999853934f369f1" } modify_external_catalogs: true
I20251025 08:02:32.307296 17258 raft_consensus.cc:2272] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.307291 17194 raft_consensus.cc:2243] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.307591 17258 ts_tablet_manager.cc:1916] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.308156 16286 master_service.cc:954] ReplaceTablet: received request to replace tablet 43da3f4fc9604562a95dff59da3c574b from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.308949 17198 tablet_replica.cc:333] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.309273 17258 ts_tablet_manager.cc:1929] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:32.309240 17198 raft_consensus.cc:2243] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.309410 17198 raft_consensus.cc:2272] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.310011 17198 ts_tablet_manager.cc:1916] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.311985 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 31c9e3906dac487e8585daa13d3fe4b1 (table default.Table_035df9ac9f6541dd9b042857523d0659 [id=2c373de1732c4d18ad45968e90a65608]) successfully deleted
W20251025 08:02:32.312165 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet e87bae31e5e642a5a34a8c170c62fdca because the tablet was not found. No further retry: Not found: Tablet not found: e87bae31e5e642a5a34a8c170c62fdca
W20251025 08:02:32.312350 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet bcf414d04305456b80b2ec5dd8fb0ba7 because the tablet was not found. No further retry: Not found: Tablet not found: bcf414d04305456b80b2ec5dd8fb0ba7
W20251025 08:02:32.312515 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 399d6b0459864b1586aa99948c56baea because the tablet was not found. No further retry: Not found: Tablet not found: 399d6b0459864b1586aa99948c56baea
W20251025 08:02:32.312685 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 2d16499315044408ad4bc1dca6341ed5 because the tablet was not found. No further retry: Not found: Tablet not found: 2d16499315044408ad4bc1dca6341ed5
I20251025 08:02:32.315491 16285 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 080d77feb2a242959fb8e375f07e5a5f
I20251025 08:02:32.316141 16285 catalog_manager.cc:6719] ReplaceTablet: tablet 080d77feb2a242959fb8e375f07e5a5f deleted and replaced by tablet 6d526e6cd8334742afea21ece24596ec
I20251025 08:02:32.316852 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 080d77feb2a242959fb8e375f07e5a5f with delete_type TABLET_DATA_DELETED (replaced by tablet 6d526e6cd8334742afea21ece24596ec) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.319373 16286 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 43da3f4fc9604562a95dff59da3c574b
I20251025 08:02:32.320116 16286 catalog_manager.cc:6719] ReplaceTablet: tablet 43da3f4fc9604562a95dff59da3c574b deleted and replaced by tablet 62db0ba07ab64d3691bac134d10db771
I20251025 08:02:32.320562 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 43da3f4fc9604562a95dff59da3c574b with delete_type TABLET_DATA_DELETED (replaced by tablet 62db0ba07ab64d3691bac134d10db771) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.321847 15083 tablet_service.cc:1552] Processing DeleteTablet for tablet 080d77feb2a242959fb8e375f07e5a5f with delete_type TABLET_DATA_DELETED (replaced by tablet 6d526e6cd8334742afea21ece24596ec) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.321985 15082 tablet_service.cc:1552] Processing DeleteTablet for tablet 43da3f4fc9604562a95dff59da3c574b with delete_type TABLET_DATA_DELETED (replaced by tablet 62db0ba07ab64d3691bac134d10db771) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.325958 15162 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:32.328269 16391 tablet_bootstrap.cc:492] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.328343 16391 ts_tablet_manager.cc:1403] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
W20251025 08:02:32.271274 15183 leader_election.cc:343] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.316643 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 080d77feb2a242959fb8e375f07e5a5f with delete_type TABLET_DATA_DELETED (replaced by tablet 6d526e6cd8334742afea21ece24596ec) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.320065 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 43da3f4fc9604562a95dff59da3c574b with delete_type TABLET_DATA_DELETED (replaced by tablet 62db0ba07ab64d3691bac134d10db771) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.327471 16390 tablet_bootstrap.cc:492] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.329615 16390 ts_tablet_manager.cc:1403] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.000s
W20251025 08:02:32.329646 15183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.70.1:35401, user_credentials={real_user=slave}} blocked reactor thread for 58372.1us
I20251025 08:02:32.329834 17274 tablet_bootstrap.cc:492] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
W20251025 08:02:32.329846 15183 leader_election.cc:343] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.329900 17274 ts_tablet_manager.cc:1403] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20251025 08:02:32.330096 16390 raft_consensus.cc:359] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:32.330111 15183 leader_election.cc:343] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.330221 16390 raft_consensus.cc:385] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.330256 16390 raft_consensus.cc:740] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
W20251025 08:02:32.330322 15183 leader_election.cc:343] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.330345 16390 consensus_queue.cc:260] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.330396 17274 raft_consensus.cc:359] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.330477 17274 raft_consensus.cc:385] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.330506 17274 raft_consensus.cc:740] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.330590 17274 consensus_queue.cc:260] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.330626 16390 ts_tablet_manager.cc:1434] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.330631 16286 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_43ee60a808814bf287008fd5a89bf0fe" } new_table_name: "default.Table_65442dc666594e129611ee817db7b2c0" modify_external_catalogs: true
I20251025 08:02:32.330775 16390 tablet_bootstrap.cc:492] T 82b93b7537c047aea430658ae2c2654b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.330734 15384 consensus_queue.cc:1048] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.330853 17274 ts_tablet_manager.cc:1434] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.331024 17274 tablet_bootstrap.cc:492] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:32.331491 15384 consensus_queue.cc:1048] T 174daf21bc41408d825ebe926af39c1b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.331724 16390 tablet_bootstrap.cc:654] T 82b93b7537c047aea430658ae2c2654b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.331888 17274 tablet_bootstrap.cc:654] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.331848 15384 consensus_queue.cc:1048] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.332482 17405 tablet.cc:1722] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:32.333344 16570 consensus_queue.cc:1048] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:32.337755 16286 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2be36d176bf34fb6bd3c70b42af15cc9 has no consensus state
I20251025 08:02:32.338903 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_47f9104a42ea4104828e1f8ecd279670"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.339231 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_47f9104a42ea4104828e1f8ecd279670 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.340569 16391 raft_consensus.cc:359] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.340662 16391 raft_consensus.cc:385] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.340703 16391 raft_consensus.cc:740] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.340782 16391 consensus_queue.cc:260] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.341030 16391 ts_tablet_manager.cc:1434] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.013s user 0.001s sys 0.000s
I20251025 08:02:32.340885 17194 raft_consensus.cc:2272] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.341169 16391 tablet_bootstrap.cc:492] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.342034 16391 tablet_bootstrap.cc:654] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.342469 17274 tablet_bootstrap.cc:492] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:32.342536 17274 ts_tablet_manager.cc:1403] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20251025 08:02:32.342720 16390 tablet_bootstrap.cc:492] T 82b93b7537c047aea430658ae2c2654b P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.342799 16390 ts_tablet_manager.cc:1403] T 82b93b7537c047aea430658ae2c2654b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.000s
I20251025 08:02:32.342965 17274 raft_consensus.cc:359] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.343057 17274 raft_consensus.cc:385] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.343087 17274 raft_consensus.cc:740] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.343179 17274 consensus_queue.cc:260] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.343219 16390 raft_consensus.cc:359] T 82b93b7537c047aea430658ae2c2654b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.343291 16390 raft_consensus.cc:385] T 82b93b7537c047aea430658ae2c2654b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.343318 16390 raft_consensus.cc:740] T 82b93b7537c047aea430658ae2c2654b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.343441 17274 ts_tablet_manager.cc:1434] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.343410 16390 consensus_queue.cc:260] T 82b93b7537c047aea430658ae2c2654b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.343598 17274 tablet_bootstrap.cc:492] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:32.343691 16390 ts_tablet_manager.cc:1434] T 82b93b7537c047aea430658ae2c2654b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.343818 16390 tablet_bootstrap.cc:492] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.344444 17274 tablet_bootstrap.cc:654] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.344688 16390 tablet_bootstrap.cc:654] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.345774 16285 master_service.cc:954] ReplaceTablet: received request to replace tablet d993e2350f37492bb712d145d03e8afb from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.346712 17415 raft_consensus.cc:493] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.346791 17415 raft_consensus.cc:515] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } }
I20251025 08:02:32.347082 17415 leader_election.cc:290] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.347399 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d81b65e094a34703ac47897d9bfa4c7c" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.347608 17389 raft_consensus.cc:493] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.347677 17389 raft_consensus.cc:515] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.347926 17389 leader_election.cc:290] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.348086 16286 master_service.cc:954] ReplaceTablet: received request to replace tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.348469 17194 ts_tablet_manager.cc:1916] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.351079 17198 ts_tablet_manager.cc:1929] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.351678 17198 log.cc:1199] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/f814b8ab1c9747e4b7da69f0ef4f2eb4
I20251025 08:02:32.354019 17198 ts_tablet_manager.cc:1950] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:32.354384 16391 tablet_bootstrap.cc:492] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.354456 16391 ts_tablet_manager.cc:1403] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20251025 08:02:32.354851 16391 raft_consensus.cc:359] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.354943 16391 raft_consensus.cc:385] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.354983 16391 raft_consensus.cc:740] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.355079 16391 consensus_queue.cc:260] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.355237 16285 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet d993e2350f37492bb712d145d03e8afb
I20251025 08:02:32.355352 16391 ts_tablet_manager.cc:1434] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:32.355499 16391 tablet_bootstrap.cc:492] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.355515 16285 catalog_manager.cc:6719] ReplaceTablet: tablet d993e2350f37492bb712d145d03e8afb deleted and replaced by tablet 00ecaed82db64f6f867f5db93e38180a
I20251025 08:02:32.355943 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet d993e2350f37492bb712d145d03e8afb with delete_type TABLET_DATA_DELETED (replaced by tablet 00ecaed82db64f6f867f5db93e38180a) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.356364 16391 tablet_bootstrap.cc:654] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.356431 17198 tablet_replica.cc:333] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.357151 15242 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8362e26d86d44e9780d3c78c6a468556" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.357245 15242 raft_consensus.cc:2468] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:32.357561 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet d993e2350f37492bb712d145d03e8afb with delete_type TABLET_DATA_DELETED (replaced by tablet 00ecaed82db64f6f867f5db93e38180a) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.357554 17198 raft_consensus.cc:2243] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.358503 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8362e26d86d44e9780d3c78c6a468556" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.358958 17198 raft_consensus.cc:2272] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.359449 15082 tablet_service.cc:1552] Processing DeleteTablet for tablet d993e2350f37492bb712d145d03e8afb with delete_type TABLET_DATA_DELETED (replaced by tablet 00ecaed82db64f6f867f5db93e38180a) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.360543 15108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d81b65e094a34703ac47897d9bfa4c7c" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.360690 15108 raft_consensus.cc:2393] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:32.360836 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 (table default.Table_9f939300bcf646508b4f05ea510f6679 [id=0db02c1368044d17ba62f03bf3aac5d2]) successfully deleted
W20251025 08:02:32.360946 15048 leader_election.cc:343] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.362762 17372 consensus_queue.cc:1048] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.363119 14970 raft_consensus.cc:3060] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.362468 17198 ts_tablet_manager.cc:1916] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.365744 14915 leader_election.cc:304] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:32.365795 17332 tablet.cc:1722] T 077ed236d1064a4d9a855bafabe0cdd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.365865 17415 raft_consensus.cc:2749] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:32.366220 17435 tablet.cc:1722] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:32.366657 17426 tablet.cc:1722] T 077ed236d1064a4d9a855bafabe0cdd7 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.368988 17194 ts_tablet_manager.cc:1929] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.369583 17194 log.cc:1199] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/bea55cdfbf454d76920806886c3d2c4e
I20251025 08:02:32.371920 16286 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8
I20251025 08:02:32.372189 16286 catalog_manager.cc:6719] ReplaceTablet: tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 deleted and replaced by tablet 9ecb15be5f5c48f1bd68e56b65543fad
I20251025 08:02:32.372721 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ecb15be5f5c48f1bd68e56b65543fad) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.372896 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ecb15be5f5c48f1bd68e56b65543fad) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.373329 17194 ts_tablet_manager.cc:1950] T bea55cdfbf454d76920806886c3d2c4e P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.376164 16391 tablet_bootstrap.cc:492] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.376238 16391 ts_tablet_manager.cc:1403] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.002s
I20251025 08:02:32.376694 16391 raft_consensus.cc:359] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.376782 16391 raft_consensus.cc:385] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.376816 16391 raft_consensus.cc:740] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.376912 17316 consensus_queue.cc:1048] T 4ff32cab636840bc86a54aa6c91e9456 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.376924 16391 consensus_queue.cc:260] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.377135 17316 consensus_queue.cc:1048] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.377213 16391 ts_tablet_manager.cc:1434] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:32.377363 16391 tablet_bootstrap.cc:492] T 878883a39db14b2dac25abacdc3dd0eb P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.381383 15082 tablet_service.cc:1552] Processing DeleteTablet for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ecb15be5f5c48f1bd68e56b65543fad) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.381513 15384 raft_consensus.cc:493] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.381582 15384 raft_consensus.cc:515] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.381760 16284 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet a40c5721a4304345b471960ed1691930
I20251025 08:02:32.381886 15384 leader_election.cc:290] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.381877 15049 leader_election.cc:304] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:32.382181 17389 raft_consensus.cc:2804] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.382261 17389 raft_consensus.cc:493] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.382314 17389 raft_consensus.cc:3060] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.382428 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet a40c5721a4304345b471960ed1691930 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.382817 16391 tablet_bootstrap.cc:654] T 878883a39db14b2dac25abacdc3dd0eb P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.383162 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet a40c5721a4304345b471960ed1691930 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.383285 17389 raft_consensus.cc:515] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.383631 17389 leader_election.cc:290] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.383641 14970 raft_consensus.cc:3060] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.383608 16284 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e0041c8cf73f46c5b49515b6f328f500" } new_table_name: "default.Table_e45046c48bb54111b38f009cc14efd2d" modify_external_catalogs: true
I20251025 08:02:32.384620 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d116fbec0c6149938b8f6c19af9607af" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.384723 15105 raft_consensus.cc:2468] T d116fbec0c6149938b8f6c19af9607af P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:32.385424 15185 leader_election.cc:304] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.385730 17373 raft_consensus.cc:2804] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.385772 17316 consensus_queue.cc:1048] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.385782 17373 raft_consensus.cc:493] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.385872 17373 raft_consensus.cc:3060] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.386772 17373 raft_consensus.cc:515] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.387063 17373 leader_election.cc:290] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.387346 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d116fbec0c6149938b8f6c19af9607af" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:32.387434 15114 raft_consensus.cc:3060] T d116fbec0c6149938b8f6c19af9607af P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.387698 17415 raft_consensus.cc:493] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.387765 17415 raft_consensus.cc:515] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.388057 17415 leader_election.cc:290] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.388284 15114 raft_consensus.cc:2468] T d116fbec0c6149938b8f6c19af9607af P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:32.388398 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "519f631918c144ff8edcfc7127ca23dc" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.388751 15185 leader_election.cc:304] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.388899 17372 raft_consensus.cc:2804] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.388973 17372 raft_consensus.cc:697] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:32.389091 17415 raft_consensus.cc:493] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.389093 17372 consensus_queue.cc:237] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.389191 17415 raft_consensus.cc:515] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.389493 17415 leader_election.cc:290] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.389792 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17339d7c0a4b40a78b3252d17481c192" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.391777 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet bea55cdfbf454d76920806886c3d2c4e (table default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]) successfully deleted
I20251025 08:02:32.391785 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8362e26d86d44e9780d3c78c6a468556" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:32.392033 15384 consensus_queue.cc:1048] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.392251 15082 tablet_service.cc:1552] Processing DeleteTablet for tablet a40c5721a4304345b471960ed1691930 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.392359 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "519f631918c144ff8edcfc7127ca23dc" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.392486 15105 raft_consensus.cc:2393] T 519f631918c144ff8edcfc7127ca23dc P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
W20251025 08:02:32.392804 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 399d6b0459864b1586aa99948c56baea because the tablet was not found. No further retry: Not found: Tablet not found: 399d6b0459864b1586aa99948c56baea
I20251025 08:02:32.393509 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "17339d7c0a4b40a78b3252d17481c192" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.393594 16391 tablet_bootstrap.cc:492] T 878883a39db14b2dac25abacdc3dd0eb P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.393662 16391 ts_tablet_manager.cc:1403] T 878883a39db14b2dac25abacdc3dd0eb P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.001s
W20251025 08:02:32.393989 15048 leader_election.cc:343] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.393615 17194 tablet_replica.cc:333] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.394637 16391 raft_consensus.cc:359] T 878883a39db14b2dac25abacdc3dd0eb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.394721 16391 raft_consensus.cc:385] T 878883a39db14b2dac25abacdc3dd0eb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.394752 16391 raft_consensus.cc:740] T 878883a39db14b2dac25abacdc3dd0eb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.394857 16391 consensus_queue.cc:260] T 878883a39db14b2dac25abacdc3dd0eb P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.395100 16391 ts_tablet_manager.cc:1434] T 878883a39db14b2dac25abacdc3dd0eb P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.395244 16391 tablet_bootstrap.cc:492] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.396245 16391 tablet_bootstrap.cc:654] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.397166 14915 leader_election.cc:304] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:32.397253 17194 raft_consensus.cc:2243] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.397334 17415 raft_consensus.cc:3060] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.397495 15384 consensus_queue.cc:1048] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.397797 14915 leader_election.cc:304] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:32.397975 15864 raft_consensus.cc:2749] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251025 08:02:32.398433 17415 raft_consensus.cc:2749] T 519f631918c144ff8edcfc7127ca23dc P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:32.398929 17258 log.cc:1199] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/ea0d438e99864c57999abf3467edc643
I20251025 08:02:32.399178 17258 ts_tablet_manager.cc:1950] T ea0d438e99864c57999abf3467edc643 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.399717 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet ea0d438e99864c57999abf3467edc643 (table default.Table_3c48d3160e5d42509de4f0be1af855e2 [id=912da5ef8bbf4af29528c084ea7fa633]) successfully deleted
I20251025 08:02:32.399267 17194 raft_consensus.cc:2272] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.399910 17258 tablet_replica.cc:333] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.400019 17258 raft_consensus.cc:2243] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.400189 17258 raft_consensus.cc:2272] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.400656 17258 ts_tablet_manager.cc:1916] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.402163 17194 ts_tablet_manager.cc:1916] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.405745 16279 catalog_manager.cc:5649] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:32.405990 16279 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet ce5ae591c86c4455a1dd3704f1c95d1c (table default.Table_9c7e0359120c415cba47b89251b0be94 [id=4510ebbcd6ee43babe7ee133a0ce6ae5]). Expected version 1 got 0
I20251025 08:02:32.406210 16279 catalog_manager.cc:5649] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:32.406453 16279 catalog_manager.cc:5649] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:32.406653 16279 catalog_manager.cc:5649] T f9ccba7de6874245bc0e1cdb8e8acfb1 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:32.407101 16279 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet f6082b299bb44d31b567f70d8da7f0ac (table default.Table_c5c036d7c66344eba94e15be432088bc [id=ebfa83131bd946d0897b32ef3c188c19]). Expected version 1 got 0
I20251025 08:02:32.407106 17198 ts_tablet_manager.cc:1929] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.408290 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet c043ab70d7364e05b0b352ac5c416db1
I20251025 08:02:32.407693 17198 log.cc:1199] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/6cedb44483cf4f62acf52b90b6708dfb
I20251025 08:02:32.408862 17332 tablet.cc:1722] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.409313 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8362e26d86d44e9780d3c78c6a468556" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:32.409421 15249 raft_consensus.cc:3060] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.409428 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet c043ab70d7364e05b0b352ac5c416db1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.409982 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet c043ab70d7364e05b0b352ac5c416db1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.410216 16286 master_service.cc:954] ReplaceTablet: received request to replace tablet 2069ab40d30c4b8dab9d37c466522ac1 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.410290 15249 raft_consensus.cc:2468] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:32.410764 17198 ts_tablet_manager.cc:1950] T 6cedb44483cf4f62acf52b90b6708dfb P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:32.411988 17390 raft_consensus.cc:493] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.412067 17390 raft_consensus.cc:515] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.412458 17390 leader_election.cc:290] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.413126 16391 tablet_bootstrap.cc:492] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.413295 16391 ts_tablet_manager.cc:1403] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.000s
I20251025 08:02:32.413751 16391 raft_consensus.cc:359] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.413847 16391 raft_consensus.cc:385] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.413883 16391 raft_consensus.cc:740] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.414016 16391 consensus_queue.cc:260] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.414345 16391 ts_tablet_manager.cc:1434] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:32.414498 16391 tablet_bootstrap.cc:492] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.415359 16391 tablet_bootstrap.cc:654] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.416705 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet b7bb3d7d89674b7e825868c17495bbb3 (table default.Table_c6928dca846645b8887db36cc7cb9675 [id=9d1a6ae0121b45cda008d5dda6ea7e35]). Expected version 1 got 0
I20251025 08:02:32.416805 17198 tablet_replica.cc:333] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.416908 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 1019d033e1f24ab596309462cbeb9c73 (table default.Table_5e5050bacd5543229399a2924609ae9c [id=4644ba57f12f4ad4bf7e89f80c4cd161]). Expected version 1 got 0
I20251025 08:02:32.417097 16282 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet e967a52212164b8cb6f9c39f207024a1 (table default.Table_434df4d622c74c6f89f7b7373096fb5f [id=0a4629613477421ba329364dbb42a8b6]). Expected version 1 got 0
I20251025 08:02:32.417441 16288 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 6d1979a4f43a4659976b0cd6d1b888ef
I20251025 08:02:32.418124 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 6d1979a4f43a4659976b0cd6d1b888ef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.418125 17198 raft_consensus.cc:2243] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.418572 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 6d1979a4f43a4659976b0cd6d1b888ef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.419275 17198 raft_consensus.cc:2272] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.420562 15384 raft_consensus.cc:493] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.420627 15384 raft_consensus.cc:515] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.421106 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77f04f445b5d47d2a78fdac0641a7372" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.421221 15112 raft_consensus.cc:2468] T 77f04f445b5d47d2a78fdac0641a7372 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:32.421459 15185 leader_election.cc:304] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.421593 17316 raft_consensus.cc:2804] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.421628 17316 raft_consensus.cc:493] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.421661 17316 raft_consensus.cc:3060] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.422488 17316 raft_consensus.cc:515] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.422748 17316 leader_election.cc:290] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.422842 17369 raft_consensus.cc:493] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.422911 17369 raft_consensus.cc:515] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.422688 17198 ts_tablet_manager.cc:1916] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.423206 17369 leader_election.cc:290] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.423513 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77f04f445b5d47d2a78fdac0641a7372" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:32.423561 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47b0f93bac664a44989534097be9fd73" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.423604 15105 raft_consensus.cc:3060] T 77f04f445b5d47d2a78fdac0641a7372 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.423650 15114 raft_consensus.cc:2468] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:32.424480 15105 raft_consensus.cc:2468] T 77f04f445b5d47d2a78fdac0641a7372 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:32.424250 17194 ts_tablet_manager.cc:1929] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.424522 15185 leader_election.cc:304] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.424672 17369 raft_consensus.cc:2804] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.424718 17369 raft_consensus.cc:493] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.424736 15185 leader_election.cc:304] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.424750 17369 raft_consensus.cc:3060] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.424597 17194 log.cc:1199] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/93d383e3e2f4493d9cc8a71a4284e107
I20251025 08:02:32.425063 17316 raft_consensus.cc:2804] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.425125 17316 raft_consensus.cc:697] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:32.425223 17316 consensus_queue.cc:237] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.425559 17369 raft_consensus.cc:515] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.425855 17369 leader_election.cc:290] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.426009 17332 tablet.cc:1722] T 454a76de5e2c421ab035e6cf1a958c11 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.427747 17405 tablet.cc:1722] T 454a76de5e2c421ab035e6cf1a958c11 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.427584 17194 ts_tablet_manager.cc:1950] T 93d383e3e2f4493d9cc8a71a4284e107 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.428009 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47b0f93bac664a44989534097be9fd73" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:32.428100 15105 raft_consensus.cc:3060] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.428104 15384 leader_election.cc:290] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:32.428843 15185 consensus_peers.cc:597] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f814b8ab1c9747e4b7da69f0ef4f2eb4. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:32.428840 15105 raft_consensus.cc:2468] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:32.429088 15185 leader_election.cc:304] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.429240 17316 raft_consensus.cc:2804] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.429308 17316 raft_consensus.cc:697] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:32.429394 17316 consensus_queue.cc:237] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.429675 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 93d383e3e2f4493d9cc8a71a4284e107 (table default.Table_0ac9d6fdd08b48f0b70da65d5f7a722a [id=7c9a46c4cada46ad916b89605c18190f]) successfully deleted
I20251025 08:02:32.430600 17194 tablet_replica.cc:333] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.431468 15049 leader_election.cc:304] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:32.431658 17390 raft_consensus.cc:2804] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.431718 17390 raft_consensus.cc:697] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:32.431821 17390 consensus_queue.cc:237] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.432004 17194 raft_consensus.cc:2243] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.433014 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47b0f93bac664a44989534097be9fd73" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.433187 17332 tablet.cc:1722] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:32.434283 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47b0f93bac664a44989534097be9fd73" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.434386 14976 raft_consensus.cc:2468] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:32.434715 15082 tablet_service.cc:1552] Processing DeleteTablet for tablet c043ab70d7364e05b0b352ac5c416db1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.434768 15048 leader_election.cc:304] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:32.434834 15083 tablet_service.cc:1552] Processing DeleteTablet for tablet 6d1979a4f43a4659976b0cd6d1b888ef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.434901 17389 raft_consensus.cc:2764] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251025 08:02:32.434933 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 6cedb44483cf4f62acf52b90b6708dfb (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]) successfully deleted
I20251025 08:02:32.437450 14972 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d116fbec0c6149938b8f6c19af9607af" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.437639 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d116fbec0c6149938b8f6c19af9607af" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:32.438009 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77f04f445b5d47d2a78fdac0641a7372" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.438081 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77f04f445b5d47d2a78fdac0641a7372" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:32.438298 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47b0f93bac664a44989534097be9fd73" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:32.438378 14974 raft_consensus.cc:3060] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.439152 16385 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet a40c5721a4304345b471960ed1691930
I20251025 08:02:32.439239 14974 raft_consensus.cc:2468] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:32.439311 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "47b0f93bac664a44989534097be9fd73" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.439405 14978 raft_consensus.cc:2376] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1. Re-sending same reply.
I20251025 08:02:32.439543 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet a40c5721a4304345b471960ed1691930 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.440073 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet a40c5721a4304345b471960ed1691930 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.440356 17194 raft_consensus.cc:2272] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.440621 16281 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_56b69a1e3b4d4e7dbaa6a4697a940880" } modify_external_catalogs: true
I20251025 08:02:32.440719 16281 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_56b69a1e3b4d4e7dbaa6a4697a940880" } modify_external_catalogs: true
I20251025 08:02:32.441943 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 16f1ab00a20345a1bb51e685b3fc6c70 (DEFAULT_TABLE table=default.Table_9419360c7ef742d196d6ac96f41241f1 [id=31777251b0174ff684a84b14f630d643]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.442292 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f1ab00a20345a1bb51e685b3fc6c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.444026 17194 ts_tablet_manager.cc:1916] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.445997 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 16f1ab00a20345a1bb51e685b3fc6c70 (DEFAULT_TABLE table=default.Table_9419360c7ef742d196d6ac96f41241f1 [id=31777251b0174ff684a84b14f630d643]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.446249 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f1ab00a20345a1bb51e685b3fc6c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.446435 16390 tablet_bootstrap.cc:492] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.446498 16390 ts_tablet_manager.cc:1403] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.103s user 0.001s sys 0.000s
I20251025 08:02:32.446875 16390 raft_consensus.cc:359] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.446951 16390 raft_consensus.cc:385] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.446977 16390 raft_consensus.cc:740] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.447055 16390 consensus_queue.cc:260] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.447561 16390 ts_tablet_manager.cc:1434] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.447707 16390 tablet_bootstrap.cc:492] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.448539 16390 tablet_bootstrap.cc:654] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.448702 17198 ts_tablet_manager.cc:1929] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.449213 14944 tablet_service.cc:1505] Processing CreateTablet for tablet dafad70d3f69440c9d42e8ee73123d2d (DEFAULT_TABLE table=default.Table_d7bd713b44f4437ea22edf08c629ecb3 [id=6eb223324e9942488e5a2461aa709a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.449446 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dafad70d3f69440c9d42e8ee73123d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.449440 17198 log.cc:1199] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/2069ab40d30c4b8dab9d37c466522ac1
I20251025 08:02:32.452190 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_3049e822186441f189fa1361f0f0224c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:32.452126 17198 ts_tablet_manager.cc:1950] T 2069ab40d30c4b8dab9d37c466522ac1 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
W20251025 08:02:32.452510 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3049e822186441f189fa1361f0f0224c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.455294 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_631837cf20584c788ca33f5d97ad28db"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.455595 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_631837cf20584c788ca33f5d97ad28db in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.455972 17258 ts_tablet_manager.cc:1929] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.456027 17258 log.cc:1199] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/212ccfb58f964d7bae31e5af110b4079
I20251025 08:02:32.456241 17258 ts_tablet_manager.cc:1950] T 212ccfb58f964d7bae31e5af110b4079 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.456744 17258 tablet_replica.cc:333] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.456743 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 212ccfb58f964d7bae31e5af110b4079 (table default.Table_ebce5278d348458e8ab930ddd6088775 [id=2de94631eeee41489ea858ed887de8c1]) successfully deleted
I20251025 08:02:32.456872 17258 raft_consensus.cc:2243] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.457018 17258 raft_consensus.cc:2272] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.457046 16283 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_bda70e09b01847069a68d129053e6b26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:32.457351 17258 ts_tablet_manager.cc:1916] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:32.457366 16283 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bda70e09b01847069a68d129053e6b26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.458009 15374 raft_consensus.cc:493] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.458081 15374 raft_consensus.cc:515] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.458113 17198 tablet_replica.cc:333] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.458431 15374 leader_election.cc:290] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.458936 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86b1873446154249a80fa67b99496545" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.461164 16281 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 997c8c5921ad4ec18914fd50c97fc33e
I20251025 08:02:32.462713 16281 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_b1d8db45b7d745a0b4dd9ff09300da89" } modify_external_catalogs: true
I20251025 08:02:32.462797 16281 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_b1d8db45b7d745a0b4dd9ff09300da89" } modify_external_catalogs: true
I20251025 08:02:32.463676 16391 tablet_bootstrap.cc:492] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.463747 16391 ts_tablet_manager.cc:1403] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.049s user 0.000s sys 0.002s
I20251025 08:02:32.463934 17198 raft_consensus.cc:2243] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.464116 17198 raft_consensus.cc:2272] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.464128 16391 raft_consensus.cc:359] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.464211 16391 raft_consensus.cc:385] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.464236 16391 raft_consensus.cc:740] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.464316 16391 consensus_queue.cc:260] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.464457 17198 ts_tablet_manager.cc:1916] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.464537 16391 ts_tablet_manager.cc:1434] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:32.464663 16391 tablet_bootstrap.cc:492] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.465408 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 997c8c5921ad4ec18914fd50c97fc33e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.465457 16391 tablet_bootstrap.cc:654] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.465535 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 997c8c5921ad4ec18914fd50c97fc33e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.466703 16285 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_67b66eb11d834963b9bfe650c7627ec3" } new_table_name: "default.Table_8d621c2f449e477ab01d1b67dc869408" modify_external_catalogs: true
I20251025 08:02:32.467172 16390 tablet_bootstrap.cc:492] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.467304 16390 ts_tablet_manager.cc:1403] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20251025 08:02:32.467710 16390 raft_consensus.cc:359] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.467839 16390 raft_consensus.cc:385] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.467900 16390 raft_consensus.cc:740] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.468043 16390 consensus_queue.cc:260] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.468314 16390 ts_tablet_manager.cc:1434] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.468484 16390 tablet_bootstrap.cc:492] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.468508 17194 ts_tablet_manager.cc:1929] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:32.468647 17194 log.cc:1199] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/d162f3ee21bd40ce9a9c74b7863a3878
I20251025 08:02:32.469137 17194 ts_tablet_manager.cc:1950] T d162f3ee21bd40ce9a9c74b7863a3878 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.469316 16390 tablet_bootstrap.cc:654] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.470155 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet d162f3ee21bd40ce9a9c74b7863a3878 (table default.Table_a6c6f65ea3444858aa562a65d71c4e77 [id=2ef2d72066f446619f9045da34df7814]) successfully deleted
I20251025 08:02:32.472064 17194 tablet_replica.cc:333] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.472182 17194 raft_consensus.cc:2243] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.472430 17198 ts_tablet_manager.cc:1929] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.472832 17198 log.cc:1199] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/14b47bf733754b72b34bd74aa033afa3
I20251025 08:02:32.472992 17194 raft_consensus.cc:2272] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.472982 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_7650f4b1f03949c5a77899e2ad5e1fe9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.473304 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7650f4b1f03949c5a77899e2ad5e1fe9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.473352 17194 ts_tablet_manager.cc:1916] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.474570 17198 ts_tablet_manager.cc:1950] T 14b47bf733754b72b34bd74aa033afa3 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:32.475133 17194 ts_tablet_manager.cc:1929] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:32.475194 17194 log.cc:1199] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/ea0d438e99864c57999abf3467edc643
I20251025 08:02:32.475418 17194 ts_tablet_manager.cc:1950] T ea0d438e99864c57999abf3467edc643 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.477890 17258 ts_tablet_manager.cc:1929] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.477939 17258 log.cc:1199] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/b41e092b7f40410a979bcfd5bbc7c225
I20251025 08:02:32.478139 17258 ts_tablet_manager.cc:1950] T b41e092b7f40410a979bcfd5bbc7c225 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.478680 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet b41e092b7f40410a979bcfd5bbc7c225 (table default.Table_e9a56ee98afd4b14bb77f82f256e8379 [id=7769118047914c3eb51e98a441aa5c50]) successfully deleted
I20251025 08:02:32.478689 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_b4260045775a4239b82e06034162a6f9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.479053 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4260045775a4239b82e06034162a6f9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.480093 15083 tablet_service.cc:1552] Processing DeleteTablet for tablet a40c5721a4304345b471960ed1691930 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.480345 15082 tablet_service.cc:1505] Processing CreateTablet for tablet 16f1ab00a20345a1bb51e685b3fc6c70 (DEFAULT_TABLE table=default.Table_9419360c7ef742d196d6ac96f41241f1 [id=31777251b0174ff684a84b14f630d643]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.480559 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16f1ab00a20345a1bb51e685b3fc6c70. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.481843 15083 tablet_service.cc:1552] Processing DeleteTablet for tablet 997c8c5921ad4ec18914fd50c97fc33e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.482064 14975 raft_consensus.cc:3060] T 878883a39db14b2dac25abacdc3dd0eb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.482748 16391 tablet_bootstrap.cc:492] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.482815 16391 ts_tablet_manager.cc:1403] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20251025 08:02:32.483250 16391 raft_consensus.cc:359] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.483338 16391 raft_consensus.cc:385] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.483371 16391 raft_consensus.cc:740] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.483475 16391 consensus_queue.cc:260] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:32.483681 16284 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d81b65e094a34703ac47897d9bfa4c7c consensus state has no leader
I20251025 08:02:32.483741 16391 ts_tablet_manager.cc:1434] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.483891 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_7fdb9c6661e241b6a185030c3593d5e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.484164 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fdb9c6661e241b6a185030c3593d5e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.484242 17258 tablet_replica.cc:333] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.484362 17258 raft_consensus.cc:2243] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.484462 17258 raft_consensus.cc:2272] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.484997 16390 tablet_bootstrap.cc:492] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.485096 16390 ts_tablet_manager.cc:1403] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20251025 08:02:32.485551 16390 raft_consensus.cc:359] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.485641 16390 raft_consensus.cc:385] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.485667 16390 raft_consensus.cc:740] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.485781 16390 consensus_queue.cc:260] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.486096 16279 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_c6928dca846645b8887db36cc7cb9675 [id=9d1a6ae0121b45cda008d5dda6ea7e35] alter complete (version 1)
I20251025 08:02:32.486137 16390 ts_tablet_manager.cc:1434] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.486330 16390 tablet_bootstrap.cc:492] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.487409 16390 tablet_bootstrap.cc:654] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.488227 16391 tablet_bootstrap.cc:492] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.489061 16391 tablet_bootstrap.cc:654] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.490599 17194 tablet_replica.cc:333] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.490662 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet ea0d438e99864c57999abf3467edc643 (table default.Table_3c48d3160e5d42509de4f0be1af855e2 [id=912da5ef8bbf4af29528c084ea7fa633]) successfully deleted
W20251025 08:02:32.490810 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 2d16499315044408ad4bc1dca6341ed5 because the tablet was not found. No further retry: Not found: Tablet not found: 2d16499315044408ad4bc1dca6341ed5
I20251025 08:02:32.490172 17258 ts_tablet_manager.cc:1916] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.491608 17194 raft_consensus.cc:2243] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.491745 17194 raft_consensus.cc:2272] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.491945 17198 tablet_replica.cc:333] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.492090 17194 ts_tablet_manager.cc:1916] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:32.492269 16285 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 88a76d187fae4f09ac879b72e9c05a86 consensus state has no leader
I20251025 08:02:32.492475 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_24ae0230ee3646e7a2d32c0e4a536dea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.492765 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24ae0230ee3646e7a2d32c0e4a536dea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.493672 15374 raft_consensus.cc:493] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.493738 15374 raft_consensus.cc:515] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.493990 15374 leader_election.cc:290] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.493844 17198 raft_consensus.cc:2243] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.494577 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "34c330b5dd544ae686f741cdd85d023d" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.495262 16390 tablet_bootstrap.cc:492] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.495383 16390 ts_tablet_manager.cc:1403] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251025 08:02:32.496104 16390 raft_consensus.cc:359] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.496251 16390 raft_consensus.cc:385] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.496335 16390 raft_consensus.cc:740] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.496474 16390 consensus_queue.cc:260] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.496783 16390 ts_tablet_manager.cc:1434] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.496978 16390 tablet_bootstrap.cc:492] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.496623 17198 raft_consensus.cc:2272] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.498085 16390 tablet_bootstrap.cc:654] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.498090 17194 ts_tablet_manager.cc:1929] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.498149 17194 log.cc:1199] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/14b47bf733754b72b34bd74aa033afa3
I20251025 08:02:32.498941 17198 ts_tablet_manager.cc:1916] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.501082 17389 consensus_queue.cc:1048] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.501727 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 14b47bf733754b72b34bd74aa033afa3 (table default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]) successfully deleted
I20251025 08:02:32.502305 17198 ts_tablet_manager.cc:1929] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.502496 17198 log.cc:1199] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/6dd0f695a2904df5b750b45782a21ce2
I20251025 08:02:32.502471 17415 raft_consensus.cc:493] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.505514 17415 raft_consensus.cc:515] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.505807 17415 leader_election.cc:290] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.506568 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c043ab70d7364e05b0b352ac5c416db1" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.506693 15240 raft_consensus.cc:2393] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:32.508258 17194 ts_tablet_manager.cc:1950] T 14b47bf733754b72b34bd74aa033afa3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.508615 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_ec80f327b59748efb9f7d1b60f08cd7c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.508899 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ec80f327b59748efb9f7d1b60f08cd7c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.509053 17194 tablet_replica.cc:333] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.509155 17194 raft_consensus.cc:2243] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.509162 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 14b47bf733754b72b34bd74aa033afa3 (table default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]) successfully deleted
I20251025 08:02:32.509234 17194 raft_consensus.cc:2272] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.509512 17194 ts_tablet_manager.cc:1916] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.511144 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_5f52465815d64efda49e01e13789088e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.511436 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f52465815d64efda49e01e13789088e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.512521 16284 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_a4db03b0afac4934abd7b889be3d9f30" } new_table_name: "default.Table_63d5e82b41854eab8d579c80fcdf9d6d" modify_external_catalogs: true
I20251025 08:02:32.512996 16391 tablet_bootstrap.cc:492] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.513065 16391 ts_tablet_manager.cc:1403] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.001s
I20251025 08:02:32.513434 16391 raft_consensus.cc:359] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.513510 16391 raft_consensus.cc:385] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.513536 16391 raft_consensus.cc:740] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.513628 16391 consensus_queue.cc:260] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.513852 16391 ts_tablet_manager.cc:1434] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:32.513983 16391 tablet_bootstrap.cc:492] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.514321 15212 tablet_service.cc:1505] Processing CreateTablet for tablet dafad70d3f69440c9d42e8ee73123d2d (DEFAULT_TABLE table=default.Table_d7bd713b44f4437ea22edf08c629ecb3 [id=6eb223324e9942488e5a2461aa709a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.514561 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dafad70d3f69440c9d42e8ee73123d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.515178 16391 tablet_bootstrap.cc:654] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.515419 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 29476b0bf2f34dcb913a665e3a008519 (DEFAULT_TABLE table=default.Table_325d514d7f504bf48182f9cab97df8b0 [id=61e8cabcdbab4f10926f4d82b9a638ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.515631 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29476b0bf2f34dcb913a665e3a008519. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.515684 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 29476b0bf2f34dcb913a665e3a008519 (DEFAULT_TABLE table=default.Table_325d514d7f504bf48182f9cab97df8b0 [id=61e8cabcdbab4f10926f4d82b9a638ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.516551 14952 tablet_service.cc:1505] Processing CreateTablet for tablet ff15c6e28a794271ac61ca111d66a06e (DEFAULT_TABLE table=default.Table_a76b5a9d0bcb445a93fc08720b6cf78d [id=63aad85eccbc4dcbb53817ea71427a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.516754 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff15c6e28a794271ac61ca111d66a06e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.518447 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29476b0bf2f34dcb913a665e3a008519. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.520231 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 1ddb3795876b486e992b58cea711afb3 (DEFAULT_TABLE table=default.Table_08013ca351ee49df9acad855462d7507 [id=8c00f3d93fc548109fc6a1893937d55b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.520417 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ddb3795876b486e992b58cea711afb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.520435 15214 tablet_service.cc:1505] Processing CreateTablet for tablet ff15c6e28a794271ac61ca111d66a06e (DEFAULT_TABLE table=default.Table_a76b5a9d0bcb445a93fc08720b6cf78d [id=63aad85eccbc4dcbb53817ea71427a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.520612 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff15c6e28a794271ac61ca111d66a06e. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:32.523039 15183 leader_election.cc:343] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.523772 17373 consensus_queue.cc:1048] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:32.524852 15183 leader_election.cc:343] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:32.525104 15183 leader_election.cc:343] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:32.525465 15183 leader_election.cc:343] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.527434 15082 tablet_service.cc:1505] Processing CreateTablet for tablet dafad70d3f69440c9d42e8ee73123d2d (DEFAULT_TABLE table=default.Table_d7bd713b44f4437ea22edf08c629ecb3 [id=6eb223324e9942488e5a2461aa709a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.527669 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dafad70d3f69440c9d42e8ee73123d2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.527783 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "34c330b5dd544ae686f741cdd85d023d" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.527987 15105 raft_consensus.cc:2393] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:32.528100 17258 ts_tablet_manager.cc:1929] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:32.528326 17258 log.cc:1199] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/fbae08a3a1c34dfda60b1985346e7761
I20251025 08:02:32.529618 15083 tablet_service.cc:1505] Processing CreateTablet for tablet 29476b0bf2f34dcb913a665e3a008519 (DEFAULT_TABLE table=default.Table_325d514d7f504bf48182f9cab97df8b0 [id=61e8cabcdbab4f10926f4d82b9a638ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.529767 15088 tablet_service.cc:1505] Processing CreateTablet for tablet ff15c6e28a794271ac61ca111d66a06e (DEFAULT_TABLE table=default.Table_a76b5a9d0bcb445a93fc08720b6cf78d [id=63aad85eccbc4dcbb53817ea71427a14]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.529839 15083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29476b0bf2f34dcb913a665e3a008519. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.529847 17258 ts_tablet_manager.cc:1950] T fbae08a3a1c34dfda60b1985346e7761 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.529927 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff15c6e28a794271ac61ca111d66a06e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.531975 15108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "86b1873446154249a80fa67b99496545" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.533077 17198 ts_tablet_manager.cc:1950] T 6dd0f695a2904df5b750b45782a21ce2 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:32.535238 17198 tablet_replica.cc:333] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.536659 14978 raft_consensus.cc:3060] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.536700 14975 raft_consensus.cc:3060] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.537549 16286 master_service.cc:954] ReplaceTablet: received request to replace tablet 60c49b70f8f44dd3aec433206b897843 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.537770 17426 tablet.cc:1722] T 454a76de5e2c421ab035e6cf1a958c11 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.538650 16286 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_14a3c11816aa4e2d93e0a9912024dbd2" } new_table_name: "default.Table_8c216cc6319243c4834215f42bebe51c" modify_external_catalogs: true
I20251025 08:02:32.539336 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet fbae08a3a1c34dfda60b1985346e7761 (table default.Table_a1c2dd3168ad45ffb213e55c47a2d0d3 [id=fb192136f9d9453a8d0aad2c1103118d]) successfully deleted
I20251025 08:02:32.539590 17258 tablet_replica.cc:333] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.539847 17258 raft_consensus.cc:2243] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.539994 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 6dd0f695a2904df5b750b45782a21ce2 (table default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]) successfully deleted
I20251025 08:02:32.540028 17258 raft_consensus.cc:2272] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.540879 17258 ts_tablet_manager.cc:1916] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.542778 16281 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 6c582efa6d334a06a48e2f2b94167776
I20251025 08:02:32.543887 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 6c582efa6d334a06a48e2f2b94167776 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.544585 16285 master_service.cc:954] ReplaceTablet: received request to replace tablet 658a20d894c5444a820ce6bd33e4fdf0 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.545418 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 6c582efa6d334a06a48e2f2b94167776 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.549166 16281 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_0a42fcc0637248fd9048c6d9d9e6055e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.549536 16281 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0a42fcc0637248fd9048c6d9d9e6055e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.550676 16279 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_a4851ecc90f640e9a09f6dd4c9b68f1e [id=bc094a879104430797416fd06811a2e3] alter complete (version 1)
I20251025 08:02:32.552083 17194 ts_tablet_manager.cc:1929] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.540170 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c043ab70d7364e05b0b352ac5c416db1" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.536260 17198 raft_consensus.cc:2243] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.553016 17194 log.cc:1199] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/e762c440cb0947deb7e6a4186deebdc1
I20251025 08:02:32.553316 17194 ts_tablet_manager.cc:1950] T e762c440cb0947deb7e6a4186deebdc1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.554714 17194 tablet_replica.cc:333] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.554797 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet e762c440cb0947deb7e6a4186deebdc1 (table default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]) successfully deleted
I20251025 08:02:32.555874 15083 tablet_service.cc:1552] Processing DeleteTablet for tablet 6c582efa6d334a06a48e2f2b94167776 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.562605 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 1ddb3795876b486e992b58cea711afb3 (DEFAULT_TABLE table=default.Table_08013ca351ee49df9acad855462d7507 [id=8c00f3d93fc548109fc6a1893937d55b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.562873 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ddb3795876b486e992b58cea711afb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.565235 16287 master_service.cc:954] ReplaceTablet: received request to replace tablet fc5f892ca7a246a28a556fe0eb3f5442 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.555131 16391 tablet_bootstrap.cc:492] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.565501 16391 ts_tablet_manager.cc:1403] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.052s user 0.002s sys 0.000s
I20251025 08:02:32.565902 16391 raft_consensus.cc:359] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.565977 16391 raft_consensus.cc:385] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.566001 16391 raft_consensus.cc:740] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.566077 16391 consensus_queue.cc:260] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.566335 16391 ts_tablet_manager.cc:1434] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.566550 15083 tablet_service.cc:1505] Processing CreateTablet for tablet 1ddb3795876b486e992b58cea711afb3 (DEFAULT_TABLE table=default.Table_08013ca351ee49df9acad855462d7507 [id=8c00f3d93fc548109fc6a1893937d55b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.566741 15083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ddb3795876b486e992b58cea711afb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.568413 17390 raft_consensus.cc:493] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.568472 17390 raft_consensus.cc:515] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.568719 17390 leader_election.cc:290] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.569630 16391 tablet_bootstrap.cc:492] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.570794 16391 tablet_bootstrap.cc:654] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.572954 17194 raft_consensus.cc:2243] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.574752 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82b93b7537c047aea430658ae2c2654b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:32.575332 15048 leader_election.cc:343] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.575695 14977 raft_consensus.cc:3060] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.574841 17194 raft_consensus.cc:2272] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.576345 17194 ts_tablet_manager.cc:1916] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.576572 14952 tablet_service.cc:1505] Processing CreateTablet for tablet fc485ee4814142cda9be0d937aaa5dc1 (DEFAULT_TABLE table=default.Table_b6d6ebb6a2ec45c5b4ff41770356102c [id=83fb26d8a404409c8f7bf016039f5c6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.576810 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc485ee4814142cda9be0d937aaa5dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.561554 14915 leader_election.cc:304] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:32.579505 17043 raft_consensus.cc:3060] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.580382 17043 raft_consensus.cc:2749] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:32.580746 14915 leader_election.cc:304] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:32.580969 17043 raft_consensus.cc:2749] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:32.581532 17198 raft_consensus.cc:2272] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.581249 14915 leader_election.cc:304] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:32.581665 17043 raft_consensus.cc:3060] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.581967 17198 ts_tablet_manager.cc:1916] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.582015 17194 ts_tablet_manager.cc:1929] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.582070 17194 log.cc:1199] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/f814b8ab1c9747e4b7da69f0ef4f2eb4
I20251025 08:02:32.582327 17194 ts_tablet_manager.cc:1950] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.582471 17043 raft_consensus.cc:2749] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:32.582926 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 (table default.Table_9f939300bcf646508b4f05ea510f6679 [id=0db02c1368044d17ba62f03bf3aac5d2]) successfully deleted
I20251025 08:02:32.584118 16391 tablet_bootstrap.cc:492] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.584209 16391 ts_tablet_manager.cc:1403] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
I20251025 08:02:32.584586 16391 raft_consensus.cc:359] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.584664 16391 raft_consensus.cc:385] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.584688 16391 raft_consensus.cc:740] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.584780 16391 consensus_queue.cc:260] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.584777 17198 ts_tablet_manager.cc:1929] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.584882 17198 log.cc:1199] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/bea55cdfbf454d76920806886c3d2c4e
I20251025 08:02:32.585021 16391 ts_tablet_manager.cc:1434] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:32.585157 16391 tablet_bootstrap.cc:492] T 56ef6eeb5739448ebeb42d0de38512a7 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.585297 17198 ts_tablet_manager.cc:1950] T bea55cdfbf454d76920806886c3d2c4e P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:32.585997 16391 tablet_bootstrap.cc:654] T 56ef6eeb5739448ebeb42d0de38512a7 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.586109 17198 tablet_replica.cc:333] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.586220 16390 tablet_bootstrap.cc:492] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.586302 16390 ts_tablet_manager.cc:1403] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.089s user 0.000s sys 0.001s
I20251025 08:02:32.586356 17198 raft_consensus.cc:2243] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.586651 17043 raft_consensus.cc:493] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.586719 17274 tablet_bootstrap.cc:492] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:32.586725 17043 raft_consensus.cc:515] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.586727 16390 raft_consensus.cc:359] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.586797 17274 ts_tablet_manager.cc:1403] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.243s user 0.001s sys 0.000s
I20251025 08:02:32.586813 16390 raft_consensus.cc:385] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.586843 16390 raft_consensus.cc:740] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.586956 16390 consensus_queue.cc:260] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.587047 17043 leader_election.cc:290] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.587241 16390 ts_tablet_manager.cc:1434] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:32.587260 17274 raft_consensus.cc:359] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.587344 17274 raft_consensus.cc:385] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.587370 17274 raft_consensus.cc:740] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.587435 16390 tablet_bootstrap.cc:492] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.587477 17274 consensus_queue.cc:260] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.587683 17274 ts_tablet_manager.cc:1434] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.587877 17274 tablet_bootstrap.cc:492] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:32.588174 16390 tablet_bootstrap.cc:654] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.588150 17258 ts_tablet_manager.cc:1929] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.588248 17258 log.cc:1199] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/080d77feb2a242959fb8e375f07e5a5f
I20251025 08:02:32.588688 17258 ts_tablet_manager.cc:1950] T 080d77feb2a242959fb8e375f07e5a5f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.588886 17274 tablet_bootstrap.cc:654] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.589205 16570 raft_consensus.cc:493] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.589282 16570 raft_consensus.cc:515] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.589612 16570 leader_election.cc:290] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.590458 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6082b299bb44d31b567f70d8da7f0ac" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.590463 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 080d77feb2a242959fb8e375f07e5a5f (table default.Table_4c672efab2bb448ab1dcfd4325e8c053 [id=0db3af0dc90e4ea5ac9a029e3864ce58]) successfully deleted
I20251025 08:02:32.590756 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84d6bed24444dcfab1920efad849932" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.591006 17258 tablet_replica.cc:333] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.591269 17258 raft_consensus.cc:2243] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
W20251025 08:02:32.591444 15185 leader_election.cc:343] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.591497 17258 raft_consensus.cc:2272] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.592077 17258 ts_tablet_manager.cc:1916] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.592679 16391 tablet_bootstrap.cc:492] T 56ef6eeb5739448ebeb42d0de38512a7 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.592753 16391 ts_tablet_manager.cc:1403] T 56ef6eeb5739448ebeb42d0de38512a7 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.001s
I20251025 08:02:32.593140 16391 raft_consensus.cc:359] T 56ef6eeb5739448ebeb42d0de38512a7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.593250 16391 raft_consensus.cc:385] T 56ef6eeb5739448ebeb42d0de38512a7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.593286 16391 raft_consensus.cc:740] T 56ef6eeb5739448ebeb42d0de38512a7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.593420 16391 consensus_queue.cc:260] T 56ef6eeb5739448ebeb42d0de38512a7 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.593768 16391 ts_tablet_manager.cc:1434] T 56ef6eeb5739448ebeb42d0de38512a7 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:32.593920 16391 tablet_bootstrap.cc:492] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:32.594692 14914 consensus_peers.cc:597] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 080d77feb2a242959fb8e375f07e5a5f. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:32.594864 16391 tablet_bootstrap.cc:654] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.595289 15212 tablet_service.cc:1505] Processing CreateTablet for tablet fc485ee4814142cda9be0d937aaa5dc1 (DEFAULT_TABLE table=default.Table_b6d6ebb6a2ec45c5b4ff41770356102c [id=83fb26d8a404409c8f7bf016039f5c6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.595570 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc485ee4814142cda9be0d937aaa5dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.597159 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 07b76abb029e4555851dfdc73ab31a38 (DEFAULT_TABLE table=default.Table_4c7bc0e29c4d40a2956a7b86660de862 [id=06dd7d49a04c446bb64afe782859059e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.597431 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b76abb029e4555851dfdc73ab31a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.600123 16288 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_5bc70f62257c438bb0c52926674f2bdf" } modify_external_catalogs: true
I20251025 08:02:32.600235 16288 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_5bc70f62257c438bb0c52926674f2bdf" } modify_external_catalogs: true
W20251025 08:02:32.602514 17249 log.cc:927] Time spent T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Append to log took a long time: real 0.050s user 0.000s sys 0.000s
I20251025 08:02:32.603965 16390 tablet_bootstrap.cc:492] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.604048 16390 ts_tablet_manager.cc:1403] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.000s
I20251025 08:02:32.604473 16390 raft_consensus.cc:359] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.604573 16390 raft_consensus.cc:385] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.604615 16390 raft_consensus.cc:740] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.604730 16390 consensus_queue.cc:260] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.605033 16390 ts_tablet_manager.cc:1434] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:32.605188 16390 tablet_bootstrap.cc:492] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.606048 16390 tablet_bootstrap.cc:654] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.607929 16570 raft_consensus.cc:493] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.608019 16570 raft_consensus.cc:515] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.608311 16570 leader_election.cc:290] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.608841 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56ef6eeb5739448ebeb42d0de38512a7" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.608950 15105 raft_consensus.cc:2468] T 56ef6eeb5739448ebeb42d0de38512a7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:32.609486 15185 leader_election.cc:304] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.609618 15384 raft_consensus.cc:2804] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.609658 15384 raft_consensus.cc:493] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.609689 15384 raft_consensus.cc:3060] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.610512 15384 raft_consensus.cc:515] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.610795 15384 leader_election.cc:290] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.611653 17393 consensus_queue.cc:1048] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.612751 15083 tablet_service.cc:1505] Processing CreateTablet for tablet fc485ee4814142cda9be0d937aaa5dc1 (DEFAULT_TABLE table=default.Table_b6d6ebb6a2ec45c5b4ff41770356102c [id=83fb26d8a404409c8f7bf016039f5c6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.612950 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet bea55cdfbf454d76920806886c3d2c4e (table default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]) successfully deleted
W20251025 08:02:32.613102 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 446194cf013c4b6499deb00fab8db42a because the tablet was not found. No further retry: Not found: Tablet not found: 446194cf013c4b6499deb00fab8db42a
I20251025 08:02:32.613449 15083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc485ee4814142cda9be0d937aaa5dc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.613663 16284 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e7ff1f77ca4f48b2afa289c6672bcafd" } modify_external_catalogs: true
I20251025 08:02:32.613751 16284 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e7ff1f77ca4f48b2afa289c6672bcafd" } modify_external_catalogs: true
I20251025 08:02:32.614537 16570 raft_consensus.cc:493] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.614619 16570 raft_consensus.cc:515] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.614881 16570 leader_election.cc:290] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.615568 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 07b76abb029e4555851dfdc73ab31a38 (DEFAULT_TABLE table=default.Table_4c7bc0e29c4d40a2956a7b86660de862 [id=06dd7d49a04c446bb64afe782859059e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.615765 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b76abb029e4555851dfdc73ab31a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.615834 14952 tablet_service.cc:1505] Processing CreateTablet for tablet a40c5721a4304345b471960ed1691930 (DEFAULT_TABLE table=default.Table_0d996ce6118b41598999853934f369f1 [id=82a8474566dd4ee99395f3220c214476]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.616053 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40c5721a4304345b471960ed1691930. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.619324 16283 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_1acaea81b51b4fe48d3777375cde2fff" } modify_external_catalogs: true
I20251025 08:02:32.619424 16283 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_1acaea81b51b4fe48d3777375cde2fff" } modify_external_catalogs: true
I20251025 08:02:32.620321 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56ef6eeb5739448ebeb42d0de38512a7" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:32.620386 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5e907ec8e7c420d8d6d68a954cc8beb" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.620414 15109 raft_consensus.cc:3060] T 56ef6eeb5739448ebeb42d0de38512a7 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.621259 15109 raft_consensus.cc:2468] T 56ef6eeb5739448ebeb42d0de38512a7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:32.624866 16286 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_90a6f70e509d406597d257083a3d3a6a" } new_table_name: "default.Table_258c905a78d94ba197752a61781fa019" modify_external_catalogs: true
I20251025 08:02:32.627274 17274 tablet_bootstrap.cc:492] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:32.627353 17274 ts_tablet_manager.cc:1403] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.040s user 0.002s sys 0.000s
I20251025 08:02:32.627740 17274 raft_consensus.cc:359] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.627820 17274 raft_consensus.cc:385] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.627849 17274 raft_consensus.cc:740] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.627933 17274 consensus_queue.cc:260] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.628096 17194 tablet_replica.cc:333] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.628223 17194 raft_consensus.cc:2243] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.628293 17274 ts_tablet_manager.cc:1434] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.628449 17274 tablet_bootstrap.cc:492] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:32.628873 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84d6bed24444dcfab1920efad849932" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.629748 17274 tablet_bootstrap.cc:654] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.630820 15083 tablet_service.cc:1505] Processing CreateTablet for tablet 07b76abb029e4555851dfdc73ab31a38 (DEFAULT_TABLE table=default.Table_4c7bc0e29c4d40a2956a7b86660de862 [id=06dd7d49a04c446bb64afe782859059e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.631062 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f6082b299bb44d31b567f70d8da7f0ac" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.632025 15083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07b76abb029e4555851dfdc73ab31a38. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.633610 16572 consensus_queue.cc:1048] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:32.634496 15185 leader_election.cc:343] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.634595 15185 leader_election.cc:304] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.635326 16570 raft_consensus.cc:2804] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.635414 16570 raft_consensus.cc:697] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:32.635535 16570 consensus_queue.cc:237] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.637998 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82b93b7537c047aea430658ae2c2654b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.638103 15239 raft_consensus.cc:2468] T 82b93b7537c047aea430658ae2c2654b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:32.639147 17258 ts_tablet_manager.cc:1929] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:32.639822 17258 log.cc:1199] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/43da3f4fc9604562a95dff59da3c574b
I20251025 08:02:32.641944 15049 leader_election.cc:304] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:32.642115 17393 raft_consensus.cc:2804] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.642170 17393 raft_consensus.cc:493] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.642232 17393 raft_consensus.cc:3060] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.642347 15497 consensus_queue.cc:1048] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.643095 17393 raft_consensus.cc:515] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.643440 17393 leader_election.cc:290] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.641929 17389 consensus_queue.cc:1048] T 878883a39db14b2dac25abacdc3dd0eb P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.644043 15214 tablet_service.cc:1505] Processing CreateTablet for tablet 98baf6e8d8e84b42a83054495ae19e01 (DEFAULT_TABLE table=default.Table_e7ff1f77ca4f48b2afa289c6672bcafd [id=a63322e79f4d47599afcfe64edd3a86c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.644277 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98baf6e8d8e84b42a83054495ae19e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.630653 17194 raft_consensus.cc:2272] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.645709 14943 tablet_service.cc:1505] Processing CreateTablet for tablet 88a76d187fae4f09ac879b72e9c05a86 (DEFAULT_TABLE table=default.Table_8d621c2f449e477ab01d1b67dc869408 [id=d318bca8bf144870aa5529426cfa9995]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.646070 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a76d187fae4f09ac879b72e9c05a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.646243 14944 tablet_service.cc:1505] Processing CreateTablet for tablet adb2c77ec9b84fe8846084cddc23888a (DEFAULT_TABLE table=default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.646299 17194 ts_tablet_manager.cc:1916] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.646458 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb2c77ec9b84fe8846084cddc23888a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.646890 14915 leader_election.cc:304] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:32.647040 17043 raft_consensus.cc:2749] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251025 08:02:32.647572 14970 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56ef6eeb5739448ebeb42d0de38512a7" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.647678 14970 raft_consensus.cc:2468] T 56ef6eeb5739448ebeb42d0de38512a7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:32.647814 14975 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "56ef6eeb5739448ebeb42d0de38512a7" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:32.647891 14975 raft_consensus.cc:3060] T 56ef6eeb5739448ebeb42d0de38512a7 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.648432 15225 tablet_service.cc:1505] Processing CreateTablet for tablet adb2c77ec9b84fe8846084cddc23888a (DEFAULT_TABLE table=default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.648660 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb2c77ec9b84fe8846084cddc23888a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.648670 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 98baf6e8d8e84b42a83054495ae19e01 (DEFAULT_TABLE table=default.Table_e7ff1f77ca4f48b2afa289c6672bcafd [id=a63322e79f4d47599afcfe64edd3a86c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.648759 14975 raft_consensus.cc:2468] T 56ef6eeb5739448ebeb42d0de38512a7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:32.647605 14972 raft_consensus.cc:3060] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.648872 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98baf6e8d8e84b42a83054495ae19e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.650022 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5e907ec8e7c420d8d6d68a954cc8beb" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:32.650094 14914 consensus_peers.cc:597] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbae08a3a1c34dfda60b1985346e7761. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:32.650256 14970 raft_consensus.cc:3060] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.652294 15212 tablet_service.cc:1505] Processing CreateTablet for tablet a40c5721a4304345b471960ed1691930 (DEFAULT_TABLE table=default.Table_0d996ce6118b41598999853934f369f1 [id=82a8474566dd4ee99395f3220c214476]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.652617 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40c5721a4304345b471960ed1691930. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.655612 17258 ts_tablet_manager.cc:1950] T 43da3f4fc9604562a95dff59da3c574b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.656167 17194 ts_tablet_manager.cc:1929] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.656281 17194 log.cc:1199] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/6cedb44483cf4f62acf52b90b6708dfb
I20251025 08:02:32.656587 17194 ts_tablet_manager.cc:1950] T 6cedb44483cf4f62acf52b90b6708dfb P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.657183 17194 tablet_replica.cc:333] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.657286 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 6cedb44483cf4f62acf52b90b6708dfb (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]) successfully deleted
I20251025 08:02:32.657354 17194 raft_consensus.cc:2243] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.657438 17194 raft_consensus.cc:2272] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.657734 17194 ts_tablet_manager.cc:1916] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.659417 17194 ts_tablet_manager.cc:1929] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.660920 15642 raft_consensus.cc:493] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.661008 15642 raft_consensus.cc:515] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.661367 15642 leader_election.cc:290] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.661317 17405 tablet.cc:1722] T 077ed236d1064a4d9a855bafabe0cdd7 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.661893 15083 tablet_service.cc:1505] Processing CreateTablet for tablet a40c5721a4304345b471960ed1691930 (DEFAULT_TABLE table=default.Table_0d996ce6118b41598999853934f369f1 [id=82a8474566dd4ee99395f3220c214476]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.661945 15082 tablet_service.cc:1505] Processing CreateTablet for tablet adb2c77ec9b84fe8846084cddc23888a (DEFAULT_TABLE table=default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.662161 15083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40c5721a4304345b471960ed1691930. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.662201 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 98baf6e8d8e84b42a83054495ae19e01 (DEFAULT_TABLE table=default.Table_e7ff1f77ca4f48b2afa289c6672bcafd [id=a63322e79f4d47599afcfe64edd3a86c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.662509 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98baf6e8d8e84b42a83054495ae19e01. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.664188 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adb2c77ec9b84fe8846084cddc23888a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.664265 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 43da3f4fc9604562a95dff59da3c574b (table default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031]) successfully deleted
I20251025 08:02:32.664208 17258 tablet_replica.cc:333] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.665262 17258 raft_consensus.cc:2243] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.666162 17258 raft_consensus.cc:2272] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.586767 17198 raft_consensus.cc:2272] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.667843 17198 ts_tablet_manager.cc:1916] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.670903 17258 ts_tablet_manager.cc:1916] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.674016 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 88a76d187fae4f09ac879b72e9c05a86 (DEFAULT_TABLE table=default.Table_8d621c2f449e477ab01d1b67dc869408 [id=d318bca8bf144870aa5529426cfa9995]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.674126 16390 tablet_bootstrap.cc:492] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.674414 16390 ts_tablet_manager.cc:1403] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.069s user 0.000s sys 0.002s
I20251025 08:02:32.674510 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a76d187fae4f09ac879b72e9c05a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.674844 16390 raft_consensus.cc:359] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.674925 16390 raft_consensus.cc:385] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.674976 16390 raft_consensus.cc:740] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.675086 16390 consensus_queue.cc:260] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.675333 16390 ts_tablet_manager.cc:1434] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:32.675467 16390 tablet_bootstrap.cc:492] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.675424 15225 tablet_service.cc:1505] Processing CreateTablet for tablet cfe93efc1a0c4dda95b5c2e58cdcec82 (DEFAULT_TABLE table=default.Table_cce271e6706043dabfbd2c4b55bf198b [id=3a6e3a35c29b486b9ed32bc6fe1ec042]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.675653 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe93efc1a0c4dda95b5c2e58cdcec82. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.676290 16390 tablet_bootstrap.cc:654] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.677960 15214 tablet_service.cc:1505] Processing CreateTablet for tablet 2be36d176bf34fb6bd3c70b42af15cc9 (DEFAULT_TABLE table=default.Table_65442dc666594e129611ee817db7b2c0 [id=de277558d55a46519b3c1e18c51f18fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.678216 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be36d176bf34fb6bd3c70b42af15cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.680109 15224 tablet_service.cc:1505] Processing CreateTablet for tablet be8d6685c70c4219947df30f023a59b8 (DEFAULT_TABLE table=default.Table_165ff894c5ab455e8daf5d1cf318b785 [id=325e0a7553e840c58179c04253e874dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.680331 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be8d6685c70c4219947df30f023a59b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.680539 15225 tablet_service.cc:1505] Processing CreateTablet for tablet acb84bad2f75474faecd00432d187ccf (DEFAULT_TABLE table=default.Table_9985b6eb72284cb583313ce952774b40 [id=3f5c8992a5e44e0d960303db92eb62be]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.680722 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb84bad2f75474faecd00432d187ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.660828 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82b93b7537c047aea430658ae2c2654b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:32.683459 17194 log.cc:1199] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/cfe9add2f8bf450bb6f49ad57be2caae
I20251025 08:02:32.662587 14971 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5f72ca8cfb94178a21619ddc9fc0352" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.683739 17194 ts_tablet_manager.cc:1950] T cfe9add2f8bf450bb6f49ad57be2caae P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.686308 16390 tablet_bootstrap.cc:492] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.686373 16390 ts_tablet_manager.cc:1403] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.002s
I20251025 08:02:32.686715 16390 raft_consensus.cc:359] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.686789 16390 raft_consensus.cc:385] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.686815 16390 raft_consensus.cc:740] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.686902 16390 consensus_queue.cc:260] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.687129 16390 ts_tablet_manager.cc:1434] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:32.687260 16390 tablet_bootstrap.cc:492] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.688367 17274 tablet_bootstrap.cc:492] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:32.688459 17274 ts_tablet_manager.cc:1403] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.060s user 0.001s sys 0.000s
I20251025 08:02:32.688899 17274 raft_consensus.cc:359] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.689008 17274 raft_consensus.cc:385] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.689043 17274 raft_consensus.cc:740] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.689148 17274 consensus_queue.cc:260] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.689406 17274 ts_tablet_manager.cc:1434] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.689569 17274 tablet_bootstrap.cc:492] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:32.689850 16390 tablet_bootstrap.cc:654] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.690500 17274 tablet_bootstrap.cc:654] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.690845 16390 tablet_bootstrap.cc:492] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.690950 16390 ts_tablet_manager.cc:1403] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20251025 08:02:32.691308 16390 raft_consensus.cc:359] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.691431 16390 raft_consensus.cc:385] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.691480 16390 raft_consensus.cc:740] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.691634 16390 consensus_queue.cc:260] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.691901 16390 ts_tablet_manager.cc:1434] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:32.692077 16390 tablet_bootstrap.cc:492] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.692760 16390 tablet_bootstrap.cc:654] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.695178 17258 ts_tablet_manager.cc:1929] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.695467 17405 tablet.cc:1722] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.696588 15384 consensus_queue.cc:1048] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.701637 17258 log.cc:1199] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/d993e2350f37492bb712d145d03e8afb
I20251025 08:02:32.701817 16279 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_22425928df99434c8c133707c8a809ef [id=79c76995e71143438cb6e30a9df85c31] alter complete (version 1)
I20251025 08:02:32.702093 17258 ts_tablet_manager.cc:1950] T d993e2350f37492bb712d145d03e8afb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.702281 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet cfe9add2f8bf450bb6f49ad57be2caae (table default.Table_035b154aa0234ef38415962cb9359b93 [id=184e7b89a0ad431f87984b6d6619058e]) successfully deleted
I20251025 08:02:32.702863 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet d993e2350f37492bb712d145d03e8afb (table default.Table_1ccbe630ac5a41ecb7b00087172bec38 [id=1e716be545914b22887b2f7e069c41c4]) successfully deleted
I20251025 08:02:32.677778 14943 tablet_service.cc:1505] Processing CreateTablet for tablet acb84bad2f75474faecd00432d187ccf (DEFAULT_TABLE table=default.Table_9985b6eb72284cb583313ce952774b40 [id=3f5c8992a5e44e0d960303db92eb62be]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.703217 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb84bad2f75474faecd00432d187ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.704161 17194 tablet_replica.cc:333] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.677726 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 2be36d176bf34fb6bd3c70b42af15cc9 (DEFAULT_TABLE table=default.Table_65442dc666594e129611ee817db7b2c0 [id=de277558d55a46519b3c1e18c51f18fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.705396 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be36d176bf34fb6bd3c70b42af15cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.706326 16285 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 658a20d894c5444a820ce6bd33e4fdf0
I20251025 08:02:32.706614 16285 catalog_manager.cc:6719] ReplaceTablet: tablet 658a20d894c5444a820ce6bd33e4fdf0 deleted and replaced by tablet 5522e9c5bf904c63bc4b00a226a0cc45
I20251025 08:02:32.706764 16285 master_service.cc:954] ReplaceTablet: received request to replace tablet 23eedc2695db43afbd6f5dbebb0ea2be from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.706863 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet 2069ab40d30c4b8dab9d37c466522ac1 with delete_type TABLET_DATA_DELETED (replaced by tablet 6d1979a4f43a4659976b0cd6d1b888ef) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.707401 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet d5cd481a98514f16bed3fb0bf5003526 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.707464 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet e87bae31e5e642a5a34a8c170c62fdca with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.707490 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet 658a20d894c5444a820ce6bd33e4fdf0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5522e9c5bf904c63bc4b00a226a0cc45) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.683252 14952 tablet_service.cc:1505] Processing CreateTablet for tablet cfe93efc1a0c4dda95b5c2e58cdcec82 (DEFAULT_TABLE table=default.Table_cce271e6706043dabfbd2c4b55bf198b [id=3a6e3a35c29b486b9ed32bc6fe1ec042]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.707593 16281 master_service.cc:954] ReplaceTablet: received request to replace tablet ff20cd7d33a440bab24bd4a61fff1f30 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.707748 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe93efc1a0c4dda95b5c2e58cdcec82. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.708058 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.708132 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 31c9e3906dac487e8585daa13d3fe4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.708180 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet bea55cdfbf454d76920806886c3d2c4e with delete_type TABLET_DATA_DELETED (replaced by tablet 17339d7c0a4b40a78b3252d17481c192) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.708236 16287 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet fc5f892ca7a246a28a556fe0eb3f5442
I20251025 08:02:32.708298 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet fba2914feb95475fbbfc5cef5a653408 with delete_type TABLET_DATA_DELETED (replaced by tablet cfe93efc1a0c4dda95b5c2e58cdcec82) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.708438 16287 catalog_manager.cc:6719] ReplaceTablet: tablet fc5f892ca7a246a28a556fe0eb3f5442 deleted and replaced by tablet e03e2e21e3f64bedb04c7e79aea6d49d
I20251025 08:02:32.708564 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet d709ecb9ac9a4525985c7d2bf10719f5 with delete_type TABLET_DATA_DELETED (replaced by tablet b7bb3d7d89674b7e825868c17495bbb3) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.708562 16287 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_c8ac7973eef94a68bf4ebe1459c2e6e6" } modify_external_catalogs: true
I20251025 08:02:32.708645 16287 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_c8ac7973eef94a68bf4ebe1459c2e6e6" } modify_external_catalogs: true
I20251025 08:02:32.708873 16288 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet bfdc6022cc5747439edcb8aa865b9437
I20251025 08:02:32.708990 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet fc5f892ca7a246a28a556fe0eb3f5442 with delete_type TABLET_DATA_DELETED (replaced by tablet e03e2e21e3f64bedb04c7e79aea6d49d) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.709164 17194 raft_consensus.cc:2243] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.709236 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_0d9ad032e51f4c38aecebf16793e490d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:32.708773 16282 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_9c7e0359120c415cba47b89251b0be94 [id=4510ebbcd6ee43babe7ee133a0ce6ae5] alter complete (version 1)
W20251025 08:02:32.709558 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0d9ad032e51f4c38aecebf16793e490d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:32.709825 16271 catalog_manager.cc:5058] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): alter failed for tablet d162f3ee21bd40ce9a9c74b7863a3878 (table default.Table_a6c6f65ea3444858aa562a65d71c4e77 [id=2ef2d72066f446619f9045da34df7814]),no further retry: Not found: Tablet not found: d162f3ee21bd40ce9a9c74b7863a3878
I20251025 08:02:32.709955 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet bfdc6022cc5747439edcb8aa865b9437 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.710243 16284 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 98baf6e8d8e84b42a83054495ae19e01
I20251025 08:02:32.710584 16284 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_808c7980d96b48a181f79124ea5a0adb" } new_table_name: "default.Table_89038955e92b42c2af35921ad16899d4" modify_external_catalogs: true
I20251025 08:02:32.710680 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 98baf6e8d8e84b42a83054495ae19e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.711301 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 27d1e084fbdf43e2a1cc60fb6dfd194b
I20251025 08:02:32.711575 17258 tablet_replica.cc:333] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.711596 15384 raft_consensus.cc:493] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.711625 16283 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_ea3622c669ee4aa5a2b88a9e87aeadaf" } new_table_name: "default.Table_3678577821c441b1bac4f3d9617e4d43" modify_external_catalogs: true
I20251025 08:02:32.711650 15384 raft_consensus.cc:515] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.711902 15384 leader_election.cc:290] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.712198 16390 tablet_bootstrap.cc:492] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.712211 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "658a20d894c5444a820ce6bd33e4fdf0" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.712267 16390 ts_tablet_manager.cc:1403] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.020s user 0.001s sys 0.000s
I20251025 08:02:32.712306 15109 raft_consensus.cc:2468] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:32.699900 16391 tablet_bootstrap.cc:492] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.700573 17426 tablet.cc:1722] T a547fb54ddbf4053b5be20ee6c4fc6b0 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.712452 16391 ts_tablet_manager.cc:1403] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.119s user 0.002s sys 0.000s
I20251025 08:02:32.679199 14948 tablet_service.cc:1505] Processing CreateTablet for tablet be8d6685c70c4219947df30f023a59b8 (DEFAULT_TABLE table=default.Table_165ff894c5ab455e8daf5d1cf318b785 [id=325e0a7553e840c58179c04253e874dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.712743 14948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be8d6685c70c4219947df30f023a59b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.712919 15185 leader_election.cc:304] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.713071 15384 raft_consensus.cc:2804] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.713110 15384 raft_consensus.cc:493] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.713143 15384 raft_consensus.cc:3060] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.714018 15384 raft_consensus.cc:515] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.714133 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.714359 15384 leader_election.cc:290] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.714743 17258 raft_consensus.cc:2243] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.714896 17258 raft_consensus.cc:2272] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.715018 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 658a20d894c5444a820ce6bd33e4fdf0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5522e9c5bf904c63bc4b00a226a0cc45) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.715286 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "658a20d894c5444a820ce6bd33e4fdf0" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:32.715307 14947 tablet_service.cc:1552] Processing DeleteTablet for tablet 98baf6e8d8e84b42a83054495ae19e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.715378 15109 raft_consensus.cc:3060] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.715378 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.715404 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet bfdc6022cc5747439edcb8aa865b9437 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.716226 15109 raft_consensus.cc:2468] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:32.716645 16390 raft_consensus.cc:359] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.716735 16390 raft_consensus.cc:385] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.716790 14943 tablet_service.cc:1552] Processing DeleteTablet for tablet fc5f892ca7a246a28a556fe0eb3f5442 with delete_type TABLET_DATA_DELETED (replaced by tablet e03e2e21e3f64bedb04c7e79aea6d49d) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.701272 17332 tablet.cc:1722] T a547fb54ddbf4053b5be20ee6c4fc6b0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.716742 15185 leader_election.cc:304] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.717108 16390 raft_consensus.cc:740] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.717115 15384 raft_consensus.cc:2804] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.717273 15384 raft_consensus.cc:697] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:32.717312 16390 consensus_queue.cc:260] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.717365 15384 consensus_queue.cc:237] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.717677 16390 ts_tablet_manager.cc:1434] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:32.717828 16390 tablet_bootstrap.cc:492] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
W20251025 08:02:32.708564 16280 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet 6d1979a4f43a4659976b0cd6d1b888ef (table default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet 6d1979a4f43a4659976b0cd6d1b888ef consensus state has no leader
I20251025 08:02:32.718340 16391 raft_consensus.cc:359] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.718436 16391 raft_consensus.cc:385] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.718472 16391 raft_consensus.cc:740] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.718592 16391 consensus_queue.cc:260] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.718797 17258 ts_tablet_manager.cc:1916] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.718897 16391 ts_tablet_manager.cc:1434] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:32.718881 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 93d383e3e2f4493d9cc8a71a4284e107 with delete_type TABLET_DATA_DELETED (replaced by tablet 82b93b7537c047aea430658ae2c2654b) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.719080 16391 tablet_bootstrap.cc:492] T f3f42babc0b2421fa80b265997effe36 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.719942 16391 tablet_bootstrap.cc:654] T f3f42babc0b2421fa80b265997effe36 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:32.720485 16270 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 88a76d187fae4f09ac879b72e9c05a86 (table default.Table_8d621c2f449e477ab01d1b67dc869408 [id=d318bca8bf144870aa5529426cfa9995], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 88a76d187fae4f09ac879b72e9c05a86 consensus state has no leader
I20251025 08:02:32.720815 17258 ts_tablet_manager.cc:1929] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:32.720866 17258 log.cc:1199] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/73cdd9616b9c460f8fcd4a40e4a3ccc8
I20251025 08:02:32.721073 17258 ts_tablet_manager.cc:1950] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.721586 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 (table default.Table_05bac665c2114dacac7804da6adfc06e [id=9aee333b5b9f4e1daba6449f643ea43a]) successfully deleted
I20251025 08:02:32.722162 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 2d16499315044408ad4bc1dca6341ed5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.722276 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet e762c440cb0947deb7e6a4186deebdc1 with delete_type TABLET_DATA_DELETED (replaced by tablet 14b47bf733754b72b34bd74aa033afa3) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.722357 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 with delete_type TABLET_DATA_DELETED (replaced by tablet e7a34f24b89b4003b6590f8259a57199) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.722402 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 6cedb44483cf4f62acf52b90b6708dfb with delete_type TABLET_DATA_DELETED (replaced by tablet 86b1873446154249a80fa67b99496545) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.722473 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 1ab6b9d8278045ae92043ada5ce6dd71 with delete_type TABLET_DATA_DELETED (replaced by tablet adb2c77ec9b84fe8846084cddc23888a) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.722513 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet cfe9add2f8bf450bb6f49ad57be2caae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.722589 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet a3379087113041beba7ddbc6596c3b0a with delete_type TABLET_DATA_DELETED (replaced by tablet bc56844d88604fa5be02cd82b5856cd1) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.722632 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d with delete_type TABLET_DATA_DELETED (replaced by tablet 1ab6b9d8278045ae92043ada5ce6dd71) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.722793 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 7e90c358ef454760b8317d78724ee377 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.722800 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 14b47bf733754b72b34bd74aa033afa3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.723403 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet ae3c8e134d164edd8781f27e7bdc3b92 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.723448 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 446194cf013c4b6499deb00fab8db42a with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.723580 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet 0769fe05ef364f8e80786bded1ec44cf with delete_type TABLET_DATA_DELETED (replaced by tablet be8d6685c70c4219947df30f023a59b8) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.723686 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 6dd0f695a2904df5b750b45782a21ce2 with delete_type TABLET_DATA_DELETED (replaced by tablet f3f42babc0b2421fa80b265997effe36) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.723829 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet e106f20977444dd4a49b6e4ae0f45380 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c) from {username='slave'} at 127.0.0.1:42704
W20251025 08:02:32.724156 16280 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.14.70.3:37907 (request call id 219) took 1059 ms (client timeout 1000 ms). Trace:
W20251025 08:02:32.724272 16280 rpcz_store.cc:269] 1025 08:02:31.664777 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:31.666338 (+ 1561us) service_pool.cc:225] Handling call
1025 08:02:32.724142 (+1057804us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1025 08:02:32.060462 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:32.060522 (+ 60us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:32.060525 (+ 3us) write_op.cc:435] Acquired schema lock
1025 08:02:32.060527 (+ 2us) tablet.cc:660] Decoding operations
1025 08:02:32.060652 (+ 125us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:32.060660 (+ 8us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:32.060662 (+ 2us) tablet.cc:683] Acquiring locks for 16 operations
1025 08:02:32.060784 (+ 122us) tablet.cc:699] Row locks acquired
1025 08:02:32.060786 (+ 2us) write_op.cc:260] PREPARE: finished
1025 08:02:32.060803 (+ 17us) write_op.cc:270] Start()
1025 08:02:32.060819 (+ 16us) write_op.cc:276] Timestamp: P: 1761379352060788 usec, L: 0
1025 08:02:32.060820 (+ 1us) op_driver.cc:348] REPLICATION: starting
1025 08:02:32.060901 (+ 81us) log.cc:844] Serialized 6138 byte log entry
1025 08:02:32.064084 (+ 3183us) op_driver.cc:464] REPLICATION: finished
1025 08:02:32.064426 (+ 342us) write_op.cc:301] APPLY: starting
1025 08:02:32.064432 (+ 6us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:32.064464 (+ 32us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:32.064475 (+ 11us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:32.064593 (+ 118us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:32.064618 (+ 25us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
1025 08:02:32.064621 (+ 3us) write_op.cc:312] APPLY: finished
1025 08:02:32.064666 (+ 45us) log.cc:844] Serialized 113 byte log entry
1025 08:02:32.064694 (+ 28us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:32.064713 (+ 19us) write_op.cc:454] Released schema lock
1025 08:02:32.064718 (+ 5us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":36492,"reported_tablets":122,"child_traces":[["op",{"apply.queue_time_us":319,"apply.run_cpu_time_us":330,"apply.run_wall_time_us":331,"num_ops":16,"prepare.queue_time_us":10055,"prepare.run_cpu_time_us":485,"prepare.run_wall_time_us":485,"raft.queue_time_us":221,"raft.run_cpu_time_us":3,"raft.run_wall_time_us":2,"replication_time_us":3254}]]}
I20251025 08:02:32.724900 16280 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_2d148de11ab3450e916c806c1f900a96"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.725310 16280 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d148de11ab3450e916c806c1f900a96 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.726107 17415 raft_consensus.cc:493] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.726210 17415 raft_consensus.cc:515] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.726480 17415 leader_election.cc:290] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.726740 16390 tablet_bootstrap.cc:654] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.726800 15242 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d049bf946c744664aba74d7a12fa4ff1" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.727232 17194 raft_consensus.cc:2272] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.728735 17194 ts_tablet_manager.cc:1916] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:32.730273 15048 leader_election.cc:343] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:32.730381 15048 leader_election.cc:343] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.730825 17194 ts_tablet_manager.cc:1929] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20251025 08:02:32.730980 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet a40c5721a4304345b471960ed1691930 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a40c5721a4304345b471960ed1691930 already in progress: creating tablet
I20251025 08:02:32.731138 15082 tablet_service.cc:1505] Processing CreateTablet for tablet 88a76d187fae4f09ac879b72e9c05a86 (DEFAULT_TABLE table=default.Table_8d621c2f449e477ab01d1b67dc869408 [id=d318bca8bf144870aa5529426cfa9995]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.731374 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a76d187fae4f09ac879b72e9c05a86. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.731529 15092 tablet_service.cc:1505] Processing CreateTablet for tablet acb84bad2f75474faecd00432d187ccf (DEFAULT_TABLE table=default.Table_9985b6eb72284cb583313ce952774b40 [id=3f5c8992a5e44e0d960303db92eb62be]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.731735 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acb84bad2f75474faecd00432d187ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.731861 15087 tablet_service.cc:1552] Processing DeleteTablet for tablet fc5f892ca7a246a28a556fe0eb3f5442 with delete_type TABLET_DATA_DELETED (replaced by tablet e03e2e21e3f64bedb04c7e79aea6d49d) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.732182 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet 98baf6e8d8e84b42a83054495ae19e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.732381 17258 tablet_replica.cc:333] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.733412 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 658a20d894c5444a820ce6bd33e4fdf0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5522e9c5bf904c63bc4b00a226a0cc45) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.733549 15083 tablet_service.cc:1505] Processing CreateTablet for tablet 2be36d176bf34fb6bd3c70b42af15cc9 (DEFAULT_TABLE table=default.Table_65442dc666594e129611ee817db7b2c0 [id=de277558d55a46519b3c1e18c51f18fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.733621 17258 raft_consensus.cc:2243] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.733695 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet bfdc6022cc5747439edcb8aa865b9437 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.733721 17258 raft_consensus.cc:2272] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.733760 15083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2be36d176bf34fb6bd3c70b42af15cc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.733790 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.731539 15084 tablet_service.cc:1505] Processing CreateTablet for tablet be8d6685c70c4219947df30f023a59b8 (DEFAULT_TABLE table=default.Table_165ff894c5ab455e8daf5d1cf318b785 [id=325e0a7553e840c58179c04253e874dc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.731333 15088 tablet_service.cc:1505] Processing CreateTablet for tablet cfe93efc1a0c4dda95b5c2e58cdcec82 (DEFAULT_TABLE table=default.Table_cce271e6706043dabfbd2c4b55bf198b [id=3a6e3a35c29b486b9ed32bc6fe1ec042]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.734095 17198 ts_tablet_manager.cc:1929] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.734169 17198 log.cc:1199] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/a3379087113041beba7ddbc6596c3b0a
I20251025 08:02:32.734107 15084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be8d6685c70c4219947df30f023a59b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.734457 17258 ts_tablet_manager.cc:1916] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:32.734867 15185 consensus_peers.cc:597] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Couldn't send request to peer e51a2be794f04642b89386067ecbc77e. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6cedb44483cf4f62acf52b90b6708dfb. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:32.736093 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe93efc1a0c4dda95b5c2e58cdcec82. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.736173 17198 ts_tablet_manager.cc:1950] T a3379087113041beba7ddbc6596c3b0a P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
W20251025 08:02:32.697610 15183 leader_election.cc:343] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.736495 15183 leader_election.cc:304] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:32.736646 15384 raft_consensus.cc:2749] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:32.737685 16572 consensus_queue.cc:1048] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.738266 16390 tablet_bootstrap.cc:492] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.738397 16390 ts_tablet_manager.cc:1403] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20251025 08:02:32.738858 16390 raft_consensus.cc:359] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.738950 16390 raft_consensus.cc:385] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.738992 16390 raft_consensus.cc:740] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.739105 16390 consensus_queue.cc:260] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.739374 16390 ts_tablet_manager.cc:1434] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:32.739593 16390 tablet_bootstrap.cc:492] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.740376 16390 tablet_bootstrap.cc:654] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:32.740607 15183 leader_election.cc:343] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.740682 15183 leader_election.cc:304] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:32.740829 15384 raft_consensus.cc:2749] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:32.742421 15183 consensus_peers.cc:597] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e762c440cb0947deb7e6a4186deebdc1. This is attempt 1: this message will repeat every 5th retry.
W20251025 08:02:32.742969 15183 consensus_peers.cc:597] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2069ab40d30c4b8dab9d37c466522ac1. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:32.743779 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82b93b7537c047aea430658ae2c2654b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:32.743877 15239 raft_consensus.cc:3060] T 82b93b7537c047aea430658ae2c2654b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.744726 15239 raft_consensus.cc:2468] T 82b93b7537c047aea430658ae2c2654b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:32.744984 17258 ts_tablet_manager.cc:1929] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:32.745047 17258 log.cc:1199] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/c043ab70d7364e05b0b352ac5c416db1
I20251025 08:02:32.745287 17258 ts_tablet_manager.cc:1950] T c043ab70d7364e05b0b352ac5c416db1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.745800 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet c043ab70d7364e05b0b352ac5c416db1 (table default.Table_21b4f92893424716afe86f9c67b6a691 [id=db6654cc26a348709c7f0577b91f18af]) successfully deleted
I20251025 08:02:32.746440 16391 tablet_bootstrap.cc:492] T f3f42babc0b2421fa80b265997effe36 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.746642 16391 ts_tablet_manager.cc:1403] T f3f42babc0b2421fa80b265997effe36 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.028s user 0.001s sys 0.000s
I20251025 08:02:32.747114 16391 raft_consensus.cc:359] T f3f42babc0b2421fa80b265997effe36 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.747210 16391 raft_consensus.cc:385] T f3f42babc0b2421fa80b265997effe36 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.747237 16391 raft_consensus.cc:740] T f3f42babc0b2421fa80b265997effe36 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.747359 16391 consensus_queue.cc:260] T f3f42babc0b2421fa80b265997effe36 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.747622 16391 ts_tablet_manager.cc:1434] T f3f42babc0b2421fa80b265997effe36 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:32.747774 16391 tablet_bootstrap.cc:492] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.748015 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5f72ca8cfb94178a21619ddc9fc0352" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.748690 16391 tablet_bootstrap.cc:654] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.748121 15240 raft_consensus.cc:2468] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:32.748068 17258 tablet_replica.cc:333] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.748992 17258 raft_consensus.cc:2243] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.749032 17332 tablet.cc:1722] T 24e0f02dd56644a3930c1cc0a972132e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.749155 17258 raft_consensus.cc:2272] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.750134 17426 tablet.cc:1722] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.750905 17094 raft_consensus.cc:493] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.750989 17094 raft_consensus.cc:515] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.751291 17094 leader_election.cc:290] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.751415 17194 log.cc:1199] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/a3379087113041beba7ddbc6596c3b0a
I20251025 08:02:32.751731 17194 ts_tablet_manager.cc:1950] T a3379087113041beba7ddbc6596c3b0a P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.752449 17258 ts_tablet_manager.cc:1916] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.754966 16391 tablet_bootstrap.cc:492] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.755044 16391 ts_tablet_manager.cc:1403] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.002s
I20251025 08:02:32.755785 16391 raft_consensus.cc:359] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.755934 16391 raft_consensus.cc:385] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.756018 16391 raft_consensus.cc:740] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.756215 16391 consensus_queue.cc:260] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.756595 16391 ts_tablet_manager.cc:1434] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:32.756780 16391 tablet_bootstrap.cc:492] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.757826 16391 tablet_bootstrap.cc:654] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.758956 16391 tablet_bootstrap.cc:492] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.759310 16391 ts_tablet_manager.cc:1403] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:32.760545 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet a3379087113041beba7ddbc6596c3b0a (table default.Table_a05736b7077d457181534fd09c3a1946 [id=54160b89eff147188297e5017eaec741]) successfully deleted
I20251025 08:02:32.760545 16391 raft_consensus.cc:359] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.760681 16391 raft_consensus.cc:385] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.760746 16391 raft_consensus.cc:740] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.760867 17194 tablet_replica.cc:333] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.761046 16391 consensus_queue.cc:260] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.761528 16391 ts_tablet_manager.cc:1434] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:32.761755 16391 tablet_bootstrap.cc:492] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.762733 17258 ts_tablet_manager.cc:1929] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.762851 17258 log.cc:1199] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/6d1979a4f43a4659976b0cd6d1b888ef
I20251025 08:02:32.761045 17194 raft_consensus.cc:2243] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.762936 17194 raft_consensus.cc:2272] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.763178 17258 ts_tablet_manager.cc:1950] T 6d1979a4f43a4659976b0cd6d1b888ef P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.763278 17194 ts_tablet_manager.cc:1916] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.763788 17258 tablet_replica.cc:333] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.764277 17258 raft_consensus.cc:2243] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.764425 17258 raft_consensus.cc:2272] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.764770 17258 ts_tablet_manager.cc:1916] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.765040 17194 ts_tablet_manager.cc:1929] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.765144 17194 log.cc:1199] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/31c9e3906dac487e8585daa13d3fe4b1
I20251025 08:02:32.765388 17194 ts_tablet_manager.cc:1950] T 31c9e3906dac487e8585daa13d3fe4b1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.765750 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 31c9e3906dac487e8585daa13d3fe4b1 (table default.Table_035df9ac9f6541dd9b042857523d0659 [id=2c373de1732c4d18ad45968e90a65608]) successfully deleted
I20251025 08:02:32.765969 17194 tablet_replica.cc:333] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.766105 17194 raft_consensus.cc:2243] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.766280 17194 raft_consensus.cc:2272] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.766609 17274 tablet_bootstrap.cc:492] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:32.766693 17274 ts_tablet_manager.cc:1403] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.077s user 0.002s sys 0.000s
I20251025 08:02:32.766702 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 6d1979a4f43a4659976b0cd6d1b888ef (table default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95]) successfully deleted
I20251025 08:02:32.766731 17194 ts_tablet_manager.cc:1916] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:32.766857 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet a40c5721a4304345b471960ed1691930 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a40c5721a4304345b471960ed1691930 already in progress: creating tablet
I20251025 08:02:32.767151 17274 raft_consensus.cc:359] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.767241 17274 raft_consensus.cc:385] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.767266 17274 raft_consensus.cc:740] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.767365 17274 consensus_queue.cc:260] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.767622 17274 ts_tablet_manager.cc:1434] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.768492 15108 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d049bf946c744664aba74d7a12fa4ff1" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.768596 15108 raft_consensus.cc:2468] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:32.768982 17405 tablet.cc:1722] T a547fb54ddbf4053b5be20ee6c4fc6b0 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.770423 17258 ts_tablet_manager.cc:1929] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:32.770480 17258 log.cc:1199] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/997c8c5921ad4ec18914fd50c97fc33e
I20251025 08:02:32.770705 17258 ts_tablet_manager.cc:1950] T 997c8c5921ad4ec18914fd50c97fc33e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.771289 16390 tablet_bootstrap.cc:492] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.771360 16390 ts_tablet_manager.cc:1403] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.000s
I20251025 08:02:32.771368 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 997c8c5921ad4ec18914fd50c97fc33e (table default.Table_56b69a1e3b4d4e7dbaa6a4697a940880 [id=cb9294ed7c474aae989ac13159ec3166]) successfully deleted
I20251025 08:02:32.771867 16390 raft_consensus.cc:359] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.771981 16390 raft_consensus.cc:385] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.772011 16390 raft_consensus.cc:740] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.772140 16390 consensus_queue.cc:260] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.772390 16390 ts_tablet_manager.cc:1434] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.772539 16390 tablet_bootstrap.cc:492] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.773587 16390 tablet_bootstrap.cc:654] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.776320 15384 consensus_queue.cc:1048] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.776368 16279 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_172a223c749e4f5f844e515a18e0522f [id=194a3dd184f4450da0604a85ace48fe9] alter complete (version 2)
I20251025 08:02:32.777029 16285 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 23eedc2695db43afbd6f5dbebb0ea2be
I20251025 08:02:32.777324 16285 catalog_manager.cc:6719] ReplaceTablet: tablet 23eedc2695db43afbd6f5dbebb0ea2be deleted and replaced by tablet edfb86283bda491993a456e365f8760f
I20251025 08:02:32.777694 16281 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet ff20cd7d33a440bab24bd4a61fff1f30
I20251025 08:02:32.777730 16391 tablet_bootstrap.cc:654] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.777897 16281 catalog_manager.cc:6719] ReplaceTablet: tablet ff20cd7d33a440bab24bd4a61fff1f30 deleted and replaced by tablet d20a130fc8ea40ddba509d2825ac028d
I20251025 08:02:32.778470 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 23eedc2695db43afbd6f5dbebb0ea2be with delete_type TABLET_DATA_DELETED (replaced by tablet edfb86283bda491993a456e365f8760f) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.778558 14943 tablet_service.cc:1552] Processing DeleteTablet for tablet 23eedc2695db43afbd6f5dbebb0ea2be with delete_type TABLET_DATA_DELETED (replaced by tablet edfb86283bda491993a456e365f8760f) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.778589 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet ff20cd7d33a440bab24bd4a61fff1f30 with delete_type TABLET_DATA_DELETED (replaced by tablet d20a130fc8ea40ddba509d2825ac028d) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.778636 14948 tablet_service.cc:1552] Processing DeleteTablet for tablet ff20cd7d33a440bab24bd4a61fff1f30 with delete_type TABLET_DATA_DELETED (replaced by tablet d20a130fc8ea40ddba509d2825ac028d) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.779094 17258 tablet_replica.cc:333] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.779462 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_e355ea0deef54efd87fb7938c19b9547"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.779801 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e355ea0deef54efd87fb7938c19b9547 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.779842 17258 raft_consensus.cc:2243] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.779978 16287 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 64996b8137f647b993923cb1bb093211
I20251025 08:02:32.780014 17258 raft_consensus.cc:2272] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.780311 17258 ts_tablet_manager.cc:1916] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.780367 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_34881ec032724dac94217f71be36dd45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.780643 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_34881ec032724dac94217f71be36dd45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.780676 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_753a908ca3a540568e454f247a3f6fd4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.780931 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_753a908ca3a540568e454f247a3f6fd4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.781412 16288 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_aa5c70a86540451b8a07688d25edc3b7" } modify_external_catalogs: true
I20251025 08:02:32.781492 16288 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_aa5c70a86540451b8a07688d25edc3b7" } modify_external_catalogs: true
I20251025 08:02:32.781684 16281 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_5402989ff9f84c51b18f63d334655e33"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.781970 16281 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5402989ff9f84c51b18f63d334655e33 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.782513 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 64996b8137f647b993923cb1bb093211 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.782757 14948 tablet_service.cc:1552] Processing DeleteTablet for tablet 64996b8137f647b993923cb1bb093211 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.783601 16572 raft_consensus.cc:493] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.783669 16572 raft_consensus.cc:515] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.783962 16572 leader_election.cc:290] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.784229 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed2036a8ebd74ab18c0bbd6d9aa67ef0" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
W20251025 08:02:32.784528 15185 leader_election.cc:343] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.793877 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_a9114bb65ce7472fa79f74bed2243563"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.794226 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a9114bb65ce7472fa79f74bed2243563 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.795156 16283 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_9ba393cca8d548bcb6a5b34c49969893"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.795423 16283 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9ba393cca8d548bcb6a5b34c49969893 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:32.795493 16279 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet f6082b299bb44d31b567f70d8da7f0ac (table default.Table_c5c036d7c66344eba94e15be432088bc [id=ebfa83131bd946d0897b32ef3c188c19], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet f6082b299bb44d31b567f70d8da7f0ac consensus state has no leader
I20251025 08:02:32.795789 16279 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_bd4d865a11f940b183fb4f06cd4da881"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.796021 16279 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd4d865a11f940b183fb4f06cd4da881 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.797310 17258 ts_tablet_manager.cc:1929] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.797397 17258 log.cc:1199] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/6c582efa6d334a06a48e2f2b94167776
I20251025 08:02:32.797646 17258 ts_tablet_manager.cc:1950] T 6c582efa6d334a06a48e2f2b94167776 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.798163 16286 master_service.cc:954] ReplaceTablet: received request to replace tablet 1927cf6a9013402a92c9e6e89e2e1715 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.798260 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 6c582efa6d334a06a48e2f2b94167776 (table default.Table_b1d8db45b7d745a0b4dd9ff09300da89 [id=be37bd4a45da444e83846233c335d445]) successfully deleted
I20251025 08:02:32.798446 17258 tablet_replica.cc:333] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.799088 16282 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_7c63861b2d594b5d8ca6e055870d36ca [id=6739c1319b784c8eb66fc75125f83056] alter complete (version 5)
I20251025 08:02:32.800129 16288 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 34c330b5dd544ae686f741cdd85d023d
I20251025 08:02:32.800139 14948 tablet_service.cc:1552] Processing DeleteTablet for tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c with delete_type TABLET_DATA_DELETED (replaced by tablet 35bddef8fd2d4971a636e0689ac37d3a) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.800590 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 34c330b5dd544ae686f741cdd85d023d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.798573 17258 raft_consensus.cc:2243] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.800729 14948 tablet_service.cc:1552] Processing DeleteTablet for tablet 34c330b5dd544ae686f741cdd85d023d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.800873 17258 raft_consensus.cc:2272] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.801250 17258 ts_tablet_manager.cc:1916] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.801491 14948 tablet_service.cc:1552] Processing DeleteTablet for tablet a3379087113041beba7ddbc6596c3b0a with delete_type TABLET_DATA_DELETED (replaced by tablet bc56844d88604fa5be02cd82b5856cd1) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.801879 14948 tablet_service.cc:1552] Processing DeleteTablet for tablet d709ecb9ac9a4525985c7d2bf10719f5 with delete_type TABLET_DATA_DELETED (replaced by tablet b7bb3d7d89674b7e825868c17495bbb3) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.803263 14948 tablet_service.cc:1552] Processing DeleteTablet for tablet 212ccfb58f964d7bae31e5af110b4079 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.808069 16282 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_889a72b0cc55456889c7b37190901b20" } new_table_name: "default.Table_f435579c26e14e2cbb8da758499bfa19" modify_external_catalogs: true
I20251025 08:02:32.809384 17258 ts_tablet_manager.cc:1929] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.810241 17258 log.cc:1199] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/2069ab40d30c4b8dab9d37c466522ac1
I20251025 08:02:32.810530 17258 ts_tablet_manager.cc:1950] T 2069ab40d30c4b8dab9d37c466522ac1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.813894 14948 tablet_service.cc:1505] Processing CreateTablet for tablet b4a6f2b64c994f3abefef9724911a5fc (DEFAULT_TABLE table=default.Table_15d9c5aa50e643adb2dae30a80b6fcd4 [id=045593a2a7cf4197836b256661103ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.814167 15225 tablet_service.cc:1505] Processing CreateTablet for tablet b4a6f2b64c994f3abefef9724911a5fc (DEFAULT_TABLE table=default.Table_15d9c5aa50e643adb2dae30a80b6fcd4 [id=045593a2a7cf4197836b256661103ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.814471 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a6f2b64c994f3abefef9724911a5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.814602 14943 tablet_service.cc:1505] Processing CreateTablet for tablet 947b2d44ffa04370a04d5b4c24e11083 (DEFAULT_TABLE table=default.Table_665ec5662cd24651897362288ed8ae87 [id=fa6ba28e0ea24fca8ab1045fb79c1222]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.815852 14942 tablet_service.cc:1505] Processing CreateTablet for tablet 29b4798bac204280b9c56ebb0f44302d (DEFAULT_TABLE table=default.Table_b78d203377614f379975983098c188da [id=9b7a89e713f146199c35cedccb39f481]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.816398 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 947b2d44ffa04370a04d5b4c24e11083 (DEFAULT_TABLE table=default.Table_665ec5662cd24651897362288ed8ae87 [id=fa6ba28e0ea24fca8ab1045fb79c1222]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.816597 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947b2d44ffa04370a04d5b4c24e11083. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:32.816781 14914 consensus_peers.cc:597] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d993e2350f37492bb712d145d03e8afb. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:32.817713 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f42babc0b2421fa80b265997effe36" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.817807 14978 raft_consensus.cc:2468] T f3f42babc0b2421fa80b265997effe36 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:32.819162 15048 leader_election.cc:304] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:32.819314 17094 raft_consensus.cc:2804] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.819355 17094 raft_consensus.cc:493] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.819389 17094 raft_consensus.cc:3060] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.820298 17094 raft_consensus.cc:515] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.820645 17094 leader_election.cc:290] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.821318 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 2069ab40d30c4b8dab9d37c466522ac1 (table default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95]) successfully deleted
I20251025 08:02:32.821705 17258 tablet_replica.cc:333] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.821884 17258 raft_consensus.cc:2243] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.822446 14915 leader_election.cc:304] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:32.822690 17043 raft_consensus.cc:2804] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251025 08:02:32.822742 17043 raft_consensus.cc:493] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.822778 17043 raft_consensus.cc:3060] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Advancing to term 2
I20251025 08:02:32.823633 17043 raft_consensus.cc:515] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.823913 17043 leader_election.cc:290] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 2 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.825074 16280 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_5f10743381924d79a2225fed0b5db70f" } new_table_name: "default.Table_5f2746d8cc7341d9a30870387f129fa2" modify_external_catalogs: true
I20251025 08:02:32.824366 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d049bf946c744664aba74d7a12fa4ff1" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:32.825825 17258 raft_consensus.cc:2272] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.826293 17258 ts_tablet_manager.cc:1916] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.826850 14970 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f42babc0b2421fa80b265997effe36" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:32.826946 14970 raft_consensus.cc:3060] T f3f42babc0b2421fa80b265997effe36 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.827663 15082 tablet_service.cc:1552] Processing DeleteTablet for tablet 212ccfb58f964d7bae31e5af110b4079 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.827759 14970 raft_consensus.cc:2468] T f3f42babc0b2421fa80b265997effe36 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:32.827677 15086 tablet_service.cc:1552] Processing DeleteTablet for tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c with delete_type TABLET_DATA_DELETED (replaced by tablet 35bddef8fd2d4971a636e0689ac37d3a) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.827944 15084 tablet_service.cc:1552] Processing DeleteTablet for tablet 23eedc2695db43afbd6f5dbebb0ea2be with delete_type TABLET_DATA_DELETED (replaced by tablet edfb86283bda491993a456e365f8760f) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.828058 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet ff20cd7d33a440bab24bd4a61fff1f30 with delete_type TABLET_DATA_DELETED (replaced by tablet d20a130fc8ea40ddba509d2825ac028d) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.828084 15082 tablet_service.cc:1505] Processing CreateTablet for tablet b4a6f2b64c994f3abefef9724911a5fc (DEFAULT_TABLE table=default.Table_15d9c5aa50e643adb2dae30a80b6fcd4 [id=045593a2a7cf4197836b256661103ba5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.828147 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 64996b8137f647b993923cb1bb093211 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.828302 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a6f2b64c994f3abefef9724911a5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.828438 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 6dd0f695a2904df5b750b45782a21ce2 with delete_type TABLET_DATA_DELETED (replaced by tablet f3f42babc0b2421fa80b265997effe36) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.828545 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 47b0f93bac664a44989534097be9fd73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.828671 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d049bf946c744664aba74d7a12fa4ff1" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:32.828944 17094 consensus_queue.cc:1048] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.830294 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet 34c330b5dd544ae686f741cdd85d023d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:32.830523 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 947b2d44ffa04370a04d5b4c24e11083 (DEFAULT_TABLE table=default.Table_665ec5662cd24651897362288ed8ae87 [id=fa6ba28e0ea24fca8ab1045fb79c1222]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.830727 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947b2d44ffa04370a04d5b4c24e11083. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.830812 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "658a20d894c5444a820ce6bd33e4fdf0" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.831120 15086 tablet_service.cc:1505] Processing CreateTablet for tablet 29b4798bac204280b9c56ebb0f44302d (DEFAULT_TABLE table=default.Table_b78d203377614f379975983098c188da [id=9b7a89e713f146199c35cedccb39f481]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.831319 15086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b4798bac204280b9c56ebb0f44302d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.832351 15384 raft_consensus.cc:493] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.832417 15384 raft_consensus.cc:515] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.832697 15384 leader_election.cc:290] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.832953 15049 leader_election.cc:304] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:32.833402 14979 raft_consensus.cc:1240] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 2 FOLLOWER]: Rejecting Update request from peer f0f2f8ce3e9f4d9ba3f3f02813397c31 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20251025 08:02:32.834162 15296 heartbeater.cc:499] Master 127.14.70.62:39499 was elected leader, sending a full tablet report...
I20251025 08:02:32.834237 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "658a20d894c5444a820ce6bd33e4fdf0" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:32.834259 17316 raft_consensus.cc:493] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.834313 17316 raft_consensus.cc:515] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.834574 17316 leader_election.cc:290] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.834650 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed2036a8ebd74ab18c0bbd6d9aa67ef0" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:32.834743 14974 raft_consensus.cc:2468] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:32.835242 17274 tablet_bootstrap.cc:492] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:32.836265 17274 tablet_bootstrap.cc:654] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.836838 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f42babc0b2421fa80b265997effe36" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.836925 15240 raft_consensus.cc:2468] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
W20251025 08:02:32.837172 14914 consensus_peers.cc:597] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 997c8c5921ad4ec18914fd50c97fc33e. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:32.838060 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 29b4798bac204280b9c56ebb0f44302d (DEFAULT_TABLE table=default.Table_b78d203377614f379975983098c188da [id=9b7a89e713f146199c35cedccb39f481]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.838310 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b4798bac204280b9c56ebb0f44302d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.838922 14944 tablet_service.cc:1505] Processing CreateTablet for tablet fc62afd62257471e8590d28e49a50cb2 (DEFAULT_TABLE table=default.Table_2f3a2a53312142a797c57248d8d2ad48 [id=f317f6ac536c45beb5e90ab9bd55ebe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.840256 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 3cac2ac7463944549b5d235ed2e5a480 (DEFAULT_TABLE table=default.Table_0e6c61f9e83f4f7db9789897a5016f7c [id=4e2fede2a3ad4c80b68f74b9ef40b72b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.840348 15225 tablet_service.cc:1505] Processing CreateTablet for tablet fc62afd62257471e8590d28e49a50cb2 (DEFAULT_TABLE table=default.Table_2f3a2a53312142a797c57248d8d2ad48 [id=f317f6ac536c45beb5e90ab9bd55ebe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.840538 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc62afd62257471e8590d28e49a50cb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.841251 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 3cac2ac7463944549b5d235ed2e5a480 (DEFAULT_TABLE table=default.Table_0e6c61f9e83f4f7db9789897a5016f7c [id=4e2fede2a3ad4c80b68f74b9ef40b72b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.841442 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cac2ac7463944549b5d235ed2e5a480. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.845141 17426 tablet.cc:1722] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20251025 08:02:32.845511 17435 tablet.cc:1722] T c59083b54df24c21a3114c34a73dd638 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.845819 17332 tablet.cc:1722] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20251025 08:02:32.847252 17332 tablet.cc:1722] T c59083b54df24c21a3114c34a73dd638 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.848889 14953 tablet_service.cc:1505] Processing CreateTablet for tablet 2a4b060efd054726b07702b691876147 (DEFAULT_TABLE table=default.Table_5f10743381924d79a2225fed0b5db70f [id=846c344408284b8e8a0e5da1d328255d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.849095 16570 raft_consensus.cc:493] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.849181 16570 raft_consensus.cc:515] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.849452 16570 leader_election.cc:290] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.849470 15242 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f42babc0b2421fa80b265997effe36" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:32.849546 15242 raft_consensus.cc:3060] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.850204 14948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a6f2b64c994f3abefef9724911a5fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.850415 15242 raft_consensus.cc:2468] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:32.852102 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 947b2d44ffa04370a04d5b4c24e11083. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.854425 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29b4798bac204280b9c56ebb0f44302d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.856405 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc62afd62257471e8590d28e49a50cb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.858098 16390 tablet_bootstrap.cc:492] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:32.858166 16390 ts_tablet_manager.cc:1403] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.086s user 0.002s sys 0.000s
I20251025 08:02:32.858237 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cac2ac7463944549b5d235ed2e5a480. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.858587 16390 raft_consensus.cc:359] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.858776 16390 raft_consensus.cc:385] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.858816 16390 raft_consensus.cc:740] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.858934 16390 consensus_queue.cc:260] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.859287 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a4b060efd054726b07702b691876147. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.859503 16390 ts_tablet_manager.cc:1434] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.859651 16390 tablet_bootstrap.cc:492] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:32.860500 16390 tablet_bootstrap.cc:654] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.861152 17415 raft_consensus.cc:493] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.861227 17415 raft_consensus.cc:515] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.861423 17258 ts_tablet_manager.cc:1929] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.861478 17258 log.cc:1199] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/d5cd481a98514f16bed3fb0bf5003526
I20251025 08:02:32.861526 17274 tablet_bootstrap.cc:492] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:32.861578 17415 leader_election.cc:290] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.861614 17274 ts_tablet_manager.cc:1403] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
I20251025 08:02:32.861725 17258 ts_tablet_manager.cc:1950] T d5cd481a98514f16bed3fb0bf5003526 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.862970 17194 ts_tablet_manager.cc:1929] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.867506 16281 catalog_manager.cc:5649] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:32.862164 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d116fbec0c6149938b8f6c19af9607af" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:32.866345 16391 tablet_bootstrap.cc:492] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:32.867952 16391 ts_tablet_manager.cc:1403] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.106s user 0.002s sys 0.000s
I20251025 08:02:32.867805 16281 catalog_manager.cc:5649] T 174daf21bc41408d825ebe926af39c1b P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:32.868234 16281 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet c59083b54df24c21a3114c34a73dd638 (table default.Table_89038955e92b42c2af35921ad16899d4 [id=e3c0ae796ee2421abe38408b729dd2a6]). Expected version 1 got 0
I20251025 08:02:32.868333 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet d5cd481a98514f16bed3fb0bf5003526 (table default.Table_c52dec25e76a4fcea78b5514db2d8dce [id=a38b6f883f524f3cb829ce9a92bd7ef3]) successfully deleted
I20251025 08:02:32.868346 16391 raft_consensus.cc:359] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.868424 16391 raft_consensus.cc:385] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.868391 16281 catalog_manager.cc:5649] T 4ff32cab636840bc86a54aa6c91e9456 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:32.868453 16391 raft_consensus.cc:740] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.868542 16391 consensus_queue.cc:260] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.868571 16281 catalog_manager.cc:5649] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:32.868759 16281 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet e967a52212164b8cb6f9c39f207024a1 (table default.Table_434df4d622c74c6f89f7b7373096fb5f [id=0a4629613477421ba329364dbb42a8b6]). Expected version 1 got 0
I20251025 08:02:32.868813 16391 ts_tablet_manager.cc:1434] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.868849 16281 catalog_manager.cc:5649] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:32.868938 16281 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 1019d033e1f24ab596309462cbeb9c73 (table default.Table_5e5050bacd5543229399a2924609ae9c [id=4644ba57f12f4ad4bf7e89f80c4cd161]). Expected version 1 got 0
I20251025 08:02:32.868956 16391 tablet_bootstrap.cc:492] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:32.869269 16281 catalog_manager.cc:5649] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:32.869365 16281 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet f6082b299bb44d31b567f70d8da7f0ac (table default.Table_c5c036d7c66344eba94e15be432088bc [id=ebfa83131bd946d0897b32ef3c188c19]). Expected version 1 got 0
I20251025 08:02:32.869515 16281 catalog_manager.cc:5649] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:32.869599 16281 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 86b1873446154249a80fa67b99496545 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]). Expected version 1 got 0
I20251025 08:02:32.869774 16391 tablet_bootstrap.cc:654] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.869673 16281 catalog_manager.cc:5649] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } }
I20251025 08:02:32.869832 16281 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet d81b65e094a34703ac47897d9bfa4c7c (table default.Table_e45046c48bb54111b38f009cc14efd2d [id=768625af4c474964ad2b502cf0b03fa7]). Expected version 1 got 0
I20251025 08:02:32.869932 16281 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 346c0c8bf30b4dbaa92436b45e5fbf47 (table default.Table_258c905a78d94ba197752a61781fa019 [id=ef3a1760f2c44935bbb79e518510905f]). Expected version 4 got 3
W20251025 08:02:32.871551 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet e87bae31e5e642a5a34a8c170c62fdca because the tablet was not found. No further retry: Not found: Tablet not found: e87bae31e5e642a5a34a8c170c62fdca
I20251025 08:02:32.871953 17258 tablet_replica.cc:333] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.872080 17194 log.cc:1199] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/4edf680e8d4a4b898fd6e64f8ec6f75d
I20251025 08:02:32.872107 17258 raft_consensus.cc:2243] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.872268 17258 pending_rounds.cc:70] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 1 pending ops.
I20251025 08:02:32.872323 17258 pending_rounds.cc:77] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609828731559936 op_type: NO_OP noop_request { }
I20251025 08:02:32.872383 17258 raft_consensus.cc:2889] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:32.872444 17258 raft_consensus.cc:2272] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.872946 17258 ts_tablet_manager.cc:1916] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.874477 17194 ts_tablet_manager.cc:1950] T 4edf680e8d4a4b898fd6e64f8ec6f75d P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.874998 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 4edf680e8d4a4b898fd6e64f8ec6f75d (table default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]) successfully deleted
I20251025 08:02:32.875547 17194 tablet_replica.cc:333] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.876398 17194 raft_consensus.cc:2243] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.876602 17194 raft_consensus.cc:2272] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.877372 17194 ts_tablet_manager.cc:1916] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.878984 17258 ts_tablet_manager.cc:1929] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.880004 17258 log.cc:1199] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/658a20d894c5444a820ce6bd33e4fdf0
I20251025 08:02:32.880473 17258 ts_tablet_manager.cc:1950] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.881083 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 658a20d894c5444a820ce6bd33e4fdf0 (table default.Table_25e0298aad614dba82f598191e458567 [id=7edb1b5b68864e54b6366186a8915fcf]) successfully deleted
I20251025 08:02:32.882687 17258 tablet_replica.cc:333] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.883399 17258 raft_consensus.cc:2243] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.883534 17258 raft_consensus.cc:2272] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.884239 16286 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 1927cf6a9013402a92c9e6e89e2e1715
I20251025 08:02:32.884487 16286 catalog_manager.cc:6719] ReplaceTablet: tablet 1927cf6a9013402a92c9e6e89e2e1715 deleted and replaced by tablet 4826826d19fd421a9d04eac17a79a9fb
I20251025 08:02:32.885470 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet 1927cf6a9013402a92c9e6e89e2e1715 with delete_type TABLET_DATA_DELETED (replaced by tablet 4826826d19fd421a9d04eac17a79a9fb) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.884855 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 1927cf6a9013402a92c9e6e89e2e1715 with delete_type TABLET_DATA_DELETED (replaced by tablet 4826826d19fd421a9d04eac17a79a9fb) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.884785 17258 ts_tablet_manager.cc:1916] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.888199 17194 ts_tablet_manager.cc:1929] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.890139 17194 log.cc:1199] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/7e90c358ef454760b8317d78724ee377
I20251025 08:02:32.891129 17194 ts_tablet_manager.cc:1950] T 7e90c358ef454760b8317d78724ee377 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
W20251025 08:02:32.893669 16280 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a4b060efd054726b07702b691876147 consensus state has no leader
I20251025 08:02:32.893906 17194 tablet_replica.cc:333] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.894064 17194 raft_consensus.cc:2243] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.894225 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 7e90c358ef454760b8317d78724ee377 (table default.Table_05fb668587d14b6c8f3a12bb75fa1423 [id=2bee387e0d87487a8652689103a57438]) successfully deleted
I20251025 08:02:32.894541 17258 ts_tablet_manager.cc:1929] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.894671 17194 raft_consensus.cc:2272] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.895450 17194 ts_tablet_manager.cc:1916] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.895548 17258 log.cc:1199] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/a2b8efa8ed634583b7bf7cc91bfc61a3
I20251025 08:02:32.895794 17258 ts_tablet_manager.cc:1950] T a2b8efa8ed634583b7bf7cc91bfc61a3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.897292 15027 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:32.898133 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet a2b8efa8ed634583b7bf7cc91bfc61a3 (table default.Table_c485105a684f427295b74968c29fd30c [id=3abb3c7d3dd74d408db083bf0499f679]) successfully deleted
W20251025 08:02:32.898595 15183 consensus_peers.cc:597] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6cedb44483cf4f62acf52b90b6708dfb. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:32.898643 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 2a4b060efd054726b07702b691876147 (DEFAULT_TABLE table=default.Table_5f2746d8cc7341d9a30870387f129fa2 [id=846c344408284b8e8a0e5da1d328255d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.898696 14953 tablet_service.cc:1505] Processing CreateTablet for tablet 5027b80220e34f5f8e1e8e8479ec41f3 (DEFAULT_TABLE table=default.Table_2723d06acdad494093ca794f37a40c63 [id=ce13cf6cceec4f6bb1cb22d48b226256]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.898865 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a4b060efd054726b07702b691876147. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.898959 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5027b80220e34f5f8e1e8e8479ec41f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.899649 17316 consensus_queue.cc:1048] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.902736 17258 tablet_replica.cc:333] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.902889 17258 raft_consensus.cc:2243] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.904021 17194 ts_tablet_manager.cc:1929] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.904168 17258 raft_consensus.cc:2272] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.904650 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 5027b80220e34f5f8e1e8e8479ec41f3 (DEFAULT_TABLE table=default.Table_2723d06acdad494093ca794f37a40c63 [id=ce13cf6cceec4f6bb1cb22d48b226256]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.904857 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5027b80220e34f5f8e1e8e8479ec41f3. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:32.904834 15049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.70.3:45447, user_credentials={real_user=slave}} blocked reactor thread for 71887.3us
I20251025 08:02:32.905216 17389 raft_consensus.cc:2804] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.905359 17389 raft_consensus.cc:697] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:32.905416 15049 leader_election.cc:304] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:32.905489 17389 consensus_queue.cc:237] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.906581 17393 raft_consensus.cc:2804] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.906641 17393 raft_consensus.cc:493] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.906683 17393 raft_consensus.cc:3060] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.906723 15099 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "736f75f26af142e59e7996c2ebb80868" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.906827 15099 raft_consensus.cc:2468] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:32.907120 15113 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f42babc0b2421fa80b265997effe36" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.907236 15113 raft_consensus.cc:2393] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:32.907694 17393 raft_consensus.cc:515] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.907999 17393 leader_election.cc:290] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.908458 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "45a22457031a4eff8e82fa232b6f05bb" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.908509 17393 raft_consensus.cc:493] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.908574 17393 raft_consensus.cc:515] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.908789 15185 leader_election.cc:304] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.908875 17393 leader_election.cc:290] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.908937 16570 raft_consensus.cc:2804] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:32.908999 16570 raft_consensus.cc:493] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:32.909039 16570 raft_consensus.cc:3060] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:32.909128 17274 raft_consensus.cc:359] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.909312 17274 raft_consensus.cc:385] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.909359 17274 raft_consensus.cc:740] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.909463 17274 consensus_queue.cc:260] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.909749 17274 ts_tablet_manager.cc:1434] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.048s user 0.001s sys 0.000s
I20251025 08:02:32.909852 16570 raft_consensus.cc:515] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.909976 17274 tablet_bootstrap.cc:492] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:32.910162 16570 leader_election.cc:290] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.910745 16572 consensus_queue.cc:1048] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:32.910790 15185 leader_election.cc:343] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.910984 16572 consensus_queue.cc:1048] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.911326 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "736f75f26af142e59e7996c2ebb80868" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:32.911405 17274 tablet_bootstrap.cc:654] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:32.904047 15183 leader_election.cc:343] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.911415 15103 raft_consensus.cc:3060] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:32.912355 15048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.70.1:35401, user_credentials={real_user=slave}} blocked reactor thread for 82422.2us
I20251025 08:02:32.913313 16281 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_d80d24fe6db14f0da8149898449ae86e [id=2283253a9522485d93d6c484c5eef6e4] alter complete (version 3)
I20251025 08:02:32.913336 15103 raft_consensus.cc:2468] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:32.913576 15185 leader_election.cc:304] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:32.914038 15048 leader_election.cc:304] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:32.914220 17389 raft_consensus.cc:2804] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.914331 17198 tablet_replica.cc:333] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.914479 17198 raft_consensus.cc:2243] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.914688 17369 consensus_queue.cc:1048] T 519f631918c144ff8edcfc7127ca23dc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.914883 17369 consensus_queue.cc:1059] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:32.915357 17372 raft_consensus.cc:2804] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:32.915419 17372 raft_consensus.cc:697] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:32.915511 17372 consensus_queue.cc:237] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.916028 17372 raft_consensus.cc:3055] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Stepping down as leader of term 1
I20251025 08:02:32.916083 17372 raft_consensus.cc:740] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:32.916208 17372 consensus_queue.cc:260] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.916337 17372 raft_consensus.cc:3060] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Advancing to term 2
I20251025 08:02:32.918362 16280 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_24a3fc5c42d441fab7d881fb258a0ddb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:32.918692 16280 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_24a3fc5c42d441fab7d881fb258a0ddb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.919363 16286 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_64c962f064d64350a1fb6d539603c572" } modify_external_catalogs: true
I20251025 08:02:32.919448 16286 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_64c962f064d64350a1fb6d539603c572" } modify_external_catalogs: true
I20251025 08:02:32.919898 17258 ts_tablet_manager.cc:1916] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.920074 16279 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_22425928df99434c8c133707c8a809ef" } modify_external_catalogs: true
I20251025 08:02:32.920157 16279 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_22425928df99434c8c133707c8a809ef" } modify_external_catalogs: true
I20251025 08:02:32.921053 17389 raft_consensus.cc:697] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:32.921167 17389 consensus_queue.cc:237] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.921399 17316 raft_consensus.cc:493] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.921469 17316 raft_consensus.cc:515] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.921752 17316 leader_election.cc:290] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:32.921813 17198 raft_consensus.cc:2272] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.922175 17198 ts_tablet_manager.cc:1916] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.922418 16282 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_a9afe52cc64243a295d043eb385ef7d9" } modify_external_catalogs: true
I20251025 08:02:32.922521 16282 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_a9afe52cc64243a295d043eb385ef7d9" } modify_external_catalogs: true
I20251025 08:02:32.923002 17194 log.cc:1199] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/6dd0f695a2904df5b750b45782a21ce2
I20251025 08:02:32.913645 14953 tablet_service.cc:1505] Processing CreateTablet for tablet 1e248b8303b1498e96178d4e46ad691e (DEFAULT_TABLE table=default.Table_64c962f064d64350a1fb6d539603c572 [id=766dd62ef84b4e56a871fbb018560a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:32.923281 17194 ts_tablet_manager.cc:1950] T 6dd0f695a2904df5b750b45782a21ce2 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.923370 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e248b8303b1498e96178d4e46ad691e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:32.925124 17194 tablet_replica.cc:333] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.925241 17194 raft_consensus.cc:2243] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.925402 17194 raft_consensus.cc:2272] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.925699 17194 ts_tablet_manager.cc:1916] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.926440 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 6dd0f695a2904df5b750b45782a21ce2 (table default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]) successfully deleted
W20251025 08:02:32.926602 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 446194cf013c4b6499deb00fab8db42a because the tablet was not found. No further retry: Not found: Tablet not found: 446194cf013c4b6499deb00fab8db42a
I20251025 08:02:32.926713 17258 ts_tablet_manager.cc:1929] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.926772 17258 log.cc:1199] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/31c9e3906dac487e8585daa13d3fe4b1
I20251025 08:02:32.926777 17198 ts_tablet_manager.cc:1929] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.926842 17198 log.cc:1199] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/d5cd481a98514f16bed3fb0bf5003526
I20251025 08:02:32.927017 17258 ts_tablet_manager.cc:1950] T 31c9e3906dac487e8585daa13d3fe4b1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.927116 17198 ts_tablet_manager.cc:1950] T d5cd481a98514f16bed3fb0bf5003526 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:32.927405 17198 tablet_replica.cc:333] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.927520 17198 raft_consensus.cc:2243] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.927589 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 31c9e3906dac487e8585daa13d3fe4b1 (table default.Table_035df9ac9f6541dd9b042857523d0659 [id=2c373de1732c4d18ad45968e90a65608]) successfully deleted
I20251025 08:02:32.927618 17198 raft_consensus.cc:2272] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.928112 17198 ts_tablet_manager.cc:1916] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.928622 17258 tablet_replica.cc:333] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.928741 17258 raft_consensus.cc:2243] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.928821 17258 raft_consensus.cc:2272] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.929132 17258 ts_tablet_manager.cc:1916] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.929774 17198 ts_tablet_manager.cc:1929] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:32.929827 17198 log.cc:1199] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/d162f3ee21bd40ce9a9c74b7863a3878
I20251025 08:02:32.930085 17198 ts_tablet_manager.cc:1950] T d162f3ee21bd40ce9a9c74b7863a3878 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:32.931402 17274 tablet_bootstrap.cc:492] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:32.931481 17274 ts_tablet_manager.cc:1403] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.000s
I20251025 08:02:32.931967 17274 raft_consensus.cc:359] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.932063 17274 raft_consensus.cc:385] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.932096 17274 raft_consensus.cc:740] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.932178 17274 consensus_queue.cc:260] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.932431 17274 ts_tablet_manager.cc:1434] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.932585 17274 tablet_bootstrap.cc:492] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:32.933627 17274 tablet_bootstrap.cc:654] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.934149 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16f1ab00a20345a1bb51e685b3fc6c70" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:32.935443 17194 ts_tablet_manager.cc:1929] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.936429 17258 ts_tablet_manager.cc:1929] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.936527 17194 log.cc:1199] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/ae3c8e134d164edd8781f27e7bdc3b92
I20251025 08:02:32.936779 17194 ts_tablet_manager.cc:1950] T ae3c8e134d164edd8781f27e7bdc3b92 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.937335 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet ae3c8e134d164edd8781f27e7bdc3b92 (table default.Table_67e95c34b6c44449abf8828cc3b6e9c2 [id=b0f029b25327468c94a2c78b37c6d203]) successfully deleted
I20251025 08:02:32.939249 17194 tablet_replica.cc:333] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.939513 17258 log.cc:1199] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/bea55cdfbf454d76920806886c3d2c4e
I20251025 08:02:32.939653 17194 raft_consensus.cc:2243] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.940022 17258 ts_tablet_manager.cc:1950] T bea55cdfbf454d76920806886c3d2c4e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.940215 17194 raft_consensus.cc:2272] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:32.937028 15185 leader_election.cc:343] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.941476 16282 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 5bf286568e8343b7921ac256a9313e63
I20251025 08:02:32.941115 17194 ts_tablet_manager.cc:1916] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.942018 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet bea55cdfbf454d76920806886c3d2c4e (table default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]) successfully deleted
I20251025 08:02:32.942144 16279 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 6a3ec64b273d4e8c92b1e24061ac7336
I20251025 08:02:32.942247 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 5bf286568e8343b7921ac256a9313e63 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.942991 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 6a3ec64b273d4e8c92b1e24061ac7336 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.943158 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 6a3ec64b273d4e8c92b1e24061ac7336 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
W20251025 08:02:32.943492 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet fba2914feb95475fbbfc5cef5a653408 because the tablet was not found. No further retry: Not found: Tablet not found: fba2914feb95475fbbfc5cef5a653408
I20251025 08:02:32.943516 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet 5bf286568e8343b7921ac256a9313e63 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.943683 17258 tablet_replica.cc:333] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.943823 17258 raft_consensus.cc:2243] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.944296 17198 tablet_replica.cc:333] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.944447 17198 raft_consensus.cc:2243] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.944559 17198 raft_consensus.cc:2272] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.944865 16279 master_service.cc:954] ReplaceTablet: received request to replace tablet 8362e26d86d44e9780d3c78c6a468556 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.944917 17198 ts_tablet_manager.cc:1916] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.945227 17194 ts_tablet_manager.cc:1929] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.945300 17194 log.cc:1199] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/e106f20977444dd4a49b6e4ae0f45380
I20251025 08:02:32.945533 17194 ts_tablet_manager.cc:1950] T e106f20977444dd4a49b6e4ae0f45380 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.945663 17258 raft_consensus.cc:2272] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.946233 17258 ts_tablet_manager.cc:1916] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.946799 17198 ts_tablet_manager.cc:1929] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:32.946906 17198 log.cc:1199] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/ea0d438e99864c57999abf3467edc643
I20251025 08:02:32.947273 17198 ts_tablet_manager.cc:1950] T ea0d438e99864c57999abf3467edc643 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:32.947599 17198 tablet_replica.cc:333] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:32.947867 17198 raft_consensus.cc:2243] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.948181 16279 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 8362e26d86d44e9780d3c78c6a468556
I20251025 08:02:32.948451 16279 catalog_manager.cc:6719] ReplaceTablet: tablet 8362e26d86d44e9780d3c78c6a468556 deleted and replaced by tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff
I20251025 08:02:32.948768 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 8362e26d86d44e9780d3c78c6a468556 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:32.948781 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet e106f20977444dd4a49b6e4ae0f45380 (table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]) successfully deleted
I20251025 08:02:32.949074 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet 8362e26d86d44e9780d3c78c6a468556 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:32.950064 17258 ts_tablet_manager.cc:1929] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.950294 17194 tablet_replica.cc:333] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.950378 17258 log.cc:1199] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/d709ecb9ac9a4525985c7d2bf10719f5
I20251025 08:02:32.950523 17194 raft_consensus.cc:2243] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.950814 17258 ts_tablet_manager.cc:1950] T d709ecb9ac9a4525985c7d2bf10719f5 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.950924 17194 raft_consensus.cc:2272] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.951269 17194 ts_tablet_manager.cc:1916] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.951928 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet d709ecb9ac9a4525985c7d2bf10719f5 (table default.Table_c6928dca846645b8887db36cc7cb9675 [id=9d1a6ae0121b45cda008d5dda6ea7e35]) successfully deleted
I20251025 08:02:32.952773 17258 tablet_replica.cc:333] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.952975 17258 raft_consensus.cc:2243] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.953100 17258 raft_consensus.cc:2272] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.954423 17258 ts_tablet_manager.cc:1916] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.955046 16279 master_service.cc:954] ReplaceTablet: received request to replace tablet d162f3ee21bd40ce9a9c74b7863a3878 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.955868 16279 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_49bbc2328aab41cda10e05a7fb925cd9" } new_table_name: "default.Table_236aa29f60b94e4d9c524ebb1051c3a8" modify_external_catalogs: true
W20251025 08:02:32.956863 15183 leader_election.cc:343] T 658a20d894c5444a820ce6bd33e4fdf0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:32.959410 17194 ts_tablet_manager.cc:1929] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.960721 17194 log.cc:1199] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/d5cd481a98514f16bed3fb0bf5003526
I20251025 08:02:32.961022 17194 ts_tablet_manager.cc:1950] T d5cd481a98514f16bed3fb0bf5003526 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.961603 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet d5cd481a98514f16bed3fb0bf5003526 (table default.Table_c52dec25e76a4fcea78b5514db2d8dce [id=a38b6f883f524f3cb829ce9a92bd7ef3]) successfully deleted
I20251025 08:02:32.962260 17530 tablet.cc:1722] T 7dd513b6c7a24dffb91f66c32acc7696 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.959282 17274 tablet_bootstrap.cc:492] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:32.963079 17274 ts_tablet_manager.cc:1403] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20251025 08:02:32.963320 17258 ts_tablet_manager.cc:1929] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.963541 17274 raft_consensus.cc:359] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.963642 17274 raft_consensus.cc:385] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:32.963675 17274 raft_consensus.cc:740] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:32.963778 17274 consensus_queue.cc:260] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.964043 17274 ts_tablet_manager.cc:1434] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:32.964188 17274 tablet_bootstrap.cc:492] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:32.965166 17274 tablet_bootstrap.cc:654] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:32.962865 17405 tablet.cc:1722] T 7dd513b6c7a24dffb91f66c32acc7696 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:32.965992 15048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.70.1:35401, user_credentials={real_user=slave}} blocked reactor thread for 51742us
I20251025 08:02:32.966483 14915 leader_election.cc:304] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:32.966737 17043 raft_consensus.cc:2749] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20251025 08:02:32.966892 17194 tablet_replica.cc:333] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.966989 17258 log.cc:1199] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/fc5f892ca7a246a28a556fe0eb3f5442
I20251025 08:02:32.967242 17258 ts_tablet_manager.cc:1950] T fc5f892ca7a246a28a556fe0eb3f5442 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.967396 17194 raft_consensus.cc:2243] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.967502 17194 raft_consensus.cc:2272] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.967828 17194 ts_tablet_manager.cc:1916] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.968473 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet fc5f892ca7a246a28a556fe0eb3f5442 (table default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b [id=4e47e7759fc64598807f1ee3a973820f]) successfully deleted
I20251025 08:02:32.969895 17258 tablet_replica.cc:333] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.970065 17258 raft_consensus.cc:2243] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.970199 17258 raft_consensus.cc:2272] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.976075 17258 ts_tablet_manager.cc:1916] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.978036 17258 ts_tablet_manager.cc:1929] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:32.978241 17194 ts_tablet_manager.cc:1929] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.978379 17194 log.cc:1199] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/a2b8efa8ed634583b7bf7cc91bfc61a3
I20251025 08:02:32.978498 16279 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet d14e12c45323420b84de06d828238caa (table default.Table_f435579c26e14e2cbb8da758499bfa19 [id=6b4ebc3c554648b48d6ea2f5916e1bad]). Expected version 2 got 1
I20251025 08:02:32.978798 17405 tablet.cc:1722] T f6082b299bb44d31b567f70d8da7f0ac P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.978925 17194 ts_tablet_manager.cc:1950] T a2b8efa8ed634583b7bf7cc91bfc61a3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.979154 16279 catalog_manager.cc:5649] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:32.979482 16279 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 7dd513b6c7a24dffb91f66c32acc7696 (table default.Table_236aa29f60b94e4d9c524ebb1051c3a8 [id=1338885c63014b47bcd512a9ddfaf31d]). Expected version 1 got 0
I20251025 08:02:32.979532 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet a2b8efa8ed634583b7bf7cc91bfc61a3 (table default.Table_c485105a684f427295b74968c29fd30c [id=3abb3c7d3dd74d408db083bf0499f679]) successfully deleted
I20251025 08:02:32.979707 16279 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet e967a52212164b8cb6f9c39f207024a1 (table default.Table_434df4d622c74c6f89f7b7373096fb5f [id=0a4629613477421ba329364dbb42a8b6]). Expected version 1 got 0
I20251025 08:02:32.979735 17194 tablet_replica.cc:333] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.979851 17194 raft_consensus.cc:2243] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.979924 16279 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 1019d033e1f24ab596309462cbeb9c73 (table default.Table_5e5050bacd5543229399a2924609ae9c [id=4644ba57f12f4ad4bf7e89f80c4cd161]). Expected version 1 got 0
I20251025 08:02:32.979943 17194 raft_consensus.cc:2272] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.980252 17194 ts_tablet_manager.cc:1916] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.980486 16279 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet f6082b299bb44d31b567f70d8da7f0ac (table default.Table_c5c036d7c66344eba94e15be432088bc [id=ebfa83131bd946d0897b32ef3c188c19]). Expected version 1 got 0
I20251025 08:02:32.980613 16279 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 86b1873446154249a80fa67b99496545 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]). Expected version 1 got 0
I20251025 08:02:32.980753 16279 catalog_manager.cc:5649] T 519f631918c144ff8edcfc7127ca23dc P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:32.980971 16279 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet d05bf0056dfc43eeb4105af559497bdc (table default.Table_3678577821c441b1bac4f3d9617e4d43 [id=72243e33e90940c09953a9ec2fcfd435]). Expected version 1 got 0
I20251025 08:02:32.981328 17258 log.cc:1199] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/bfdc6022cc5747439edcb8aa865b9437
I20251025 08:02:32.981323 16279 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet d81b65e094a34703ac47897d9bfa4c7c (table default.Table_e45046c48bb54111b38f009cc14efd2d [id=768625af4c474964ad2b502cf0b03fa7]). Expected version 1 got 0
I20251025 08:02:32.981633 17258 ts_tablet_manager.cc:1950] T bfdc6022cc5747439edcb8aa865b9437 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.980443 17530 tablet.cc:1722] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:32.982678 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet bfdc6022cc5747439edcb8aa865b9437 (table default.Table_5bc70f62257c438bb0c52926674f2bdf [id=e62c2aba4e5546e2bd881c5f2ae3abd4]) successfully deleted
W20251025 08:02:32.983143 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 98baf6e8d8e84b42a83054495ae19e01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98baf6e8d8e84b42a83054495ae19e01 already in progress: creating tablet
I20251025 08:02:32.983352 17258 tablet_replica.cc:333] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.983493 17258 raft_consensus.cc:2243] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.984143 16280 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_d0bdafcb33804ab48f880343784af6e0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:32.984218 17258 raft_consensus.cc:2272] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:32.984476 16280 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d0bdafcb33804ab48f880343784af6e0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:32.984946 17258 ts_tablet_manager.cc:1916] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.990336 17194 ts_tablet_manager.cc:1929] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.991542 17194 log.cc:1199] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/b41e092b7f40410a979bcfd5bbc7c225
I20251025 08:02:32.991863 17194 ts_tablet_manager.cc:1950] T b41e092b7f40410a979bcfd5bbc7c225 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:32.992504 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet b41e092b7f40410a979bcfd5bbc7c225 (table default.Table_e9a56ee98afd4b14bb77f82f256e8379 [id=7769118047914c3eb51e98a441aa5c50]) successfully deleted
I20251025 08:02:32.992712 17194 tablet_replica.cc:333] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:32.992978 17094 raft_consensus.cc:493] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:32.993048 17094 raft_consensus.cc:515] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:32.993330 17094 leader_election.cc:290] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:32.993700 16282 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_9419360c7ef742d196d6ac96f41241f1" } modify_external_catalogs: true
I20251025 08:02:32.993795 16282 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_9419360c7ef742d196d6ac96f41241f1" } modify_external_catalogs: true
I20251025 08:02:32.993552 17258 ts_tablet_manager.cc:1929] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:32.993930 17258 log.cc:1199] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/27d1e084fbdf43e2a1cc60fb6dfd194b
I20251025 08:02:32.994220 17258 ts_tablet_manager.cc:1950] T 27d1e084fbdf43e2a1cc60fb6dfd194b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:32.994758 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 27d1e084fbdf43e2a1cc60fb6dfd194b (table default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064]) successfully deleted
I20251025 08:02:32.993707 17194 raft_consensus.cc:2243] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:32.995074 17194 raft_consensus.cc:2272] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.995251 16280 master_service.cc:954] ReplaceTablet: received request to replace tablet 34c330b5dd544ae686f741cdd85d023d from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:32.995298 17258 tablet_replica.cc:333] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:32.995411 17258 raft_consensus.cc:2243] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:32.995487 17258 raft_consensus.cc:2272] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:32.995764 17258 ts_tablet_manager.cc:1916] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.996094 17194 ts_tablet_manager.cc:1916] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:32.997805 16283 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_0517aaafe6e64827b84bb99171d2ad75" } new_table_name: "default.Table_e7e4f555b1d140ef907741daae26ce2b" modify_external_catalogs: true
I20251025 08:02:32.999374 17258 ts_tablet_manager.cc:1929] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:32.999341 16280 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_6ae9d9f6f9b942e689eecb0548fdf715" } new_table_name: "default.Table_1d154c130315454cad4d9f3ea6bdd9b2" modify_external_catalogs: true
I20251025 08:02:33.000507 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_bf6a70d1926d4a9da3c3ee62f85bf2cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.000641 17194 ts_tablet_manager.cc:1929] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20251025 08:02:33.000797 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bf6a70d1926d4a9da3c3ee62f85bf2cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.001144 16285 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_75b0519af19a461d8dd5bdfd0c7a50c5" } modify_external_catalogs: true
I20251025 08:02:33.001251 16285 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_75b0519af19a461d8dd5bdfd0c7a50c5" } modify_external_catalogs: true
I20251025 08:02:33.000700 17194 log.cc:1199] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/fbae08a3a1c34dfda60b1985346e7761
I20251025 08:02:33.002310 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_42cdcbf9b2a0438b92ed7d428d482506"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.002497 17194 ts_tablet_manager.cc:1950] T fbae08a3a1c34dfda60b1985346e7761 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
W20251025 08:02:33.002583 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42cdcbf9b2a0438b92ed7d428d482506 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.003057 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet fbae08a3a1c34dfda60b1985346e7761 (table default.Table_a1c2dd3168ad45ffb213e55c47a2d0d3 [id=fb192136f9d9453a8d0aad2c1103118d]) successfully deleted
I20251025 08:02:33.003183 17258 log.cc:1199] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/93d383e3e2f4493d9cc8a71a4284e107
I20251025 08:02:33.003202 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_1af17555bf4d4cd480b16563fa2098e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.003427 17258 ts_tablet_manager.cc:1950] T 93d383e3e2f4493d9cc8a71a4284e107 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:33.003470 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1af17555bf4d4cd480b16563fa2098e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.003998 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 93d383e3e2f4493d9cc8a71a4284e107 (table default.Table_0ac9d6fdd08b48f0b70da65d5f7a722a [id=7c9a46c4cada46ad916b89605c18190f]) successfully deleted
I20251025 08:02:33.004190 17194 tablet_replica.cc:333] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.004324 17194 raft_consensus.cc:2243] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.004492 17194 raft_consensus.cc:2272] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.004812 17194 ts_tablet_manager.cc:1916] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.004822 17198 raft_consensus.cc:2272] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.005156 17198 ts_tablet_manager.cc:1916] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:33.005779 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 2d16499315044408ad4bc1dca6341ed5 because the tablet was not found. No further retry: Not found: Tablet not found: 2d16499315044408ad4bc1dca6341ed5
I20251025 08:02:33.006251 17258 tablet_replica.cc:333] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.006282 17415 raft_consensus.cc:493] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.006366 17258 raft_consensus.cc:2243] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.006353 17415 raft_consensus.cc:515] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.006659 17415 leader_election.cc:290] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.006524 17258 raft_consensus.cc:2272] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.007491 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77f04f445b5d47d2a78fdac0641a7372" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.007686 17415 raft_consensus.cc:493] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.007757 17415 raft_consensus.cc:515] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.007849 17258 ts_tablet_manager.cc:1916] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.008036 17415 leader_election.cc:290] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.008844 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8362e26d86d44e9780d3c78c6a468556" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.008993 15240 raft_consensus.cc:2393] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:33.010555 17194 ts_tablet_manager.cc:1929] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.010654 17194 log.cc:1199] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/080d77feb2a242959fb8e375f07e5a5f
I20251025 08:02:33.011226 17198 ts_tablet_manager.cc:1929] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.011408 17258 ts_tablet_manager.cc:1929] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.011701 17194 ts_tablet_manager.cc:1950] T 080d77feb2a242959fb8e375f07e5a5f P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.012382 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 080d77feb2a242959fb8e375f07e5a5f (table default.Table_4c672efab2bb448ab1dcfd4325e8c053 [id=0db3af0dc90e4ea5ac9a029e3864ce58]) successfully deleted
I20251025 08:02:33.012585 17194 tablet_replica.cc:333] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.012686 17258 log.cc:1199] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/e762c440cb0947deb7e6a4186deebdc1
I20251025 08:02:33.012949 17258 ts_tablet_manager.cc:1950] T e762c440cb0947deb7e6a4186deebdc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.013106 17194 raft_consensus.cc:2243] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.013218 17194 raft_consensus.cc:2272] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.013559 17194 ts_tablet_manager.cc:1916] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.014401 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet e762c440cb0947deb7e6a4186deebdc1 (table default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]) successfully deleted
I20251025 08:02:33.014588 17258 tablet_replica.cc:333] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.015528 17258 raft_consensus.cc:2243] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.015726 17258 raft_consensus.cc:2272] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.016528 17258 ts_tablet_manager.cc:1916] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:33.016604 16283 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed2036a8ebd74ab18c0bbd6d9aa67ef0 consensus state has no leader
I20251025 08:02:33.016813 16283 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_2942acd29f7c42ceb19355a101b68dd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.017074 16283 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2942acd29f7c42ceb19355a101b68dd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.018357 17274 tablet_bootstrap.cc:492] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.018486 17274 ts_tablet_manager.cc:1403] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.000s
I20251025 08:02:33.018968 17274 raft_consensus.cc:359] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.019064 17274 raft_consensus.cc:385] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.019101 17274 raft_consensus.cc:740] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.019227 17274 consensus_queue.cc:260] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.019337 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_7a0da42c26a9414996eb1aeaea64f82d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.019434 17194 ts_tablet_manager.cc:1929] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.019493 17194 log.cc:1199] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/43da3f4fc9604562a95dff59da3c574b
I20251025 08:02:33.019500 17274 ts_tablet_manager.cc:1434] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20251025 08:02:33.019613 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a0da42c26a9414996eb1aeaea64f82d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.019659 17274 tablet_bootstrap.cc:492] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.020610 17274 tablet_bootstrap.cc:654] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.020814 17194 ts_tablet_manager.cc:1950] T 43da3f4fc9604562a95dff59da3c574b P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.021358 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 43da3f4fc9604562a95dff59da3c574b (table default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031]) successfully deleted
I20251025 08:02:33.021822 17258 ts_tablet_manager.cc:1929] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.021929 17198 log.cc:1199] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/60c49b70f8f44dd3aec433206b897843
I20251025 08:02:33.022236 17198 ts_tablet_manager.cc:1950] T 60c49b70f8f44dd3aec433206b897843 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:33.022506 17258 log.cc:1199] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/f814b8ab1c9747e4b7da69f0ef4f2eb4
I20251025 08:02:33.022584 17194 tablet_replica.cc:333] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.022853 17258 ts_tablet_manager.cc:1950] T f814b8ab1c9747e4b7da69f0ef4f2eb4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.023015 17194 raft_consensus.cc:2243] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.023195 17194 raft_consensus.cc:2272] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.023743 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 (table default.Table_9f939300bcf646508b4f05ea510f6679 [id=0db02c1368044d17ba62f03bf3aac5d2]) successfully deleted
I20251025 08:02:33.024169 17194 ts_tablet_manager.cc:1916] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.024304 17258 tablet_replica.cc:333] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.024451 16282 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 16f1ab00a20345a1bb51e685b3fc6c70
I20251025 08:02:33.024833 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet 16f1ab00a20345a1bb51e685b3fc6c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.025957 17198 tablet_replica.cc:333] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:33.026032 17194 ts_tablet_manager.cc:1929] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.025235 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 16f1ab00a20345a1bb51e685b3fc6c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.026106 17198 raft_consensus.cc:2243] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.026300 17258 raft_consensus.cc:2243] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.026343 17198 raft_consensus.cc:2272] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.026499 17258 raft_consensus.cc:2272] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.026757 17198 ts_tablet_manager.cc:1916] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.026825 17258 ts_tablet_manager.cc:1916] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.028605 17258 ts_tablet_manager.cc:1929] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.028720 17198 ts_tablet_manager.cc:1929] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.028795 17198 log.cc:1199] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/a2b8efa8ed634583b7bf7cc91bfc61a3
I20251025 08:02:33.029039 17194 log.cc:1199] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/d993e2350f37492bb712d145d03e8afb
I20251025 08:02:33.029081 17198 ts_tablet_manager.cc:1950] T a2b8efa8ed634583b7bf7cc91bfc61a3 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:33.029336 17194 ts_tablet_manager.cc:1950] T d993e2350f37492bb712d145d03e8afb P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.029574 17198 tablet_replica.cc:333] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:33.029701 17198 raft_consensus.cc:2243] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.029816 17198 raft_consensus.cc:2272] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.030071 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet d993e2350f37492bb712d145d03e8afb (table default.Table_1ccbe630ac5a41ecb7b00087172bec38 [id=1e716be545914b22887b2f7e069c41c4]) successfully deleted
I20251025 08:02:33.030166 17198 ts_tablet_manager.cc:1916] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.030352 17194 tablet_replica.cc:333] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.030437 17258 log.cc:1199] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/6cedb44483cf4f62acf52b90b6708dfb
I20251025 08:02:33.030701 17258 ts_tablet_manager.cc:1950] T 6cedb44483cf4f62acf52b90b6708dfb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.030843 17194 raft_consensus.cc:2243] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.030972 17194 raft_consensus.cc:2272] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.031667 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 6cedb44483cf4f62acf52b90b6708dfb (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]) successfully deleted
I20251025 08:02:33.032032 17194 ts_tablet_manager.cc:1916] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:33.032490 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 1ab6b9d8278045ae92043ada5ce6dd71 because the tablet was not found. No further retry: Not found: Tablet not found: 1ab6b9d8278045ae92043ada5ce6dd71
I20251025 08:02:33.034250 17194 ts_tablet_manager.cc:1929] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.034387 17258 tablet_replica.cc:333] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.034515 17258 raft_consensus.cc:2243] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.034653 17258 raft_consensus.cc:2272] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.035171 17258 ts_tablet_manager.cc:1916] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.036689 17194 log.cc:1199] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/73cdd9616b9c460f8fcd4a40e4a3ccc8
I20251025 08:02:33.036942 17194 ts_tablet_manager.cc:1950] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.037567 17258 ts_tablet_manager.cc:1929] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.038434 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 (table default.Table_05bac665c2114dacac7804da6adfc06e [id=9aee333b5b9f4e1daba6449f643ea43a]) successfully deleted
W20251025 08:02:33.038849 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet a40c5721a4304345b471960ed1691930 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a40c5721a4304345b471960ed1691930 already in progress: creating tablet
I20251025 08:02:33.039022 17258 log.cc:1199] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/cfe9add2f8bf450bb6f49ad57be2caae
I20251025 08:02:33.039301 17258 ts_tablet_manager.cc:1950] T cfe9add2f8bf450bb6f49ad57be2caae P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.039440 17194 tablet_replica.cc:333] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.039593 17194 raft_consensus.cc:2243] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.040179 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet cfe9add2f8bf450bb6f49ad57be2caae (table default.Table_035b154aa0234ef38415962cb9359b93 [id=184e7b89a0ad431f87984b6d6619058e]) successfully deleted
I20251025 08:02:33.040352 17194 pending_rounds.cc:70] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:33.040405 17194 pending_rounds.cc:77] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609827020394496 op_type: NO_OP noop_request { }
I20251025 08:02:33.040475 17194 raft_consensus.cc:2889] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:33.040557 17194 raft_consensus.cc:2272] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.040741 17258 tablet_replica.cc:333] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.040894 17258 raft_consensus.cc:2243] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.041033 17258 raft_consensus.cc:2272] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.041361 17258 ts_tablet_manager.cc:1916] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.043848 16286 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 1e248b8303b1498e96178d4e46ad691e
I20251025 08:02:33.044303 17530 tablet.cc:1722] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.044796 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 1e248b8303b1498e96178d4e46ad691e (DEFAULT_TABLE table=default.Table_64c962f064d64350a1fb6d539603c572 [id=766dd62ef84b4e56a871fbb018560a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.045025 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e248b8303b1498e96178d4e46ad691e. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:33.046561 15183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.70.1:35401, user_credentials={real_user=slave}} blocked reactor thread for 90047.8us
I20251025 08:02:33.046744 15183 leader_election.cc:304] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:33.047078 17373 raft_consensus.cc:2804] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.047127 17373 raft_consensus.cc:493] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.047163 17373 raft_consensus.cc:3060] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.047277 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f3f42babc0b2421fa80b265997effe36" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.047397 14978 raft_consensus.cc:2393] T f3f42babc0b2421fa80b265997effe36 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:33.048041 17373 raft_consensus.cc:515] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.048108 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "736f75f26af142e59e7996c2ebb80868" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.048187 14974 raft_consensus.cc:2468] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:33.048349 17373 leader_election.cc:290] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.049032 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet 1e248b8303b1498e96178d4e46ad691e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.049060 14978 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "45a22457031a4eff8e82fa232b6f05bb" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.049086 14953 tablet_service.cc:1505] Processing CreateTablet for tablet c8bc7a0419e84a19a0349d0b7d63f174 (DEFAULT_TABLE table=default.Table_501f3c298af041b9aec232c1957e77eb [id=4181639020fe4f83885a3cbc37909477]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.049341 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8bc7a0419e84a19a0349d0b7d63f174. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.051941 14971 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "736f75f26af142e59e7996c2ebb80868" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:33.052039 14971 raft_consensus.cc:3060] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.052104 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed2036a8ebd74ab18c0bbd6d9aa67ef0" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:33.052207 15107 raft_consensus.cc:3060] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.052945 14971 raft_consensus.cc:2468] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:33.053109 14972 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "16f1ab00a20345a1bb51e685b3fc6c70" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.053299 15107 raft_consensus.cc:2468] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:33.054275 14970 raft_consensus.cc:3060] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.055012 17405 tablet.cc:1722] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.055387 14969 raft_consensus.cc:3060] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.057163 15225 tablet_service.cc:1505] Processing CreateTablet for tablet c8bc7a0419e84a19a0349d0b7d63f174 (DEFAULT_TABLE table=default.Table_501f3c298af041b9aec232c1957e77eb [id=4181639020fe4f83885a3cbc37909477]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.057397 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8bc7a0419e84a19a0349d0b7d63f174. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.059065 15185 leader_election.cc:304] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.059325 16572 raft_consensus.cc:2804] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.059401 16572 raft_consensus.cc:697] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:33.059546 16572 consensus_queue.cc:237] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.062623 16285 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet f5f72ca8cfb94178a21619ddc9fc0352
I20251025 08:02:33.062594 17405 tablet.cc:1722] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.064369 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet f5f72ca8cfb94178a21619ddc9fc0352 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.065399 16281 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_400420f05a7a4b4b931b7009853a9f10 [id=c2a7a02e46184b638b19f9a95da2eda8] alter complete (version 1)
I20251025 08:02:33.066388 17369 consensus_queue.cc:1048] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.071393 14976 raft_consensus.cc:3060] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.073689 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 1e248b8303b1498e96178d4e46ad691e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.074131 16390 tablet_bootstrap.cc:492] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:33.074244 16390 ts_tablet_manager.cc:1403] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.215s user 0.002s sys 0.000s
I20251025 08:02:33.074167 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5f72ca8cfb94178a21619ddc9fc0352" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:33.074709 16390 raft_consensus.cc:359] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.074798 16390 raft_consensus.cc:385] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.074831 16390 raft_consensus.cc:740] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.074939 16390 consensus_queue.cc:260] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.075230 16390 ts_tablet_manager.cc:1434] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.075373 16390 tablet_bootstrap.cc:492] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:33.076396 16390 tablet_bootstrap.cc:654] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.077556 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_51597e88f32f4306a7ede83a03bf7670"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.077877 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51597e88f32f4306a7ede83a03bf7670 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.078020 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet f5f72ca8cfb94178a21619ddc9fc0352 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.078686 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5e907ec8e7c420d8d6d68a954cc8beb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.078738 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet a3379087113041beba7ddbc6596c3b0a (table default.Table_a05736b7077d457181534fd09c3a1946 [id=54160b89eff147188297e5017eaec741]) successfully deleted
I20251025 08:02:33.080713 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_b9fd1eb722b44b99bb445efa0d2bfc72"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.080916 16391 tablet_bootstrap.cc:492] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
W20251025 08:02:33.080994 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b9fd1eb722b44b99bb445efa0d2bfc72 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.081005 16391 ts_tablet_manager.cc:1403] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.212s user 0.001s sys 0.000s
I20251025 08:02:33.081436 16391 raft_consensus.cc:359] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.081534 16391 raft_consensus.cc:385] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.081565 16391 raft_consensus.cc:740] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.081670 16391 consensus_queue.cc:260] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.081959 16391 ts_tablet_manager.cc:1434] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.082124 16391 tablet_bootstrap.cc:492] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.082422 16283 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_6c09057554af4ae3aaff0255f8bfc04a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.082739 16283 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c09057554af4ae3aaff0255f8bfc04a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.082790 17258 ts_tablet_manager.cc:1929] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.082862 17258 log.cc:1199] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/a3379087113041beba7ddbc6596c3b0a
I20251025 08:02:33.083222 16391 tablet_bootstrap.cc:654] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.083235 17373 raft_consensus.cc:493] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.083303 17373 raft_consensus.cc:515] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.083613 17373 leader_election.cc:290] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.083994 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ddb3795876b486e992b58cea711afb3" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
W20251025 08:02:33.084343 15185 leader_election.cc:343] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.084148 17539 raft_consensus.cc:493] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.084501 17539 raft_consensus.cc:515] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.090027 17258 ts_tablet_manager.cc:1950] T a3379087113041beba7ddbc6596c3b0a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.090592 17539 leader_election.cc:290] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.090626 16282 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_2f3a2a53312142a797c57248d8d2ad48" } new_table_name: "default.Table_8527e07298754b1ab5eefd758ff1fe70" modify_external_catalogs: true
I20251025 08:02:33.091167 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet a3379087113041beba7ddbc6596c3b0a (table default.Table_a05736b7077d457181534fd09c3a1946 [id=54160b89eff147188297e5017eaec741]) successfully deleted
I20251025 08:02:33.091379 17258 tablet_replica.cc:333] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.091547 17258 raft_consensus.cc:2243] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.091750 17258 raft_consensus.cc:2272] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.091920 17373 raft_consensus.cc:493] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.091993 17373 raft_consensus.cc:515] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.092284 17373 leader_election.cc:290] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.092643 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95030a851b5d4155b235a4e896250c80" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.092756 15107 raft_consensus.cc:2468] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:33.093025 15185 leader_election.cc:304] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.093240 17373 raft_consensus.cc:2804] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.093284 17373 raft_consensus.cc:493] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.093320 17373 raft_consensus.cc:3060] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.094215 17373 raft_consensus.cc:515] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.094519 17373 leader_election.cc:290] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.094964 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95030a851b5d4155b235a4e896250c80" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:33.095081 15107 raft_consensus.cc:3060] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.095053 16283 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_2d148de11ab3450e916c806c1f900a96" } new_table_name: "default.Table_1c42bf37d0434552a8f4ffe93d29d77a" modify_external_catalogs: true
I20251025 08:02:33.096043 15107 raft_consensus.cc:2468] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:33.096450 16285 master_service.cc:954] ReplaceTablet: received request to replace tablet 8b6ae6527fd64c3bb5999dec97db861d from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.099001 15185 leader_election.cc:304] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.099292 17369 raft_consensus.cc:2804] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.099361 17369 raft_consensus.cc:697] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:33.099460 17369 consensus_queue.cc:237] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:33.100409 17548 consensus_queue.cc:1175] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ab02c9d78a9d42f193755d436c8d44b2" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20251025 08:02:33.101604 17274 tablet_bootstrap.cc:492] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.101698 17274 ts_tablet_manager.cc:1403] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.082s user 0.002s sys 0.000s
I20251025 08:02:33.102221 17274 raft_consensus.cc:359] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.102329 17274 raft_consensus.cc:385] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.102365 17274 raft_consensus.cc:740] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.102478 17274 consensus_queue.cc:260] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.102738 17274 ts_tablet_manager.cc:1434] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:33.102739 17194 ts_tablet_manager.cc:1916] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.102918 17274 tablet_bootstrap.cc:492] T dafad70d3f69440c9d42e8ee73123d2d P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.103871 17274 tablet_bootstrap.cc:654] T dafad70d3f69440c9d42e8ee73123d2d P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.103919 16285 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 8b6ae6527fd64c3bb5999dec97db861d
I20251025 08:02:33.104223 16285 catalog_manager.cc:6719] ReplaceTablet: tablet 8b6ae6527fd64c3bb5999dec97db861d deleted and replaced by tablet 774988b980d8474e9b41518410c5dc9b
I20251025 08:02:33.104511 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 8b6ae6527fd64c3bb5999dec97db861d with delete_type TABLET_DATA_DELETED (replaced by tablet 774988b980d8474e9b41518410c5dc9b) from {username='slave'} at 127.0.0.1:42704
W20251025 08:02:33.104985 16283 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b826067888164df0af7da797d42c0862 has no consensus state
W20251025 08:02:33.105507 16282 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fc62afd62257471e8590d28e49a50cb2 consensus state has no leader
I20251025 08:02:33.105654 17194 ts_tablet_manager.cc:1929] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.105746 17194 log.cc:1199] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/c043ab70d7364e05b0b352ac5c416db1
I20251025 08:02:33.106041 17194 ts_tablet_manager.cc:1950] T c043ab70d7364e05b0b352ac5c416db1 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.106307 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet 8b6ae6527fd64c3bb5999dec97db861d with delete_type TABLET_DATA_DELETED (replaced by tablet 774988b980d8474e9b41518410c5dc9b) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.107776 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet c043ab70d7364e05b0b352ac5c416db1 (table default.Table_21b4f92893424716afe86f9c67b6a691 [id=db6654cc26a348709c7f0577b91f18af]) successfully deleted
I20251025 08:02:33.108014 17194 tablet_replica.cc:333] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.108194 17194 raft_consensus.cc:2243] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.108320 17194 raft_consensus.cc:2272] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.108850 17194 ts_tablet_manager.cc:1916] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.110304 17415 raft_consensus.cc:493] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.110389 17415 raft_consensus.cc:515] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.110707 17415 leader_election.cc:290] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.111701 17194 ts_tablet_manager.cc:1929] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.112506 17194 log.cc:1199] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/6d1979a4f43a4659976b0cd6d1b888ef
I20251025 08:02:33.114320 16282 master_service.cc:954] ReplaceTablet: received request to replace tablet ed5ed91e953d42afa9ebf9ab8b89d0e6 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.114580 17258 ts_tablet_manager.cc:1916] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.115286 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82b93b7537c047aea430658ae2c2654b" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.115407 15240 raft_consensus.cc:2393] T 82b93b7537c047aea430658ae2c2654b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:33.116688 16390 tablet_bootstrap.cc:492] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:33.116772 16390 ts_tablet_manager.cc:1403] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.000s
I20251025 08:02:33.117712 16390 raft_consensus.cc:359] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.118459 16390 raft_consensus.cc:385] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.118556 16390 raft_consensus.cc:740] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.118734 16390 consensus_queue.cc:260] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.119081 16390 ts_tablet_manager.cc:1434] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:33.119129 17530 tablet.cc:1722] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.119840 17274 tablet_bootstrap.cc:492] T dafad70d3f69440c9d42e8ee73123d2d P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.119926 17274 ts_tablet_manager.cc:1403] T dafad70d3f69440c9d42e8ee73123d2d P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20251025 08:02:33.120316 17405 tablet.cc:1722] T d81b65e094a34703ac47897d9bfa4c7c P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.120361 17274 raft_consensus.cc:359] T dafad70d3f69440c9d42e8ee73123d2d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.120442 17274 raft_consensus.cc:385] T dafad70d3f69440c9d42e8ee73123d2d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.120471 17274 raft_consensus.cc:740] T dafad70d3f69440c9d42e8ee73123d2d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.120563 17274 consensus_queue.cc:260] T dafad70d3f69440c9d42e8ee73123d2d P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.120842 17274 ts_tablet_manager.cc:1434] T dafad70d3f69440c9d42e8ee73123d2d P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.121026 17274 tablet_bootstrap.cc:492] T ff15c6e28a794271ac61ca111d66a06e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.121938 17274 tablet_bootstrap.cc:654] T ff15c6e28a794271ac61ca111d66a06e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.122408 16282 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet ed5ed91e953d42afa9ebf9ab8b89d0e6
I20251025 08:02:33.122815 16282 catalog_manager.cc:6719] ReplaceTablet: tablet ed5ed91e953d42afa9ebf9ab8b89d0e6 deleted and replaced by tablet 32ef1622f95f497ba839271dacf29841
I20251025 08:02:33.122944 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet ed5ed91e953d42afa9ebf9ab8b89d0e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 32ef1622f95f497ba839271dacf29841) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.124464 16390 tablet_bootstrap.cc:492] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:33.125389 16390 tablet_bootstrap.cc:654] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.126829 15088 tablet_service.cc:1505] Processing CreateTablet for tablet fc62afd62257471e8590d28e49a50cb2 (DEFAULT_TABLE table=default.Table_2f3a2a53312142a797c57248d8d2ad48 [id=f317f6ac536c45beb5e90ab9bd55ebe7]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.126897 15082 tablet_service.cc:1505] Processing CreateTablet for tablet 3cac2ac7463944549b5d235ed2e5a480 (DEFAULT_TABLE table=default.Table_0e6c61f9e83f4f7db9789897a5016f7c [id=4e2fede2a3ad4c80b68f74b9ef40b72b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.127045 15086 tablet_service.cc:1552] Processing DeleteTablet for tablet 1927cf6a9013402a92c9e6e89e2e1715 with delete_type TABLET_DATA_DELETED (replaced by tablet 4826826d19fd421a9d04eac17a79a9fb) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.127094 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc62afd62257471e8590d28e49a50cb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.127401 15085 tablet_service.cc:1505] Processing CreateTablet for tablet 5027b80220e34f5f8e1e8e8479ec41f3 (DEFAULT_TABLE table=default.Table_2723d06acdad494093ca794f37a40c63 [id=ce13cf6cceec4f6bb1cb22d48b226256]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.127456 15086 tablet_service.cc:1505] Processing CreateTablet for tablet 1e248b8303b1498e96178d4e46ad691e (DEFAULT_TABLE table=default.Table_64c962f064d64350a1fb6d539603c572 [id=766dd62ef84b4e56a871fbb018560a9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.127811 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5027b80220e34f5f8e1e8e8479ec41f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.127925 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet 5bf286568e8343b7921ac256a9313e63 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.128813 16282 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_2eae5b9e44bc40acafb6a647bed4a4d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.129112 15083 tablet_service.cc:1505] Processing CreateTablet for tablet 2a4b060efd054726b07702b691876147 (DEFAULT_TABLE table=default.Table_5f10743381924d79a2225fed0b5db70f [id=846c344408284b8e8a0e5da1d328255d]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:33.129216 16282 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2eae5b9e44bc40acafb6a647bed4a4d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.129304 15083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a4b060efd054726b07702b691876147. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.130659 15086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e248b8303b1498e96178d4e46ad691e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.125293 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet d5cd481a98514f16bed3fb0bf5003526 (table default.Table_c52dec25e76a4fcea78b5514db2d8dce [id=a38b6f883f524f3cb829ce9a92bd7ef3]) successfully deleted
I20251025 08:02:33.130972 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet d162f3ee21bd40ce9a9c74b7863a3878 (table default.Table_a6c6f65ea3444858aa562a65d71c4e77 [id=2ef2d72066f446619f9045da34df7814]) successfully deleted
I20251025 08:02:33.131070 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet ea0d438e99864c57999abf3467edc643 (table default.Table_3c48d3160e5d42509de4f0be1af855e2 [id=912da5ef8bbf4af29528c084ea7fa633]) successfully deleted
I20251025 08:02:33.131202 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 6a3ec64b273d4e8c92b1e24061ac7336 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.131306 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 8362e26d86d44e9780d3c78c6a468556 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.131412 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 16f1ab00a20345a1bb51e685b3fc6c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.132615 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cac2ac7463944549b5d235ed2e5a480. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.136986 17198 ts_tablet_manager.cc:1929] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.137089 17198 log.cc:1199] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/93d383e3e2f4493d9cc8a71a4284e107
I20251025 08:02:33.137378 17198 ts_tablet_manager.cc:1950] T 93d383e3e2f4493d9cc8a71a4284e107 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:33.137853 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 45) took 1004 ms. Trace:
I20251025 08:02:33.137944 17198 rpcz_store.cc:276] 1025 08:02:32.133515 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.141677 (+ 8162us) service_pool.cc:225] Handling call
1025 08:02:33.029548 (+887871us) ts_tablet_manager.cc:1151] Deleting tablet 93d383e3e2f4493d9cc8a71a4284e107
1025 08:02:33.029554 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:33.135892 (+106338us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:33.136939 (+ 1047us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:33.137841 (+ 902us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":887787}
I20251025 08:02:33.138454 17198 tablet_replica.cc:333] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:33.138602 17198 raft_consensus.cc:2243] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.138722 17198 raft_consensus.cc:2272] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.139106 17198 ts_tablet_manager.cc:1916] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.140758 17198 ts_tablet_manager.cc:1929] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.140897 16572 consensus_queue.cc:1048] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.142941 16282 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_b9669fd414104dcca80167117a5b0ed7" } modify_external_catalogs: true
I20251025 08:02:33.143646 16283 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_c72833b153cc441eaeff12a70a584954" } modify_external_catalogs: true
I20251025 08:02:33.143847 16283 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_c72833b153cc441eaeff12a70a584954" } modify_external_catalogs: true
I20251025 08:02:33.144506 16282 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_b9669fd414104dcca80167117a5b0ed7" } modify_external_catalogs: true
I20251025 08:02:33.148497 17258 ts_tablet_manager.cc:1929] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.123471 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet ed5ed91e953d42afa9ebf9ab8b89d0e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 32ef1622f95f497ba839271dacf29841) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.148937 17194 ts_tablet_manager.cc:1950] T 6d1979a4f43a4659976b0cd6d1b888ef P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.152733 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 6d1979a4f43a4659976b0cd6d1b888ef (table default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95]) successfully deleted
I20251025 08:02:33.148535 16390 tablet_bootstrap.cc:492] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:33.151479 15242 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f5f72ca8cfb94178a21619ddc9fc0352" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:33.154997 16390 ts_tablet_manager.cc:1403] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.031s user 0.002s sys 0.000s
I20251025 08:02:33.155067 15242 raft_consensus.cc:3060] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.155555 16390 raft_consensus.cc:359] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.155678 16390 raft_consensus.cc:385] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.155735 16390 raft_consensus.cc:740] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.155860 16390 consensus_queue.cc:260] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.156011 15242 raft_consensus.cc:2468] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:33.152663 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5e907ec8e7c420d8d6d68a954cc8beb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.156188 15238 raft_consensus.cc:2468] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:33.153311 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed2036a8ebd74ab18c0bbd6d9aa67ef0" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.156352 16390 ts_tablet_manager.cc:1434] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.154603 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95030a851b5d4155b235a4e896250c80" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.153532 17530 tablet.cc:1722] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.156514 16390 tablet_bootstrap.cc:492] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:33.157415 16390 tablet_bootstrap.cc:654] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.157984 17258 log.cc:1199] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/4edf680e8d4a4b898fd6e64f8ec6f75d
I20251025 08:02:33.158259 17258 ts_tablet_manager.cc:1950] T 4edf680e8d4a4b898fd6e64f8ec6f75d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:33.160377 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet a40c5721a4304345b471960ed1691930 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a40c5721a4304345b471960ed1691930 already in progress: creating tablet
I20251025 08:02:33.160385 16285 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_b1a5d2a17d6949d8b97b1aa02de7a9e7" } new_table_name: "default.Table_3cb2ab7a99584877a1e8c650a29489db" modify_external_catalogs: true
I20251025 08:02:33.162863 17194 tablet_replica.cc:333] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.163004 17194 raft_consensus.cc:2243] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
W20251025 08:02:33.164462 16285 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d6243825ae7b4307b5789aaee2473edc has no consensus state
I20251025 08:02:33.165832 17194 raft_consensus.cc:2272] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.166149 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 4edf680e8d4a4b898fd6e64f8ec6f75d (table default.Table_219931bbd7ec46f7bee6b90d2c3145ae [id=f6339e86106447c0a9ece99d596ae0e4]) successfully deleted
I20251025 08:02:33.166602 17194 ts_tablet_manager.cc:1916] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.166766 17258 tablet_replica.cc:333] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.166914 17258 raft_consensus.cc:2243] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.167299 17258 raft_consensus.cc:2272] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.169348 16285 master_service.cc:954] ReplaceTablet: received request to replace tablet f8576553f17b49f8bd11436ecac471ed from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.169728 17258 ts_tablet_manager.cc:1916] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.173343 16287 master_service.cc:954] ReplaceTablet: received request to replace tablet 54de7e83e8ea42ef93218b0204c61ec6 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.174535 16285 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet f8576553f17b49f8bd11436ecac471ed
I20251025 08:02:33.174796 16285 catalog_manager.cc:6719] ReplaceTablet: tablet f8576553f17b49f8bd11436ecac471ed deleted and replaced by tablet 61c8a83c2146418184842b7d7dd594fa
I20251025 08:02:33.175243 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet f8576553f17b49f8bd11436ecac471ed with delete_type TABLET_DATA_DELETED (replaced by tablet 61c8a83c2146418184842b7d7dd594fa) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.175499 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet f8576553f17b49f8bd11436ecac471ed with delete_type TABLET_DATA_DELETED (replaced by tablet 61c8a83c2146418184842b7d7dd594fa) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.175954 17258 ts_tablet_manager.cc:1929] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.180410 16287 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 54de7e83e8ea42ef93218b0204c61ec6
I20251025 08:02:33.180428 17194 ts_tablet_manager.cc:1929] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:33.180650 16287 catalog_manager.cc:6719] ReplaceTablet: tablet 54de7e83e8ea42ef93218b0204c61ec6 deleted and replaced by tablet 6ae883acfacf451495ae73e1e813ec71
I20251025 08:02:33.180800 17194 log.cc:1199] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/997c8c5921ad4ec18914fd50c97fc33e
I20251025 08:02:33.179075 16390 tablet_bootstrap.cc:492] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:33.181203 16390 ts_tablet_manager.cc:1403] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20251025 08:02:33.181290 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet 54de7e83e8ea42ef93218b0204c61ec6 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ae883acfacf451495ae73e1e813ec71) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.181612 16390 raft_consensus.cc:359] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.181691 16390 raft_consensus.cc:385] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.181716 16390 raft_consensus.cc:740] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.181813 16390 consensus_queue.cc:260] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.182051 16390 ts_tablet_manager.cc:1434] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.182222 16390 tablet_bootstrap.cc:492] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:33.183178 16390 tablet_bootstrap.cc:654] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.183557 17369 raft_consensus.cc:493] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.183622 17369 raft_consensus.cc:515] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.183898 17369 leader_election.cc:290] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.181063 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 54de7e83e8ea42ef93218b0204c61ec6 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ae883acfacf451495ae73e1e813ec71) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.184706 17258 log.cc:1199] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/7e90c358ef454760b8317d78724ee377
I20251025 08:02:33.184940 17194 ts_tablet_manager.cc:1950] T 997c8c5921ad4ec18914fd50c97fc33e P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.185205 17258 ts_tablet_manager.cc:1950] T 7e90c358ef454760b8317d78724ee377 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.186084 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 997c8c5921ad4ec18914fd50c97fc33e (table default.Table_56b69a1e3b4d4e7dbaa6a4697a940880 [id=cb9294ed7c474aae989ac13159ec3166]) successfully deleted
I20251025 08:02:33.188031 17369 raft_consensus.cc:493] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.188100 17369 raft_consensus.cc:515] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.188349 17369 leader_election.cc:290] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.190073 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 7e90c358ef454760b8317d78724ee377 (table default.Table_05fb668587d14b6c8f3a12bb75fa1423 [id=2bee387e0d87487a8652689103a57438]) successfully deleted
I20251025 08:02:33.190569 17194 tablet_replica.cc:333] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.190701 17258 tablet_replica.cc:333] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.190899 17194 raft_consensus.cc:2243] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.191852 17194 raft_consensus.cc:2272] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.191951 17258 raft_consensus.cc:2243] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.192080 17258 raft_consensus.cc:2272] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.192447 17194 ts_tablet_manager.cc:1916] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.192780 17258 ts_tablet_manager.cc:1916] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.193390 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_c53c1ae65b3a4ca1bd5646d90cf626e9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.193753 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c53c1ae65b3a4ca1bd5646d90cf626e9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.194775 17258 ts_tablet_manager.cc:1929] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.206498 16285 master_service.cc:954] ReplaceTablet: received request to replace tablet e2b014e0f49c4f7da8e65b7d4c98ea63 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.199421 14947 tablet_service.cc:1505] Processing CreateTablet for tablet 334015a0a5aa42c8b127d64e794c2705 (DEFAULT_TABLE table=default.Table_34881ec032724dac94217f71be36dd45 [id=7a1037f752964f4297e98d6179eee165]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.208796 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334015a0a5aa42c8b127d64e794c2705. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.199997 14952 tablet_service.cc:1505] Processing CreateTablet for tablet f1c15457dfac48e3a33de5a9c3d6f1f1 (DEFAULT_TABLE table=default.Table_42cdcbf9b2a0438b92ed7d428d482506 [id=7a5de3149f6545a680efc1df204128ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.200232 14944 tablet_service.cc:1505] Processing CreateTablet for tablet cb2a4db00068482fb8d3b5313017e035 (DEFAULT_TABLE table=default.Table_24a3fc5c42d441fab7d881fb258a0ddb [id=866f01db50274ea29407f759600aff90]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.200451 14942 tablet_service.cc:1505] Processing CreateTablet for tablet 2c614480578945839a6662bafc62726c (DEFAULT_TABLE table=default.Table_bd4d865a11f940b183fb4f06cd4da881 [id=b080141fd09a489da6324d45421c2fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.200626 14943 tablet_service.cc:1505] Processing CreateTablet for tablet 0f141107d4674690acd51e499bc4e208 (DEFAULT_TABLE table=default.Table_9ba393cca8d548bcb6a5b34c49969893 [id=ee49c87b7ddc47f28029112a49b5665b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.200805 14948 tablet_service.cc:1505] Processing CreateTablet for tablet 5dc32b27b3f743bf8719e39ea8c20e34 (DEFAULT_TABLE table=default.Table_5402989ff9f84c51b18f63d334655e33 [id=adee939435074550bb85b2f00c102367]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.202376 14953 tablet_service.cc:1505] Processing CreateTablet for tablet 6b16e4b9ef4c41db83ab3bf55149719b (DEFAULT_TABLE table=default.Table_bf6a70d1926d4a9da3c3ee62f85bf2cf [id=7b0f2a2cf9de45ed9a2dd070deaa13a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.210541 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2a4db00068482fb8d3b5313017e035. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.212864 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c15457dfac48e3a33de5a9c3d6f1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.204442 14945 tablet_service.cc:1505] Processing CreateTablet for tablet 879ae11ae94b4d2eab76c1dc74e160ca (DEFAULT_TABLE table=default.Table_e355ea0deef54efd87fb7938c19b9547 [id=141db142f9034f4bb225526996a54b92]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.214988 14945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879ae11ae94b4d2eab76c1dc74e160ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.204496 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 76c31d4c83c740dab40bebd6c8d3f161 (DEFAULT_TABLE table=default.Table_ec80f327b59748efb9f7d1b60f08cd7c [id=f2c68f806e5040b5ae0095c7156a0cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.204629 14946 tablet_service.cc:1505] Processing CreateTablet for tablet d0de3ec67dcc4e41a447338869076314 (DEFAULT_TABLE table=default.Table_5f52465815d64efda49e01e13789088e [id=4590a287cbc24df7ab303a5b8ce87007]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.204800 14950 tablet_service.cc:1505] Processing CreateTablet for tablet d6cbe1616ced4f47999a6a1365af0092 (DEFAULT_TABLE table=default.Table_7fdb9c6661e241b6a185030c3593d5e2 [id=8b4baee097c94e428a9a26f5d2a22107]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.205034 14955 tablet_service.cc:1505] Processing CreateTablet for tablet aae693881f9d40c789d242c6de5d9905 (DEFAULT_TABLE table=default.Table_8065852bc26846929a54ba0b632cf16b [id=6394f825a52f496c983151503252b502]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.205231 14954 tablet_service.cc:1505] Processing CreateTablet for tablet 3caafcc644e34ec1acc0d3741fd34721 (DEFAULT_TABLE table=default.Table_6c9870e0994744ba98aace68eba418f6 [id=984010acd02142579a16d6897862efb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.216912 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c31d4c83c740dab40bebd6c8d3f161. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.205641 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 12a6b5f9ed8041e9929c9f1673ac212a (DEFAULT_TABLE table=default.Table_8d895bf14fe042d7832bde868edc0e61 [id=270c8b1a2ef34d80a82bb0de00c72db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.204799 14958 tablet_service.cc:1505] Processing CreateTablet for tablet f2bc1c43a4724406a9e2cc2c8cb72bec (DEFAULT_TABLE table=default.Table_f35d0fa958084bb9bb792e93fd367806 [id=ae28464385cf4504b39a9292d794460f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.206127 14959 tablet_service.cc:1505] Processing CreateTablet for tablet d6243825ae7b4307b5789aaee2473edc (DEFAULT_TABLE table=default.Table_3cb2ab7a99584877a1e8c650a29489db [id=d272aae5be5249ae9f40a67315f3756c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.219094 14951 tablet_service.cc:1505] Processing CreateTablet for tablet b1fc8a8cfb73420f81f5b73839d3d3cb (DEFAULT_TABLE table=default.Table_dd5055250bd34b1cb92185869ef6186c [id=114aff0abb5d4c78b98b63d145ec02c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.219429 14941 tablet_service.cc:1505] Processing CreateTablet for tablet b316ba50a48446338d49435a8e809ff4 (DEFAULT_TABLE table=default.Table_d0bdafcb33804ab48f880343784af6e0 [id=464250cb73944d90b9c1fd39002a9e11]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.219594 14949 tablet_service.cc:1505] Processing CreateTablet for tablet 63085b146f03434b912d639b430a2cfe (DEFAULT_TABLE table=default.Table_24ae0230ee3646e7a2d32c0e4a536dea [id=6e17d76cd39f4556bea24c3197dca4ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.220134 16280 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_fe4cbb31d8584609ab3669f24baa8c27" } new_table_name: "default.Table_36b5cc8d55f84063a624820d55f1aac8" modify_external_catalogs: true
I20251025 08:02:33.220875 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_7a1fe941fd114b82875d9b1b0ccb98e2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.221000 14950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6cbe1616ced4f47999a6a1365af0092. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.221118 14952 tablet_service.cc:1505] Processing CreateTablet for tablet ea8a95b8fbf94520a2c219755cdc5d14 (DEFAULT_TABLE table=default.Table_753a908ca3a540568e454f247a3f6fd4 [id=c77692f42923422a853159374c35a59c]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:33.221158 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a1fe941fd114b82875d9b1b0ccb98e2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.221357 14945 tablet_service.cc:1505] Processing CreateTablet for tablet c079391742cc4d488826c5536ab6d1d1 (DEFAULT_TABLE table=default.Table_8a52f20ffb6e455f9c5bc212cd09c071 [id=0434a2fb173a495a895b11aa307bf44f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.222076 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_799de52c9d9244b9a55f3c0a56de6136"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.222385 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_799de52c9d9244b9a55f3c0a56de6136 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.222376 14940 tablet_service.cc:1505] Processing CreateTablet for tablet b826067888164df0af7da797d42c0862 (DEFAULT_TABLE table=default.Table_1c42bf37d0434552a8f4ffe93d29d77a [id=7eda6d3807c042d3a7aecf63ebd73fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.223310 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8a95b8fbf94520a2c219755cdc5d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.224277 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_37d4aabbd78f4580864d62b6edf2ab23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.224529 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_37d4aabbd78f4580864d62b6edf2ab23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.225219 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 91d9fca3965e4ff8bb0a50574ede0209 (DEFAULT_TABLE table=default.Table_47f9104a42ea4104828e1f8ecd279670 [id=bdd0ed6dbdb844bdb993f37e1db34cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.225427 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91d9fca3965e4ff8bb0a50574ede0209. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.225747 16285 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet e2b014e0f49c4f7da8e65b7d4c98ea63
I20251025 08:02:33.225832 17194 ts_tablet_manager.cc:1929] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.225888 17194 log.cc:1199] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/6c582efa6d334a06a48e2f2b94167776
I20251025 08:02:33.225999 16285 catalog_manager.cc:6719] ReplaceTablet: tablet e2b014e0f49c4f7da8e65b7d4c98ea63 deleted and replaced by tablet 0514d05680994b5f9bf7da9c62dd098a
I20251025 08:02:33.226146 16285 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_3c48d3160e5d42509de4f0be1af855e2" } new_table_name: "default.Table_82dd4283c4d44377ad2a4834aa04ebfe" modify_external_catalogs: true
I20251025 08:02:33.226332 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b16e4b9ef4c41db83ab3bf55149719b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.226737 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f141107d4674690acd51e499bc4e208. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.226785 17258 log.cc:1199] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/14b47bf733754b72b34bd74aa033afa3
I20251025 08:02:33.199702 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 2c614480578945839a6662bafc62726c (DEFAULT_TABLE table=default.Table_bd4d865a11f940b183fb4f06cd4da881 [id=b080141fd09a489da6324d45421c2fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.227027 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c614480578945839a6662bafc62726c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.227226 17194 ts_tablet_manager.cc:1950] T 6c582efa6d334a06a48e2f2b94167776 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.227804 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 6c582efa6d334a06a48e2f2b94167776 (table default.Table_b1d8db45b7d745a0b4dd9ff09300da89 [id=be37bd4a45da444e83846233c335d445]) successfully deleted
I20251025 08:02:33.227036 17258 ts_tablet_manager.cc:1950] T 14b47bf733754b72b34bd74aa033afa3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.228729 14943 tablet_service.cc:1505] Processing CreateTablet for tablet edfb86283bda491993a456e365f8760f (DEFAULT_TABLE table=default.Table_d9fe75661236465ca4c58953ed0023c4 [id=c0f5ecd0d89d409785fbd905d22e3fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.228935 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfb86283bda491993a456e365f8760f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.228950 15224 tablet_service.cc:1505] Processing CreateTablet for tablet b316ba50a48446338d49435a8e809ff4 (DEFAULT_TABLE table=default.Table_d0bdafcb33804ab48f880343784af6e0 [id=464250cb73944d90b9c1fd39002a9e11]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.229137 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b316ba50a48446338d49435a8e809ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.229647 17258 tablet_replica.cc:333] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.229776 17258 raft_consensus.cc:2243] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.229871 17258 raft_consensus.cc:2272] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.199916 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 5dc32b27b3f743bf8719e39ea8c20e34 (DEFAULT_TABLE table=default.Table_5402989ff9f84c51b18f63d334655e33 [id=adee939435074550bb85b2f00c102367]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.201030 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 6b16e4b9ef4c41db83ab3bf55149719b (DEFAULT_TABLE table=default.Table_bf6a70d1926d4a9da3c3ee62f85bf2cf [id=7b0f2a2cf9de45ed9a2dd070deaa13a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.201246 15225 tablet_service.cc:1505] Processing CreateTablet for tablet f1c15457dfac48e3a33de5a9c3d6f1f1 (DEFAULT_TABLE table=default.Table_42cdcbf9b2a0438b92ed7d428d482506 [id=7a5de3149f6545a680efc1df204128ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.230443 14948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc32b27b3f743bf8719e39ea8c20e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.230628 14942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c614480578945839a6662bafc62726c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.201463 15222 tablet_service.cc:1505] Processing CreateTablet for tablet 0f141107d4674690acd51e499bc4e208 (DEFAULT_TABLE table=default.Table_9ba393cca8d548bcb6a5b34c49969893 [id=ee49c87b7ddc47f28029112a49b5665b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.230765 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3caafcc644e34ec1acc0d3741fd34721. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.230849 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 14b47bf733754b72b34bd74aa033afa3 (table default.Table_ac5b84a98ba9491b8a549aef2ae7a8c8 [id=59daf7f960b84b148da5d5f30db95bfe]) successfully deleted
I20251025 08:02:33.202572 15214 tablet_service.cc:1505] Processing CreateTablet for tablet cb2a4db00068482fb8d3b5313017e035 (DEFAULT_TABLE table=default.Table_24a3fc5c42d441fab7d881fb258a0ddb [id=866f01db50274ea29407f759600aff90]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.203573 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 334015a0a5aa42c8b127d64e794c2705 (DEFAULT_TABLE table=default.Table_34881ec032724dac94217f71be36dd45 [id=7a1037f752964f4297e98d6179eee165]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.203755 15217 tablet_service.cc:1505] Processing CreateTablet for tablet 879ae11ae94b4d2eab76c1dc74e160ca (DEFAULT_TABLE table=default.Table_e355ea0deef54efd87fb7938c19b9547 [id=141db142f9034f4bb225526996a54b92]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.203755 15226 tablet_service.cc:1505] Processing CreateTablet for tablet d6cbe1616ced4f47999a6a1365af0092 (DEFAULT_TABLE table=default.Table_7fdb9c6661e241b6a185030c3593d5e2 [id=8b4baee097c94e428a9a26f5d2a22107]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.203882 15220 tablet_service.cc:1505] Processing CreateTablet for tablet aae693881f9d40c789d242c6de5d9905 (DEFAULT_TABLE table=default.Table_8065852bc26846929a54ba0b632cf16b [id=6394f825a52f496c983151503252b502]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.203884 15229 tablet_service.cc:1505] Processing CreateTablet for tablet f2bc1c43a4724406a9e2cc2c8cb72bec (DEFAULT_TABLE table=default.Table_f35d0fa958084bb9bb792e93fd367806 [id=ae28464385cf4504b39a9292d794460f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.204030 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 76c31d4c83c740dab40bebd6c8d3f161 (DEFAULT_TABLE table=default.Table_ec80f327b59748efb9f7d1b60f08cd7c [id=f2c68f806e5040b5ae0095c7156a0cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.203881 15221 tablet_service.cc:1505] Processing CreateTablet for tablet d0de3ec67dcc4e41a447338869076314 (DEFAULT_TABLE table=default.Table_5f52465815d64efda49e01e13789088e [id=4590a287cbc24df7ab303a5b8ce87007]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.205438 15228 tablet_service.cc:1505] Processing CreateTablet for tablet 3caafcc644e34ec1acc0d3741fd34721 (DEFAULT_TABLE table=default.Table_6c9870e0994744ba98aace68eba418f6 [id=984010acd02142579a16d6897862efb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.206439 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 12a6b5f9ed8041e9929c9f1673ac212a (DEFAULT_TABLE table=default.Table_8d895bf14fe042d7832bde868edc0e61 [id=270c8b1a2ef34d80a82bb0de00c72db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.211747 15223 tablet_service.cc:1505] Processing CreateTablet for tablet c079391742cc4d488826c5536ab6d1d1 (DEFAULT_TABLE table=default.Table_8a52f20ffb6e455f9c5bc212cd09c071 [id=0434a2fb173a495a895b11aa307bf44f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.212630 15219 tablet_service.cc:1505] Processing CreateTablet for tablet d6243825ae7b4307b5789aaee2473edc (DEFAULT_TABLE table=default.Table_3cb2ab7a99584877a1e8c650a29489db [id=d272aae5be5249ae9f40a67315f3756c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.212702 15213 tablet_service.cc:1505] Processing CreateTablet for tablet ea8a95b8fbf94520a2c219755cdc5d14 (DEFAULT_TABLE table=default.Table_753a908ca3a540568e454f247a3f6fd4 [id=c77692f42923422a853159374c35a59c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.214300 15211 tablet_service.cc:1505] Processing CreateTablet for tablet 63085b146f03434b912d639b430a2cfe (DEFAULT_TABLE table=default.Table_24ae0230ee3646e7a2d32c0e4a536dea [id=6e17d76cd39f4556bea24c3197dca4ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.232654 14954 tablet_service.cc:1552] Processing DeleteTablet for tablet e2b014e0f49c4f7da8e65b7d4c98ea63 with delete_type TABLET_DATA_DELETED (replaced by tablet 0514d05680994b5f9bf7da9c62dd098a) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.232997 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a6b5f9ed8041e9929c9f1673ac212a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.233237 15224 tablet_service.cc:1505] Processing CreateTablet for tablet b826067888164df0af7da797d42c0862 (DEFAULT_TABLE table=default.Table_1c42bf37d0434552a8f4ffe93d29d77a [id=7eda6d3807c042d3a7aecf63ebd73fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.214761 15210 tablet_service.cc:1505] Processing CreateTablet for tablet b1fc8a8cfb73420f81f5b73839d3d3cb (DEFAULT_TABLE table=default.Table_dd5055250bd34b1cb92185869ef6186c [id=114aff0abb5d4c78b98b63d145ec02c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.234942 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2bc1c43a4724406a9e2cc2c8cb72bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.235380 16286 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 346c0c8bf30b4dbaa92436b45e5fbf47 (table default.Table_258c905a78d94ba197752a61781fa019 [id=ef3a1760f2c44935bbb79e518510905f]). Expected version 4 got 3
I20251025 08:02:33.235488 16286 catalog_manager.cc:5649] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:33.235829 16286 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet d14e12c45323420b84de06d828238caa (table default.Table_f435579c26e14e2cbb8da758499bfa19 [id=6b4ebc3c554648b48d6ea2f5916e1bad]). Expected version 2 got 1
I20251025 08:02:33.236279 16286 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet c59083b54df24c21a3114c34a73dd638 (table default.Table_89038955e92b42c2af35921ad16899d4 [id=e3c0ae796ee2421abe38408b729dd2a6]). Expected version 1 got 0
I20251025 08:02:33.226696 16390 tablet_bootstrap.cc:492] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:33.230384 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc32b27b3f743bf8719e39ea8c20e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.236672 16390 ts_tablet_manager.cc:1403] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.055s user 0.002s sys 0.000s
I20251025 08:02:33.236747 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6243825ae7b4307b5789aaee2473edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.237112 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6243825ae7b4307b5789aaee2473edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.237129 16390 raft_consensus.cc:359] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.237208 16390 raft_consensus.cc:385] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.237236 16390 raft_consensus.cc:740] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.237352 16390 consensus_queue.cc:260] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.237597 16390 ts_tablet_manager.cc:1434] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.237744 16390 tablet_bootstrap.cc:492] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:33.238234 16286 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 2be36d176bf34fb6bd3c70b42af15cc9 (table default.Table_65442dc666594e129611ee817db7b2c0 [id=de277558d55a46519b3c1e18c51f18fb]). Expected version 1 got 0
I20251025 08:02:33.238364 16286 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet f426e93af38e4e17b30cd01eea12dcac (table default.Table_1d154c130315454cad4d9f3ea6bdd9b2 [id=a1ed1a0c27ef42c69acd197420340d7d]). Expected version 1 got 0
I20251025 08:02:33.238435 15219 tablet_service.cc:1505] Processing CreateTablet for tablet 91d9fca3965e4ff8bb0a50574ede0209 (DEFAULT_TABLE table=default.Table_47f9104a42ea4104828e1f8ecd279670 [id=bdd0ed6dbdb844bdb993f37e1db34cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.238520 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aae693881f9d40c789d242c6de5d9905. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.238605 16286 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet e967a52212164b8cb6f9c39f207024a1 (table default.Table_434df4d622c74c6f89f7b7373096fb5f [id=0a4629613477421ba329364dbb42a8b6]). Expected version 1 got 0
I20251025 08:02:33.238631 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91d9fca3965e4ff8bb0a50574ede0209. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.238684 16286 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet ed2036a8ebd74ab18c0bbd6d9aa67ef0 (table default.Table_e7e4f555b1d140ef907741daae26ce2b [id=a8e0504bc08744b4915157fa63d2226e]). Expected version 1 got 0
I20251025 08:02:33.238699 16390 tablet_bootstrap.cc:654] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.239029 16286 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet d81b65e094a34703ac47897d9bfa4c7c (table default.Table_e45046c48bb54111b38f009cc14efd2d [id=768625af4c474964ad2b502cf0b03fa7]). Expected version 1 got 0
I20251025 08:02:33.239140 16286 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 88a76d187fae4f09ac879b72e9c05a86 (table default.Table_8d621c2f449e477ab01d1b67dc869408 [id=d318bca8bf144870aa5529426cfa9995]). Expected version 1 got 0
I20251025 08:02:33.239467 14946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0de3ec67dcc4e41a447338869076314. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.239544 16286 catalog_manager.cc:5649] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:33.239804 16286 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet f6082b299bb44d31b567f70d8da7f0ac (table default.Table_c5c036d7c66344eba94e15be432088bc [id=ebfa83131bd946d0897b32ef3c188c19]). Expected version 1 got 0
I20251025 08:02:33.239890 16286 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 7dd513b6c7a24dffb91f66c32acc7696 (table default.Table_236aa29f60b94e4d9c524ebb1051c3a8 [id=1338885c63014b47bcd512a9ddfaf31d]). Expected version 1 got 0
I20251025 08:02:33.240067 16286 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 1019d033e1f24ab596309462cbeb9c73 (table default.Table_5e5050bacd5543229399a2924609ae9c [id=4644ba57f12f4ad4bf7e89f80c4cd161]). Expected version 1 got 0
I20251025 08:02:33.240208 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a6b5f9ed8041e9929c9f1673ac212a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.240236 16286 catalog_manager.cc:5649] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:33.240712 14945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c079391742cc4d488826c5536ab6d1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.240716 16286 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 86b1873446154249a80fa67b99496545 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]). Expected version 1 got 0
I20251025 08:02:33.241071 16286 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet d05bf0056dfc43eeb4105af559497bdc (table default.Table_3678577821c441b1bac4f3d9617e4d43 [id=72243e33e90940c09953a9ec2fcfd435]). Expected version 1 got 0
I20251025 08:02:33.241310 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b826067888164df0af7da797d42c0862. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.242156 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c079391742cc4d488826c5536ab6d1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.242400 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b826067888164df0af7da797d42c0862. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.242512 15217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879ae11ae94b4d2eab76c1dc74e160ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.243649 14949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63085b146f03434b912d639b430a2cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.243927 15213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8a95b8fbf94520a2c219755cdc5d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.244299 15220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aae693881f9d40c789d242c6de5d9905. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.244853 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1fc8a8cfb73420f81f5b73839d3d3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.245873 15211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63085b146f03434b912d639b430a2cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.246228 14941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b316ba50a48446338d49435a8e809ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.246233 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2bc1c43a4724406a9e2cc2c8cb72bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.248389 16391 tablet_bootstrap.cc:492] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.248471 16391 ts_tablet_manager.cc:1403] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.166s user 0.002s sys 0.000s
I20251025 08:02:33.248637 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334015a0a5aa42c8b127d64e794c2705. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.248931 16391 raft_consensus.cc:359] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.249029 16391 raft_consensus.cc:385] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.249063 16391 raft_consensus.cc:740] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.249176 16391 consensus_queue.cc:260] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.249421 16391 ts_tablet_manager.cc:1434] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:33.249593 16391 tablet_bootstrap.cc:492] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.250499 16391 tablet_bootstrap.cc:654] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.250751 15210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1fc8a8cfb73420f81f5b73839d3d3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.252776 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c15457dfac48e3a33de5a9c3d6f1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.253892 16279 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_b9669fd414104dcca80167117a5b0ed7 [id=431195fe6a3847caa5b39d62cb399ffb] alter complete (version 1)
I20251025 08:02:33.254249 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3caafcc644e34ec1acc0d3741fd34721. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:33.255980 15184 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251025 08:02:33.256093 15221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0de3ec67dcc4e41a447338869076314. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.257761 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c31d4c83c740dab40bebd6c8d3f161. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.258184 16280 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e3dddd8db8a64833bd7de5ad2fec599a" } modify_external_catalogs: true
I20251025 08:02:33.258270 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6cbe1616ced4f47999a6a1365af0092. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.258320 16280 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e3dddd8db8a64833bd7de5ad2fec599a" } modify_external_catalogs: true
I20251025 08:02:33.258718 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_cd387a4e144d4b88921db554e1fd89da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.259001 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd387a4e144d4b88921db554e1fd89da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.260003 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_e30fc339f0c6497a910719bc1c5389cf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.260329 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e30fc339f0c6497a910719bc1c5389cf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.260747 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f141107d4674690acd51e499bc4e208. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.262607 16287 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_165ff894c5ab455e8daf5d1cf318b785" } modify_external_catalogs: true
I20251025 08:02:33.262705 16287 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_165ff894c5ab455e8daf5d1cf318b785" } modify_external_catalogs: true
I20251025 08:02:33.262991 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2a4db00068482fb8d3b5313017e035. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:33.263259 16285 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e0f08e0726a447848747ea33588867eb consensus state has no leader
I20251025 08:02:33.264917 16391 tablet_bootstrap.cc:492] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.265008 16391 ts_tablet_manager.cc:1403] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:33.265384 16391 raft_consensus.cc:359] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.265479 16391 raft_consensus.cc:385] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.265511 16391 raft_consensus.cc:740] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.265611 16391 consensus_queue.cc:260] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.265784 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b16e4b9ef4c41db83ab3bf55149719b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.265858 16391 ts_tablet_manager.cc:1434] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.266022 16391 tablet_bootstrap.cc:492] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.267109 16391 tablet_bootstrap.cc:654] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.268182 16391 tablet_bootstrap.cc:492] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.268258 16391 ts_tablet_manager.cc:1403] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:33.268657 16391 raft_consensus.cc:359] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.268738 16391 raft_consensus.cc:385] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.268769 16391 raft_consensus.cc:740] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.268872 16391 consensus_queue.cc:260] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.269124 16391 ts_tablet_manager.cc:1434] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.269279 16391 tablet_bootstrap.cc:492] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.270128 16391 tablet_bootstrap.cc:654] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.275565 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed2036a8ebd74ab18c0bbd6d9aa67ef0" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:33.275684 14977 raft_consensus.cc:3060] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.276645 14977 raft_consensus.cc:2468] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
W20251025 08:02:33.277380 15227 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42704: Illegal state: replica f0f2f8ce3e9f4d9ba3f3f02813397c31 is not leader of this config: current role FOLLOWER
I20251025 08:02:33.277812 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95030a851b5d4155b235a4e896250c80" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.278036 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95030a851b5d4155b235a4e896250c80" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:33.278678 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ddb3795876b486e992b58cea711afb3" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.279243 16288 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_9c7e0359120c415cba47b89251b0be94" } modify_external_catalogs: true
I20251025 08:02:33.279350 16288 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_9c7e0359120c415cba47b89251b0be94" } modify_external_catalogs: true
I20251025 08:02:33.280175 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet e2b014e0f49c4f7da8e65b7d4c98ea63 with delete_type TABLET_DATA_DELETED (replaced by tablet 0514d05680994b5f9bf7da9c62dd098a) from {username='slave'} at 127.0.0.1:42704
W20251025 08:02:33.280444 16271 catalog_manager.cc:5064] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): alter failed for tablet d049bf946c744664aba74d7a12fa4ff1 (table default.Table_36b5cc8d55f84063a624820d55f1aac8 [id=33bbe4605d924011b9002a939a73203d]): Illegal state: replica f0f2f8ce3e9f4d9ba3f3f02813397c31 is not leader of this config: current role FOLLOWER
I20251025 08:02:33.280881 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff15c6e28a794271ac61ca111d66a06e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.281064 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29476b0bf2f34dcb913a665e3a008519" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:33.281247 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 658a20d894c5444a820ce6bd33e4fdf0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 658a20d894c5444a820ce6bd33e4fdf0 already in progress: creating tablet
W20251025 08:02:33.281548 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 98baf6e8d8e84b42a83054495ae19e01 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 98baf6e8d8e84b42a83054495ae19e01 already in progress: creating tablet
I20251025 08:02:33.281481 17194 tablet_replica.cc:333] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.283376 15183 leader_election.cc:304] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:33.283504 17369 raft_consensus.cc:2749] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:33.284005 17369 consensus_queue.cc:1048] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:33.284965 15183 leader_election.cc:343] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.285151 16281 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_63d5e82b41854eab8d579c80fcdf9d6d [id=9759ac18bd46453eab5a8c294a229886] alter complete (version 1)
I20251025 08:02:33.281971 17194 raft_consensus.cc:2243] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.286602 17194 raft_consensus.cc:2272] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.288625 16281 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_beff096618394ac1b31db74a94a9f991 [id=8a0e4fe9e4544c539cb23b0279c1deaf] alter complete (version 2)
I20251025 08:02:33.291185 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_39b16d4513794370a809c027496a8357"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.291522 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_39b16d4513794370a809c027496a8357 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.292284 17194 ts_tablet_manager.cc:1916] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.292346 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_6afbe6fa71c541bf8cac121cae96aa81"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.292634 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6afbe6fa71c541bf8cac121cae96aa81 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.294394 17194 ts_tablet_manager.cc:1929] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.294466 17194 log.cc:1199] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/27d1e084fbdf43e2a1cc60fb6dfd194b
I20251025 08:02:33.294703 17194 ts_tablet_manager.cc:1950] T 27d1e084fbdf43e2a1cc60fb6dfd194b P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.298242 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 27d1e084fbdf43e2a1cc60fb6dfd194b (table default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064]) successfully deleted
I20251025 08:02:33.298511 17194 tablet_replica.cc:333] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.298959 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_2d23a19b70fe485986083303286874fa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.299248 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d23a19b70fe485986083303286874fa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.300226 16391 tablet_bootstrap.cc:492] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.301224 16391 ts_tablet_manager.cc:1403] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20251025 08:02:33.301652 16391 raft_consensus.cc:359] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.301739 16391 raft_consensus.cc:385] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.301766 16391 raft_consensus.cc:740] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.301864 16391 consensus_queue.cc:260] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.302105 16391 ts_tablet_manager.cc:1434] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.302276 16391 tablet_bootstrap.cc:492] T 95030a851b5d4155b235a4e896250c80 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.303146 16391 tablet_bootstrap.cc:654] T 95030a851b5d4155b235a4e896250c80 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.298668 17194 raft_consensus.cc:2243] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.305472 17194 raft_consensus.cc:2272] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.306059 16284 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_8c216cc6319243c4834215f42bebe51c" } new_table_name: "default.Table_0a7689d2e9da469a99bf4e6238b2bdf5" modify_external_catalogs: true
I20251025 08:02:33.306106 17194 ts_tablet_manager.cc:1916] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.307085 16285 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_155857795087477392a338e28fb60afc" } new_table_name: "default.Table_ad9841940177424384c1bbcbf700ea9d" modify_external_catalogs: true
I20251025 08:02:33.308166 17194 ts_tablet_manager.cc:1929] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.308238 17194 log.cc:1199] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/bfdc6022cc5747439edcb8aa865b9437
I20251025 08:02:33.308826 16391 tablet_bootstrap.cc:492] T 95030a851b5d4155b235a4e896250c80 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.309240 16391 ts_tablet_manager.cc:1403] T 95030a851b5d4155b235a4e896250c80 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251025 08:02:33.309684 16391 raft_consensus.cc:359] T 95030a851b5d4155b235a4e896250c80 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.309768 16391 raft_consensus.cc:385] T 95030a851b5d4155b235a4e896250c80 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.309806 16391 raft_consensus.cc:740] T 95030a851b5d4155b235a4e896250c80 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.309898 16391 consensus_queue.cc:260] T 95030a851b5d4155b235a4e896250c80 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.310160 16391 ts_tablet_manager.cc:1434] T 95030a851b5d4155b235a4e896250c80 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.311069 16391 tablet_bootstrap.cc:492] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.312263 16391 tablet_bootstrap.cc:654] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.313417 17194 ts_tablet_manager.cc:1950] T bfdc6022cc5747439edcb8aa865b9437 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.315968 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 17339d7c0a4b40a78b3252d17481c192
I20251025 08:02:33.316715 16283 master_service.cc:954] ReplaceTablet: received request to replace tablet b41e092b7f40410a979bcfd5bbc7c225 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.317430 16279 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_9d8c68374942454a8e7c869e8cef206f [id=b228e3c8480f475ca877713e168bcba8] alter complete (version 1)
I20251025 08:02:33.316694 14945 tablet_service.cc:1552] Processing DeleteTablet for tablet 17339d7c0a4b40a78b3252d17481c192 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.318557 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet bfdc6022cc5747439edcb8aa865b9437 (table default.Table_5bc70f62257c438bb0c52926674f2bdf [id=e62c2aba4e5546e2bd881c5f2ae3abd4]) successfully deleted
I20251025 08:02:33.318797 17194 tablet_replica.cc:333] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.318948 17194 raft_consensus.cc:2243] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.319089 17194 raft_consensus.cc:2272] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.319458 17194 ts_tablet_manager.cc:1916] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.320726 16279 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_08073379da334076bcc5503770a32982 [id=1ee33ee129d749d0bd7f26dc49fca0fe] alter complete (version 4)
I20251025 08:02:33.321295 17194 ts_tablet_manager.cc:1929] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.321408 17194 log.cc:1199] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/fc5f892ca7a246a28a556fe0eb3f5442
I20251025 08:02:33.321870 16281 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_155857795087477392a338e28fb60afc [id=b58927a3527c45cb946d1fcc0681d6bf] alter complete (version 1)
I20251025 08:02:33.321892 17194 ts_tablet_manager.cc:1950] T fc5f892ca7a246a28a556fe0eb3f5442 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.322466 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet fc5f892ca7a246a28a556fe0eb3f5442 (table default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b [id=4e47e7759fc64598807f1ee3a973820f]) successfully deleted
I20251025 08:02:33.322690 17194 tablet_replica.cc:333] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.322872 17194 raft_consensus.cc:2243] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.323074 17194 raft_consensus.cc:2272] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.323655 17194 ts_tablet_manager.cc:1916] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.323729 17415 raft_consensus.cc:493] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.323797 17415 raft_consensus.cc:515] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.324136 17415 leader_election.cc:290] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.327080 16391 tablet_bootstrap.cc:492] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.327152 16391 ts_tablet_manager.cc:1403] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20251025 08:02:33.327519 16391 raft_consensus.cc:359] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.327601 16391 raft_consensus.cc:385] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.327630 16391 raft_consensus.cc:740] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.327737 16391 consensus_queue.cc:260] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.327999 16391 ts_tablet_manager.cc:1434] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.328154 16391 tablet_bootstrap.cc:492] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.328655 17194 ts_tablet_manager.cc:1929] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.329018 16391 tablet_bootstrap.cc:654] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.330683 17194 log.cc:1199] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/23eedc2695db43afbd6f5dbebb0ea2be
I20251025 08:02:33.330946 17194 ts_tablet_manager.cc:1950] T 23eedc2695db43afbd6f5dbebb0ea2be P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.331288 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 23eedc2695db43afbd6f5dbebb0ea2be (table default.Table_d9fe75661236465ca4c58953ed0023c4 [id=c0f5ecd0d89d409785fbd905d22e3fc2]) successfully deleted
I20251025 08:02:33.331981 16281 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_5d847a37cb0c456294cb5137046f80bb [id=1f6784494d0b4b98b46077a0af6c2ea8] alter complete (version 1)
I20251025 08:02:33.332481 17194 tablet_replica.cc:333] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.332603 17194 raft_consensus.cc:2243] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.332695 17194 raft_consensus.cc:2272] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.333011 17194 ts_tablet_manager.cc:1916] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.333051 16279 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_c1e77003b0f5470681f7ae92a0e7a320 [id=f191d520ebe342ff849af37e4507fd2e] alter complete (version 1)
I20251025 08:02:33.333457 16285 master_service.cc:954] ReplaceTablet: received request to replace tablet 6c582efa6d334a06a48e2f2b94167776 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.334501 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_bcf26fc494eb47ffbdecbeaadcf70015"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.334929 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bcf26fc494eb47ffbdecbeaadcf70015 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.336755 16391 tablet_bootstrap.cc:492] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.336855 16391 ts_tablet_manager.cc:1403] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.001s
I20251025 08:02:33.337402 16391 raft_consensus.cc:359] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.337499 16391 raft_consensus.cc:385] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.337525 16391 raft_consensus.cc:740] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.337634 16391 consensus_queue.cc:260] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.337867 16391 ts_tablet_manager.cc:1434] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.338006 16391 tablet_bootstrap.cc:492] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.338937 16391 tablet_bootstrap.cc:654] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.339390 17194 ts_tablet_manager.cc:1929] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.339460 17194 log.cc:1199] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/ff20cd7d33a440bab24bd4a61fff1f30
I20251025 08:02:33.339682 17194 ts_tablet_manager.cc:1950] T ff20cd7d33a440bab24bd4a61fff1f30 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.340438 16281 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8] alter complete (version 1)
I20251025 08:02:33.340665 15027 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:33.341614 17194 tablet_replica.cc:333] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.341738 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]) successfully deleted
I20251025 08:02:33.341781 17194 raft_consensus.cc:2243] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.341866 17194 raft_consensus.cc:2272] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.342191 17194 ts_tablet_manager.cc:1916] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.348773 17194 ts_tablet_manager.cc:1929] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.350165 16282 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 2f64072c416f4a77b1c81855d7db8f01
I20251025 08:02:33.348937 16391 tablet_bootstrap.cc:492] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.350703 14945 tablet_service.cc:1552] Processing DeleteTablet for tablet 2f64072c416f4a77b1c81855d7db8f01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.352177 16391 ts_tablet_manager.cc:1403] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.000s
I20251025 08:02:33.352541 16391 raft_consensus.cc:359] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.352617 16391 raft_consensus.cc:385] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.352644 16391 raft_consensus.cc:740] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.352732 16391 consensus_queue.cc:260] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.352960 16391 ts_tablet_manager.cc:1434] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.353101 16391 tablet_bootstrap.cc:492] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.354009 16391 tablet_bootstrap.cc:654] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.355124 17194 log.cc:1199] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/64996b8137f647b993923cb1bb093211
I20251025 08:02:33.355708 17194 ts_tablet_manager.cc:1950] T 64996b8137f647b993923cb1bb093211 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.356287 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 64996b8137f647b993923cb1bb093211 (table default.Table_c8ac7973eef94a68bf4ebe1459c2e6e6 [id=3c371b3791fd45be983458cd55d67827]) successfully deleted
I20251025 08:02:33.357374 16280 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 85c7748077184fdda472821a0826cd77
I20251025 08:02:33.357702 16288 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet ce5ae591c86c4455a1dd3704f1c95d1c
I20251025 08:02:33.358038 17194 tablet_replica.cc:333] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.358227 17194 raft_consensus.cc:2243] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.358378 17194 pending_rounds.cc:70] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
W20251025 08:02:33.358454 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c because the tablet was not found. No further retry: Not found: Tablet not found: 0d6cca70bc3c48bf9c2396fdfdb8e42c
I20251025 08:02:33.358537 17194 pending_rounds.cc:77] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609826649460736 op_type: NO_OP noop_request { }
I20251025 08:02:33.358587 17194 raft_consensus.cc:2889] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:33.358656 17194 raft_consensus.cc:2272] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.358986 14945 tablet_service.cc:1552] Processing DeleteTablet for tablet 85c7748077184fdda472821a0826cd77 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.359084 16287 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet be8d6685c70c4219947df30f023a59b8
I20251025 08:02:33.359117 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet ce5ae591c86c4455a1dd3704f1c95d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.359342 17194 ts_tablet_manager.cc:1916] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.361052 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet be8d6685c70c4219947df30f023a59b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.362615 16281 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_a3565262078c4a9a84c70de12fbb9672 [id=72c011b62b744dce916913de58d26d09] alter complete (version 1)
I20251025 08:02:33.363704 17194 ts_tablet_manager.cc:1929] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.154408 15082 tablet_service.cc:1505] Processing CreateTablet for tablet c8bc7a0419e84a19a0349d0b7d63f174 (DEFAULT_TABLE table=default.Table_501f3c298af041b9aec232c1957e77eb [id=4181639020fe4f83885a3cbc37909477]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.363809 17194 log.cc:1199] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/34c330b5dd544ae686f741cdd85d023d
I20251025 08:02:33.363801 17198 log.cc:1199] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/b41e092b7f40410a979bcfd5bbc7c225
I20251025 08:02:33.363974 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8bc7a0419e84a19a0349d0b7d63f174. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.364079 17198 ts_tablet_manager.cc:1950] T b41e092b7f40410a979bcfd5bbc7c225 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:33.364580 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 61) took 1125 ms. Trace:
I20251025 08:02:33.364652 17198 rpcz_store.cc:276] 1025 08:02:32.239562 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.239595 (+ 33us) service_pool.cc:225] Handling call
1025 08:02:33.138431 (+898836us) ts_tablet_manager.cc:1151] Deleting tablet b41e092b7f40410a979bcfd5bbc7c225
1025 08:02:33.138436 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:33.139957 (+ 1521us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:33.140706 (+ 749us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:33.364570 (+223864us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":898728}
I20251025 08:02:33.364827 17198 tablet_replica.cc:333] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:33.365293 16287 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_beff096618394ac1b31db74a94a9f991" } new_table_name: "default.Table_4b899f935c754aa2876c910eb2e208e3" modify_external_catalogs: true
I20251025 08:02:33.154529 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 8b6ae6527fd64c3bb5999dec97db861d with delete_type TABLET_DATA_DELETED (replaced by tablet 774988b980d8474e9b41518410c5dc9b) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.154616 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet ed5ed91e953d42afa9ebf9ab8b89d0e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 32ef1622f95f497ba839271dacf29841) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.154529 15086 tablet_service.cc:1552] Processing DeleteTablet for tablet 1e248b8303b1498e96178d4e46ad691e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.154412 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet f5f72ca8cfb94178a21619ddc9fc0352 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.157169 17405 tablet.cc:1722] T 346c0c8bf30b4dbaa92436b45e5fbf47 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 4
I20251025 08:02:33.366604 17194 ts_tablet_manager.cc:1950] T 34c330b5dd544ae686f741cdd85d023d P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.158749 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "77f04f445b5d47d2a78fdac0641a7372" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.158963 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "8362e26d86d44e9780d3c78c6a468556" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.160795 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "82b93b7537c047aea430658ae2c2654b" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.163254 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d116fbec0c6149938b8f6c19af9607af" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.184293 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff15c6e28a794271ac61ca111d66a06e" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.188599 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29476b0bf2f34dcb913a665e3a008519" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.367545 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 34c330b5dd544ae686f741cdd85d023d (table default.Table_aa5c70a86540451b8a07688d25edc3b7 [id=bd246e92f35b47a2864b5da042da3232]) successfully deleted
I20251025 08:02:33.367722 17194 tablet_replica.cc:333] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
W20251025 08:02:33.367827 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet a3379087113041beba7ddbc6596c3b0a because the tablet was not found. No further retry: Not found: Tablet not found: a3379087113041beba7ddbc6596c3b0a
I20251025 08:02:33.367841 17194 raft_consensus.cc:2243] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.367928 17194 raft_consensus.cc:2272] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:33.367944 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet d709ecb9ac9a4525985c7d2bf10719f5 because the tablet was not found. No further retry: Not found: Tablet not found: d709ecb9ac9a4525985c7d2bf10719f5
W20251025 08:02:33.368053 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 212ccfb58f964d7bae31e5af110b4079 because the tablet was not found. No further retry: Not found: Tablet not found: 212ccfb58f964d7bae31e5af110b4079
W20251025 08:02:33.253113 15048 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.14.70.61:44347, user_credentials={real_user=slave}} blocked reactor thread for 93458.7us
I20251025 08:02:33.275218 17274 tablet_bootstrap.cc:492] T ff15c6e28a794271ac61ca111d66a06e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.368247 17194 ts_tablet_manager.cc:1916] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.368330 17274 ts_tablet_manager.cc:1403] T ff15c6e28a794271ac61ca111d66a06e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.247s user 0.002s sys 0.000s
I20251025 08:02:33.368732 17274 raft_consensus.cc:359] T ff15c6e28a794271ac61ca111d66a06e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.368827 17274 raft_consensus.cc:385] T ff15c6e28a794271ac61ca111d66a06e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.368862 17274 raft_consensus.cc:740] T ff15c6e28a794271ac61ca111d66a06e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.368978 17274 consensus_queue.cc:260] T ff15c6e28a794271ac61ca111d66a06e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.369238 17274 ts_tablet_manager.cc:1434] T ff15c6e28a794271ac61ca111d66a06e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:33.369395 17274 tablet_bootstrap.cc:492] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.370364 17194 ts_tablet_manager.cc:1929] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.370466 17194 log.cc:1199] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/1927cf6a9013402a92c9e6e89e2e1715
I20251025 08:02:33.370587 17274 tablet_bootstrap.cc:654] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.370734 17194 ts_tablet_manager.cc:1950] T 1927cf6a9013402a92c9e6e89e2e1715 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
W20251025 08:02:33.280026 15049 consensus_peers.cc:597] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c043ab70d7364e05b0b352ac5c416db1. This is attempt 1: this message will repeat every 5th retry.
W20251025 08:02:33.371096 15049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.70.3:45447, user_credentials={real_user=slave}} blocked reactor thread for 91090.7us
I20251025 08:02:33.371222 17194 tablet_replica.cc:333] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.371323 17194 raft_consensus.cc:2243] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.371421 17194 raft_consensus.cc:2272] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.371639 17536 consensus_queue.cc:1048] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:33.371840 15049 consensus_peers.cc:597] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43da3f4fc9604562a95dff59da3c574b. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:33.371924 15049 leader_election.cc:304] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.372037 15049 leader_election.cc:304] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.321585 17576 tablet.cc:1722] T c59083b54df24c21a3114c34a73dd638 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.372198 17536 raft_consensus.cc:2804] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.372268 17536 raft_consensus.cc:697] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:33.372411 17194 ts_tablet_manager.cc:1916] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.372382 17536 consensus_queue.cc:237] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.373376 17393 raft_consensus.cc:2804] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.373435 17393 raft_consensus.cc:493] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.373482 17393 raft_consensus.cc:3060] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.374047 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 1927cf6a9013402a92c9e6e89e2e1715 (table default.Table_d03eda3087a54490a502678eeeeeabc8 [id=1297b3a21b8a458d80575525d6df9783]) successfully deleted
I20251025 08:02:33.374281 17194 ts_tablet_manager.cc:1929] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.374333 17194 log.cc:1199] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/6a3ec64b273d4e8c92b1e24061ac7336
I20251025 08:02:33.374389 17393 raft_consensus.cc:515] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.374545 17194 ts_tablet_manager.cc:1950] T 6a3ec64b273d4e8c92b1e24061ac7336 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.374696 17393 leader_election.cc:290] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.374768 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ed2036a8ebd74ab18c0bbd6d9aa67ef0" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.374884 14974 raft_consensus.cc:2393] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:33.375382 17393 raft_consensus.cc:493] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.375459 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 6a3ec64b273d4e8c92b1e24061ac7336 (table default.Table_22425928df99434c8c133707c8a809ef [id=79c76995e71143438cb6e30a9df85c31]) successfully deleted
I20251025 08:02:33.375460 17393 raft_consensus.cc:515] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.375511 17194 tablet_replica.cc:333] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.375614 17194 raft_consensus.cc:2243] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.375689 17194 raft_consensus.cc:2272] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.375741 17393 leader_election.cc:290] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.376150 17194 ts_tablet_manager.cc:1916] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.378443 14977 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "95030a851b5d4155b235a4e896250c80" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.378543 14977 raft_consensus.cc:2468] T 95030a851b5d4155b235a4e896250c80 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:33.379170 17194 ts_tablet_manager.cc:1929] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.379288 17194 log.cc:1199] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/5bf286568e8343b7921ac256a9313e63
I20251025 08:02:33.379575 17194 ts_tablet_manager.cc:1950] T 5bf286568e8343b7921ac256a9313e63 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.380445 17194 tablet_replica.cc:333] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.380545 15864 raft_consensus.cc:493] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.380597 17194 raft_consensus.cc:2243] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.380585 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 5bf286568e8343b7921ac256a9313e63 (table default.Table_a9afe52cc64243a295d043eb385ef7d9 [id=46383e9b028a4d2bb7b39e04f147491e]) successfully deleted
I20251025 08:02:33.380620 15864 raft_consensus.cc:515] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.380668 17194 raft_consensus.cc:2272] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.380903 15864 leader_election.cc:290] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.381089 17194 ts_tablet_manager.cc:1916] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.382335 16391 tablet_bootstrap.cc:492] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.382416 16391 ts_tablet_manager.cc:1403] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20251025 08:02:33.382826 16391 raft_consensus.cc:359] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.382932 16391 raft_consensus.cc:385] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.382965 16391 raft_consensus.cc:740] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.383064 16391 consensus_queue.cc:260] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.382836 17194 ts_tablet_manager.cc:1929] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:33.383313 16391 ts_tablet_manager.cc:1434] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.383488 16391 tablet_bootstrap.cc:492] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.384044 14915 leader_election.cc:304] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:33.384179 15864 raft_consensus.cc:2749] T 77f04f445b5d47d2a78fdac0641a7372 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:33.384341 14915 leader_election.cc:304] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:33.384424 14915 raft_consensus.cc:2686] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251025 08:02:33.384620 14915 leader_election.cc:304] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:33.384750 15864 raft_consensus.cc:2749] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:33.384919 14915 leader_election.cc:304] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:33.385051 15864 raft_consensus.cc:3060] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.385795 15864 raft_consensus.cc:2749] T 82b93b7537c047aea430658ae2c2654b P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:33.385859 15497 raft_consensus.cc:493] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.385926 15497 raft_consensus.cc:515] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.386214 15497 leader_election.cc:290] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.386404 15497 consensus_queue.cc:1048] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:33.386893 15048 leader_election.cc:343] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:33.387097 15048 leader_election.cc:343] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.388268 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 60c49b70f8f44dd3aec433206b897843 (table default.Table_df3848a55c7646b1bd519eb12aa88aa1 [id=5160fad54600448f8b2c5bfc942f60a2]) successfully deleted
I20251025 08:02:33.388425 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet a2b8efa8ed634583b7bf7cc91bfc61a3 (table default.Table_c485105a684f427295b74968c29fd30c [id=3abb3c7d3dd74d408db083bf0499f679]) successfully deleted
I20251025 08:02:33.383304 17194 log.cc:1199] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/8362e26d86d44e9780d3c78c6a468556
I20251025 08:02:33.388834 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 93d383e3e2f4493d9cc8a71a4284e107 (table default.Table_0ac9d6fdd08b48f0b70da65d5f7a722a [id=7c9a46c4cada46ad916b89605c18190f]) successfully deleted
I20251025 08:02:33.388991 17194 ts_tablet_manager.cc:1950] T 8362e26d86d44e9780d3c78c6a468556 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.388994 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet b41e092b7f40410a979bcfd5bbc7c225 (table default.Table_e9a56ee98afd4b14bb77f82f256e8379 [id=7769118047914c3eb51e98a441aa5c50]) successfully deleted
I20251025 08:02:33.321748 17566 tablet.cc:1722] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.389495 17194 tablet_replica.cc:333] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.389639 17194 raft_consensus.cc:2243] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.389755 17194 raft_consensus.cc:2272] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.391288 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 8362e26d86d44e9780d3c78c6a468556 (table default.Table_5a29e7dba4ba43dfbd0c27981080a1ac [id=8611464429b848fbb277f6a03557cd0d]) successfully deleted
I20251025 08:02:33.391713 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 3c86ceda5c2c4583b9ff388e82b5369f (DEFAULT_TABLE table=default.Table_1af17555bf4d4cd480b16563fa2098e5 [id=767682c0185b4db09bb0bc784a7a971e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.391898 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c86ceda5c2c4583b9ff388e82b5369f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.392303 16288 master_service.cc:954] ReplaceTablet: received request to replace tablet 86b1873446154249a80fa67b99496545 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.393646 14945 tablet_service.cc:1505] Processing CreateTablet for tablet 54ac551e1e9a4bb1970be52edd04c0d3 (DEFAULT_TABLE table=default.Table_df3848a55c7646b1bd519eb12aa88aa1 [id=5160fad54600448f8b2c5bfc942f60a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.393843 14945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ac551e1e9a4bb1970be52edd04c0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.396778 15864 raft_consensus.cc:493] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.396849 15864 raft_consensus.cc:515] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.397120 15864 leader_election.cc:290] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.397526 17194 ts_tablet_manager.cc:1916] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.397734 16280 master_service.cc:954] ReplaceTablet: received request to replace tablet b4d1c652b6a4420a81e03cd58c6dbc69 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.399773 17194 ts_tablet_manager.cc:1929] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:33.399835 17194 log.cc:1199] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/16f1ab00a20345a1bb51e685b3fc6c70
I20251025 08:02:33.402032 16391 tablet_bootstrap.cc:654] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.402293 16279 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_6698a850627e4288bd367296b595759e [id=5c3e59374e02472bb347c7891cb16537] alter complete (version 1)
I20251025 08:02:33.402582 17194 ts_tablet_manager.cc:1950] T 16f1ab00a20345a1bb51e685b3fc6c70 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.403115 17274 tablet_bootstrap.cc:492] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.403177 17194 tablet_replica.cc:333] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.403223 17274 ts_tablet_manager.cc:1403] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
I20251025 08:02:33.403281 17194 raft_consensus.cc:2243] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.403360 17194 raft_consensus.cc:2272] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.403344 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 16f1ab00a20345a1bb51e685b3fc6c70 (table default.Table_9419360c7ef742d196d6ac96f41241f1 [id=31777251b0174ff684a84b14f630d643]) successfully deleted
W20251025 08:02:33.403474 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 1e248b8303b1498e96178d4e46ad691e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e248b8303b1498e96178d4e46ad691e already in progress: creating tablet
I20251025 08:02:33.403698 17274 raft_consensus.cc:359] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.403802 17274 raft_consensus.cc:385] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.403838 17274 raft_consensus.cc:740] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.403949 17274 consensus_queue.cc:260] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.404474 17274 ts_tablet_manager.cc:1434] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.404829 17194 ts_tablet_manager.cc:1916] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.404894 17198 raft_consensus.cc:2243] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.405314 17198 raft_consensus.cc:2272] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.405689 17198 ts_tablet_manager.cc:1916] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.405928 17274 tablet_bootstrap.cc:492] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.406831 17274 tablet_bootstrap.cc:654] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.407332 17194 ts_tablet_manager.cc:1929] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:33.407404 17194 log.cc:1199] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/f5f72ca8cfb94178a21619ddc9fc0352
I20251025 08:02:33.407608 17194 ts_tablet_manager.cc:1950] T f5f72ca8cfb94178a21619ddc9fc0352 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.407719 17198 ts_tablet_manager.cc:1929] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.407789 17198 log.cc:1199] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/fbae08a3a1c34dfda60b1985346e7761
I20251025 08:02:33.408026 17198 ts_tablet_manager.cc:1950] T fbae08a3a1c34dfda60b1985346e7761 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:33.408131 17194 tablet_replica.cc:333] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.408207 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet f5f72ca8cfb94178a21619ddc9fc0352 (table default.Table_75b0519af19a461d8dd5bdfd0c7a50c5 [id=b73d5c5cd3824129b9efc54f3aa7c304]) successfully deleted
I20251025 08:02:33.408255 17194 raft_consensus.cc:2243] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.408344 17194 raft_consensus.cc:2272] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.408774 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 62) took 1117 ms. Trace:
I20251025 08:02:33.408854 17198 rpcz_store.cc:276] 1025 08:02:32.291304 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.291382 (+ 78us) service_pool.cc:225] Handling call
1025 08:02:33.364807 (+1073425us) ts_tablet_manager.cc:1151] Deleting tablet fbae08a3a1c34dfda60b1985346e7761
1025 08:02:33.364812 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:33.406788 (+ 41976us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:33.407671 (+ 883us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:33.408759 (+ 1088us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1064246}
I20251025 08:02:33.409102 17198 tablet_replica.cc:333] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:33.409236 17198 raft_consensus.cc:2243] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.409323 17198 raft_consensus.cc:2272] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.409582 17198 ts_tablet_manager.cc:1916] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.410559 16391 tablet_bootstrap.cc:492] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.410647 16391 ts_tablet_manager.cc:1403] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.027s user 0.000s sys 0.001s
I20251025 08:02:33.411032 16391 raft_consensus.cc:359] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.411121 16391 raft_consensus.cc:385] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.411160 16391 raft_consensus.cc:740] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.411296 16391 consensus_queue.cc:260] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.411564 16391 ts_tablet_manager.cc:1434] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:33.411731 16391 tablet_bootstrap.cc:492] T fc485ee4814142cda9be0d937aaa5dc1 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.412420 16391 tablet_bootstrap.cc:654] T fc485ee4814142cda9be0d937aaa5dc1 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.414427 14945 tablet_service.cc:1505] Processing CreateTablet for tablet d4bf7ad8c26a42c5a2704bc005062ea3 (DEFAULT_TABLE table=default.Table_a9114bb65ce7472fa79f74bed2243563 [id=9e5da7dd17cd45ea800b3361736db041]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.414609 14945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4bf7ad8c26a42c5a2704bc005062ea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.419243 17194 ts_tablet_manager.cc:1916] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.421145 17194 ts_tablet_manager.cc:1929] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.421218 17194 log.cc:1199] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/8b6ae6527fd64c3bb5999dec97db861d
I20251025 08:02:33.421540 17194 ts_tablet_manager.cc:1950] T 8b6ae6527fd64c3bb5999dec97db861d P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.421964 17194 tablet_replica.cc:333] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.422036 17274 tablet_bootstrap.cc:492] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.422068 17194 raft_consensus.cc:2243] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.422096 17274 ts_tablet_manager.cc:1403] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20251025 08:02:33.422139 17194 raft_consensus.cc:2272] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.422441 17194 ts_tablet_manager.cc:1916] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.422449 17274 raft_consensus.cc:359] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.422521 17274 raft_consensus.cc:385] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.422544 17274 raft_consensus.cc:740] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.422614 17274 consensus_queue.cc:260] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.422681 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 8b6ae6527fd64c3bb5999dec97db861d (table default.Table_599c0d46a95d45b4aa9bab3b54b52470 [id=b8e6ffed1a2e442db3c9ee5ac1a6ff3d]) successfully deleted
I20251025 08:02:33.424250 17194 ts_tablet_manager.cc:1929] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.424312 17194 log.cc:1199] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/ed5ed91e953d42afa9ebf9ab8b89d0e6
I20251025 08:02:33.424557 17194 ts_tablet_manager.cc:1950] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.424922 17274 ts_tablet_manager.cc:1434] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:33.425036 17194 tablet_replica.cc:333] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.425092 17274 tablet_bootstrap.cc:492] T fc485ee4814142cda9be0d937aaa5dc1 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.425117 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet ed5ed91e953d42afa9ebf9ab8b89d0e6 (table default.Table_a901c364849c4301910d7c32f0ec25fc [id=cadc2427db7c404cbbf9d3542145cccc]) successfully deleted
I20251025 08:02:33.425165 17194 raft_consensus.cc:2243] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.425375 17194 raft_consensus.cc:2272] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.425664 17194 ts_tablet_manager.cc:1916] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.425931 17274 tablet_bootstrap.cc:654] T fc485ee4814142cda9be0d937aaa5dc1 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.426091 16282 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_8876401911a841b68376afacf6bc7e08"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.426494 16282 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8876401911a841b68376afacf6bc7e08 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.427531 17194 ts_tablet_manager.cc:1929] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20251025 08:02:33.427603 17194 log.cc:1199] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/f8576553f17b49f8bd11436ecac471ed
I20251025 08:02:33.427857 17194 ts_tablet_manager.cc:1950] T f8576553f17b49f8bd11436ecac471ed P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.428344 17194 tablet_replica.cc:333] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.428444 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet f8576553f17b49f8bd11436ecac471ed (table default.Table_d80d24fe6db14f0da8149898449ae86e [id=2283253a9522485d93d6c484c5eef6e4]) successfully deleted
I20251025 08:02:33.428467 17194 raft_consensus.cc:2243] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.428550 17194 raft_consensus.cc:2272] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.428862 17194 ts_tablet_manager.cc:1916] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.430065 17274 tablet_bootstrap.cc:492] T fc485ee4814142cda9be0d937aaa5dc1 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.430127 17274 ts_tablet_manager.cc:1403] T fc485ee4814142cda9be0d937aaa5dc1 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251025 08:02:33.430629 17194 ts_tablet_manager.cc:1929] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.430689 17194 log.cc:1199] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/54de7e83e8ea42ef93218b0204c61ec6
I20251025 08:02:33.430648 17274 raft_consensus.cc:359] T fc485ee4814142cda9be0d937aaa5dc1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.430740 17274 raft_consensus.cc:385] T fc485ee4814142cda9be0d937aaa5dc1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.430766 17274 raft_consensus.cc:740] T fc485ee4814142cda9be0d937aaa5dc1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.430850 17274 consensus_queue.cc:260] T fc485ee4814142cda9be0d937aaa5dc1 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.431064 17274 ts_tablet_manager.cc:1434] T fc485ee4814142cda9be0d937aaa5dc1 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.431188 17274 tablet_bootstrap.cc:492] T 07b76abb029e4555851dfdc73ab31a38 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.431943 17274 tablet_bootstrap.cc:654] T 07b76abb029e4555851dfdc73ab31a38 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.432665 14945 tablet_service.cc:1505] Processing CreateTablet for tablet 9ecb15be5f5c48f1bd68e56b65543fad (DEFAULT_TABLE table=default.Table_05bac665c2114dacac7804da6adfc06e [id=9aee333b5b9f4e1daba6449f643ea43a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.432850 14945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecb15be5f5c48f1bd68e56b65543fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.434347 14952 tablet_service.cc:1505] Processing CreateTablet for tablet c23d5d373a30413b94508b50dd4fec89 (DEFAULT_TABLE table=default.Table_0d9ad032e51f4c38aecebf16793e490d [id=2ac1c7a6a67943a5af05c1f2c7e6b65e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.434527 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23d5d373a30413b94508b50dd4fec89. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.435667 14943 tablet_service.cc:1505] Processing CreateTablet for tablet 52765e926e904ec9b052db3135cfb77a (DEFAULT_TABLE table=default.Table_492cb5cd156a4d1a910aa96ecf028de1 [id=6716c87cf323485893ce723e76924979]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.435847 14943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52765e926e904ec9b052db3135cfb77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.286783 17258 ts_tablet_manager.cc:1916] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.436549 15183 leader_election.cc:304] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:33.436770 17369 raft_consensus.cc:2749] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:33.436939 15183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.70.1:35401, user_credentials={real_user=slave}} blocked reactor thread for 151967us
I20251025 08:02:33.436980 14940 tablet_service.cc:1505] Processing CreateTablet for tablet 1dacca1fcbad4795835ec08c8bd0dc3c (DEFAULT_TABLE table=default.Table_0a42fcc0637248fd9048c6d9d9e6055e [id=438ba3cc67564d1bac9cd6653033546e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.437162 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dacca1fcbad4795835ec08c8bd0dc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.437142 17369 consensus_queue.cc:1048] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.438839 17258 ts_tablet_manager.cc:1929] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.438911 17258 log.cc:1199] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/ae3c8e134d164edd8781f27e7bdc3b92
I20251025 08:02:33.439186 17258 ts_tablet_manager.cc:1950] T ae3c8e134d164edd8781f27e7bdc3b92 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.435808 14941 tablet_service.cc:1505] Processing CreateTablet for tablet d20a130fc8ea40ddba509d2825ac028d (DEFAULT_TABLE table=default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:33.439299 15183 leader_election.cc:343] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.439375 15183 leader_election.cc:304] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:33.439435 14941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d20a130fc8ea40ddba509d2825ac028d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.295315 16390 tablet_bootstrap.cc:492] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:33.439549 16390 ts_tablet_manager.cc:1403] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.202s user 0.000s sys 0.002s
I20251025 08:02:33.439661 17369 raft_consensus.cc:2749] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:33.439945 16390 raft_consensus.cc:359] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.440047 16390 raft_consensus.cc:385] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.440080 16390 raft_consensus.cc:740] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.440181 16390 consensus_queue.cc:260] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.305959 17372 raft_consensus.cc:493] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.440317 17372 raft_consensus.cc:515] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.440646 17372 leader_election.cc:290] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:33.309442 15225 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42704: Illegal state: replica f0f2f8ce3e9f4d9ba3f3f02813397c31 is not leader of this config: current role FOLLOWER
I20251025 08:02:33.440838 17369 consensus_queue.cc:1048] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.315508 17530 tablet.cc:1722] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.317585 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet 17339d7c0a4b40a78b3252d17481c192 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.324855 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84d6bed24444dcfab1920efad849932" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.351073 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 2f64072c416f4a77b1c81855d7db8f01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.441329 15248 raft_consensus.cc:2468] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:33.360253 15226 tablet_service.cc:1552] Processing DeleteTablet for tablet be8d6685c70c4219947df30f023a59b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.360431 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet 85c7748077184fdda472821a0826cd77 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.441437 15048 leader_election.cc:304] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:33.360540 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet ce5ae591c86c4455a1dd3704f1c95d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.441713 17536 raft_consensus.cc:2749] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:33.370537 15185 leader_election.cc:343] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.392189 15219 tablet_service.cc:1505] Processing CreateTablet for tablet 3c86ceda5c2c4583b9ff388e82b5369f (DEFAULT_TABLE table=default.Table_1af17555bf4d4cd480b16563fa2098e5 [id=767682c0185b4db09bb0bc784a7a971e]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:33.442217 15185 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.70.2:37455, user_credentials={real_user=slave}} blocked reactor thread for 71685.1us
W20251025 08:02:33.442329 15185 leader_election.cc:343] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.442374 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c86ceda5c2c4583b9ff388e82b5369f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.393448 15221 tablet_service.cc:1505] Processing CreateTablet for tablet edfb86283bda491993a456e365f8760f (DEFAULT_TABLE table=default.Table_d9fe75661236465ca4c58953ed0023c4 [id=c0f5ecd0d89d409785fbd905d22e3fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.443006 15221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfb86283bda491993a456e365f8760f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.443141 15240 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dafad70d3f69440c9d42e8ee73123d2d" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.443246 15240 raft_consensus.cc:2468] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:33.443364 14914 leader_election.cc:304] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.443414 15238 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "45a22457031a4eff8e82fa232b6f05bb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.443506 15238 raft_consensus.cc:2468] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:33.444253 15864 raft_consensus.cc:2804] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.444301 15864 raft_consensus.cc:493] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.444335 15864 raft_consensus.cc:3060] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.444316 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dafad70d3f69440c9d42e8ee73123d2d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.444416 15110 raft_consensus.cc:2468] T dafad70d3f69440c9d42e8ee73123d2d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
W20251025 08:02:33.444571 15048 consensus_peers.cc:597] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20251025 08:02:33.445039 15048 consensus_peers.cc:597] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bfdc6022cc5747439edcb8aa865b9437. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:33.445138 15864 raft_consensus.cc:515] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.445433 15864 leader_election.cc:290] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.445647 15048 leader_election.cc:304] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:33.445794 17393 raft_consensus.cc:2764] T 95030a851b5d4155b235a4e896250c80 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20251025 08:02:33.446079 17576 tablet.cc:1722] T a941ba28528d41699390e9db80f25594 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20251025 08:02:33.446154 15048 consensus_peers.cc:597] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43da3f4fc9604562a95dff59da3c574b. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:33.446339 17566 tablet.cc:1722] T d14e12c45323420b84de06d828238caa P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:33.393530 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 54ac551e1e9a4bb1970be52edd04c0d3 (DEFAULT_TABLE table=default.Table_df3848a55c7646b1bd519eb12aa88aa1 [id=5160fad54600448f8b2c5bfc942f60a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.418501 17373 raft_consensus.cc:493] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.446621 17373 raft_consensus.cc:515] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.446697 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ac551e1e9a4bb1970be52edd04c0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.446897 17373 leader_election.cc:290] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.428996 17591 tablet.cc:1722] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:33.448498 15185 leader_election.cc:304] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.431020 15228 tablet_service.cc:1505] Processing CreateTablet for tablet d4bf7ad8c26a42c5a2704bc005062ea3 (DEFAULT_TABLE table=default.Table_a9114bb65ce7472fa79f74bed2243563 [id=9e5da7dd17cd45ea800b3361736db041]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.448614 17373 raft_consensus.cc:2804] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.448662 17373 raft_consensus.cc:493] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.448696 17373 raft_consensus.cc:3060] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.448730 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4bf7ad8c26a42c5a2704bc005062ea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.449326 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84d6bed24444dcfab1920efad849932" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:33.449414 15239 raft_consensus.cc:3060] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.449540 17373 raft_consensus.cc:515] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.449803 17373 leader_election.cc:290] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.449975 14914 leader_election.cc:304] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.450109 14914 leader_election.cc:304] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.450171 16285 master_service.cc:954] ReplaceTablet: received request to replace tablet b4d1c652b6a4420a81e03cd58c6dbc69 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.432089 15210 tablet_service.cc:1505] Processing CreateTablet for tablet 9ecb15be5f5c48f1bd68e56b65543fad (DEFAULT_TABLE table=default.Table_05bac665c2114dacac7804da6adfc06e [id=9aee333b5b9f4e1daba6449f643ea43a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.450567 17415 raft_consensus.cc:2804] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.450626 17415 raft_consensus.cc:493] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.450654 15210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecb15be5f5c48f1bd68e56b65543fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.450666 17415 raft_consensus.cc:3060] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.450858 15239 raft_consensus.cc:2468] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:33.451473 17415 raft_consensus.cc:515] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.451802 17415 leader_election.cc:290] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.451911 17415 raft_consensus.cc:2804] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.451947 17415 raft_consensus.cc:493] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.451979 17415 raft_consensus.cc:3060] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.433018 15218 tablet_service.cc:1505] Processing CreateTablet for tablet c23d5d373a30413b94508b50dd4fec89 (DEFAULT_TABLE table=default.Table_0d9ad032e51f4c38aecebf16793e490d [id=2ac1c7a6a67943a5af05c1f2c7e6b65e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.452646 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23d5d373a30413b94508b50dd4fec89. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.452730 17415 raft_consensus.cc:515] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.452981 17415 leader_election.cc:290] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.453509 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98baf6e8d8e84b42a83054495ae19e01" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.453680 17043 raft_consensus.cc:493] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.453747 17043 raft_consensus.cc:515] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.454021 17043 leader_election.cc:290] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.434262 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 52765e926e904ec9b052db3135cfb77a (DEFAULT_TABLE table=default.Table_492cb5cd156a4d1a910aa96ecf028de1 [id=6716c87cf323485893ce723e76924979]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.454548 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52765e926e904ec9b052db3135cfb77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.456528 17316 raft_consensus.cc:493] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.456589 17316 raft_consensus.cc:515] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.456873 17316 leader_election.cc:290] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.456981 17316 raft_consensus.cc:493] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.457026 17316 raft_consensus.cc:515] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.457245 17316 leader_election.cc:290] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.435411 15211 tablet_service.cc:1505] Processing CreateTablet for tablet 1dacca1fcbad4795835ec08c8bd0dc3c (DEFAULT_TABLE table=default.Table_0a42fcc0637248fd9048c6d9d9e6055e [id=438ba3cc67564d1bac9cd6653033546e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.457712 15211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dacca1fcbad4795835ec08c8bd0dc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.458292 16288 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 86b1873446154249a80fa67b99496545
I20251025 08:02:33.458545 16288 catalog_manager.cc:6719] ReplaceTablet: tablet 86b1873446154249a80fa67b99496545 deleted and replaced by tablet 5fcded6ebe3a42f4a83a65e44c080120
I20251025 08:02:33.458748 16280 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet b4d1c652b6a4420a81e03cd58c6dbc69
I20251025 08:02:33.458895 16280 catalog_manager.cc:6719] ReplaceTablet: tablet b4d1c652b6a4420a81e03cd58c6dbc69 deleted and replaced by tablet 9b9ff161e6034353a824cf8ab9489a73
I20251025 08:02:33.459554 16390 ts_tablet_manager.cc:1434] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.020s user 0.000s sys 0.001s
I20251025 08:02:33.459686 16390 tablet_bootstrap.cc:492] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:33.460602 16390 tablet_bootstrap.cc:654] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.461254 16286 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_83bb382534b740f383e0ddc24667d244 [id=aa46eca7031242f3b4a3144dd521cc6b] alter complete (version 2)
I20251025 08:02:33.462522 16280 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_e3c8607d64ae4ee1b9c2d05ed6cb8eb6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.462714 15185 leader_election.cc:343] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:33.462855 16280 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3c8607d64ae4ee1b9c2d05ed6cb8eb6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.463007 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "45a22457031a4eff8e82fa232b6f05bb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:33.463093 15239 raft_consensus.cc:3060] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.463498 14914 leader_election.cc:304] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.463565 15242 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5e907ec8e7c420d8d6d68a954cc8beb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.463687 15242 raft_consensus.cc:2468] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:33.463850 17043 raft_consensus.cc:2804] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.463908 17043 raft_consensus.cc:697] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:33.463899 15239 raft_consensus.cc:2468] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:33.464002 17043 consensus_queue.cc:237] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.464082 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dafad70d3f69440c9d42e8ee73123d2d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:33.464116 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adb2c77ec9b84fe8846084cddc23888a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.464174 15109 raft_consensus.cc:3060] T dafad70d3f69440c9d42e8ee73123d2d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.464619 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dafad70d3f69440c9d42e8ee73123d2d" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:33.464726 15248 raft_consensus.cc:2393] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:33.464691 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_c106c0d4d9c74a81924952f3e165d6e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.464995 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c106c0d4d9c74a81924952f3e165d6e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.465044 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 86b1873446154249a80fa67b99496545 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fcded6ebe3a42f4a83a65e44c080120) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.465142 15211 tablet_service.cc:1552] Processing DeleteTablet for tablet b4d1c652b6a4420a81e03cd58c6dbc69 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b9ff161e6034353a824cf8ab9489a73) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.465121 15109 raft_consensus.cc:2468] T dafad70d3f69440c9d42e8ee73123d2d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:33.465512 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc485ee4814142cda9be0d937aaa5dc1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.465615 17258 tablet_replica.cc:333] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.465611 15111 raft_consensus.cc:2468] T fc485ee4814142cda9be0d937aaa5dc1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:33.465736 17258 raft_consensus.cc:2243] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.465813 17258 raft_consensus.cc:2272] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.466153 17258 ts_tablet_manager.cc:1916] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.466481 16283 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_2942acd29f7c42ceb19355a101b68dd8" } new_table_name: "default.Table_fc45669554034bd9acfbd2e54bbb9dad" modify_external_catalogs: true
I20251025 08:02:33.466650 14943 tablet_service.cc:1552] Processing DeleteTablet for tablet b4d1c652b6a4420a81e03cd58c6dbc69 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b9ff161e6034353a824cf8ab9489a73) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.466779 14941 tablet_service.cc:1552] Processing DeleteTablet for tablet 86b1873446154249a80fa67b99496545 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fcded6ebe3a42f4a83a65e44c080120) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.467157 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_047beef8f8ac418783052f81f56b8667"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.467417 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_047beef8f8ac418783052f81f56b8667 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.467996 17258 ts_tablet_manager.cc:1929] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.468055 17258 log.cc:1199] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/6dd0f695a2904df5b750b45782a21ce2
I20251025 08:02:33.468284 17258 ts_tablet_manager.cc:1950] T 6dd0f695a2904df5b750b45782a21ce2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.468533 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet ae3c8e134d164edd8781f27e7bdc3b92 (table default.Table_67e95c34b6c44449abf8828cc3b6e9c2 [id=b0f029b25327468c94a2c78b37c6d203]) successfully deleted
W20251025 08:02:33.468663 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 446194cf013c4b6499deb00fab8db42a because the tablet was not found. No further retry: Not found: Tablet not found: 446194cf013c4b6499deb00fab8db42a
I20251025 08:02:33.468708 16285 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_b9fd1eb722b44b99bb445efa0d2bfc72" } new_table_name: "default.Table_093d20ac970543978ab5c4900b681def" modify_external_catalogs: true
I20251025 08:02:33.469556 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 6dd0f695a2904df5b750b45782a21ce2 (table default.Table_891766baabb34ace9d4695004f20f425 [id=84b17130403b4b9fad63483a5660fe37]) successfully deleted
I20251025 08:02:33.469761 17258 tablet_replica.cc:333] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.469900 17258 raft_consensus.cc:2243] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.470093 17258 raft_consensus.cc:2272] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.470465 17258 ts_tablet_manager.cc:1916] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.472220 17258 ts_tablet_manager.cc:1929] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.472324 17258 log.cc:1199] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/e106f20977444dd4a49b6e4ae0f45380
I20251025 08:02:33.472592 17258 ts_tablet_manager.cc:1950] T e106f20977444dd4a49b6e4ae0f45380 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.472750 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_7a23a84cd5c446c8b427b73c956ca350"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.473028 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a23a84cd5c446c8b427b73c956ca350 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:33.474746 15185 leader_election.cc:343] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.474992 14914 leader_election.cc:304] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.475040 15185 leader_election.cc:304] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.475153 14914 leader_election.cc:304] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.475168 15864 raft_consensus.cc:2804] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.475201 15185 leader_election.cc:304] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.475229 15864 raft_consensus.cc:493] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.475265 15864 raft_consensus.cc:3060] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.475421 15384 raft_consensus.cc:2804] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.475492 15384 raft_consensus.cc:697] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:33.475589 17373 raft_consensus.cc:2804] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.475638 17373 raft_consensus.cc:493] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.475677 17373 raft_consensus.cc:3060] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.475780 17043 raft_consensus.cc:2804] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.475850 17043 raft_consensus.cc:697] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:33.475948 17043 consensus_queue.cc:237] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.476032 15864 raft_consensus.cc:515] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.476330 15864 leader_election.cc:290] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.476533 17373 raft_consensus.cc:515] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.476815 17373 leader_election.cc:290] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.475595 15384 consensus_queue.cc:237] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.475378 17372 consensus_queue.cc:1048] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.478293 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet e106f20977444dd4a49b6e4ae0f45380 (table default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]) successfully deleted
I20251025 08:02:33.478560 17258 tablet_replica.cc:333] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.478818 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5e907ec8e7c420d8d6d68a954cc8beb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:33.478904 15248 raft_consensus.cc:3060] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.479277 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc485ee4814142cda9be0d937aaa5dc1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:33.479364 15107 raft_consensus.cc:3060] T fc485ee4814142cda9be0d937aaa5dc1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.479668 15248 raft_consensus.cc:2468] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:33.478719 17258 raft_consensus.cc:2243] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.479986 17258 raft_consensus.cc:2272] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.480297 15107 raft_consensus.cc:2468] T fc485ee4814142cda9be0d937aaa5dc1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:33.480340 17258 ts_tablet_manager.cc:1916] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.481784 15185 leader_election.cc:304] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.481928 17369 raft_consensus.cc:2804] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.482015 17369 raft_consensus.cc:697] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:33.482021 14914 leader_election.cc:304] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.482128 17369 consensus_queue.cc:237] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.482163 15864 raft_consensus.cc:2804] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.482381 15864 raft_consensus.cc:697] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:33.482484 15864 consensus_queue.cc:237] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.485971 16390 tablet_bootstrap.cc:492] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:33.486053 16390 ts_tablet_manager.cc:1403] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.026s user 0.001s sys 0.001s
I20251025 08:02:33.486456 16390 raft_consensus.cc:359] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.486547 16390 raft_consensus.cc:385] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.486577 16390 raft_consensus.cc:740] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.486680 16390 consensus_queue.cc:260] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.486888 16390 ts_tablet_manager.cc:1434] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:33.487025 16390 tablet_bootstrap.cc:492] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:33.487838 16390 tablet_bootstrap.cc:654] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.489864 16282 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_e1b8cc9321994d33976994fc3b9858b6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.490267 16282 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e1b8cc9321994d33976994fc3b9858b6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.492122 17258 ts_tablet_manager.cc:1929] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.492246 17258 log.cc:1199] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/23eedc2695db43afbd6f5dbebb0ea2be
I20251025 08:02:33.492537 17258 ts_tablet_manager.cc:1950] T 23eedc2695db43afbd6f5dbebb0ea2be P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.493104 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 23eedc2695db43afbd6f5dbebb0ea2be (table default.Table_d9fe75661236465ca4c58953ed0023c4 [id=c0f5ecd0d89d409785fbd905d22e3fc2]) successfully deleted
I20251025 08:02:33.493321 17258 tablet_replica.cc:333] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.493460 17258 raft_consensus.cc:2243] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.494380 17194 ts_tablet_manager.cc:1950] T 54de7e83e8ea42ef93218b0204c61ec6 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.495086 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 54de7e83e8ea42ef93218b0204c61ec6 (table default.Table_a6bf9c572cb3485f9ecced6d0d55877d [id=26a6f00041d04924b3e8eb2b279b55de]) successfully deleted
I20251025 08:02:33.495324 17194 tablet_replica.cc:333] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.495488 17194 raft_consensus.cc:2243] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.495640 17194 raft_consensus.cc:2272] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.496023 17194 ts_tablet_manager.cc:1916] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.496428 17258 raft_consensus.cc:2272] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.496603 17274 tablet_bootstrap.cc:492] T 07b76abb029e4555851dfdc73ab31a38 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.496680 17274 ts_tablet_manager.cc:1403] T 07b76abb029e4555851dfdc73ab31a38 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.066s user 0.002s sys 0.000s
I20251025 08:02:33.496749 17258 ts_tablet_manager.cc:1916] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.498142 17194 ts_tablet_manager.cc:1929] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.498785 16390 tablet_bootstrap.cc:492] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:33.498867 16390 ts_tablet_manager.cc:1403] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.002s
I20251025 08:02:33.499123 17194 log.cc:1199] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/e2b014e0f49c4f7da8e65b7d4c98ea63
I20251025 08:02:33.499256 16390 raft_consensus.cc:359] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.499348 16390 raft_consensus.cc:385] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.499390 16390 raft_consensus.cc:740] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.499490 17194 ts_tablet_manager.cc:1950] T e2b014e0f49c4f7da8e65b7d4c98ea63 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.499491 16390 consensus_queue.cc:260] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.499748 16390 ts_tablet_manager.cc:1434] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:33.499904 16390 tablet_bootstrap.cc:492] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:33.500527 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet e2b014e0f49c4f7da8e65b7d4c98ea63 (table default.Table_5228048f3783458dbb44280a7a6e4816 [id=7fe739c2f676459d8c73632266babedb]) successfully deleted
I20251025 08:02:33.500701 16390 tablet_bootstrap.cc:654] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.506278 17274 raft_consensus.cc:359] T 07b76abb029e4555851dfdc73ab31a38 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.506384 17274 raft_consensus.cc:385] T 07b76abb029e4555851dfdc73ab31a38 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.506420 17274 raft_consensus.cc:740] T 07b76abb029e4555851dfdc73ab31a38 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.506508 17274 consensus_queue.cc:260] T 07b76abb029e4555851dfdc73ab31a38 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.506568 17194 tablet_replica.cc:333] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.506785 17194 raft_consensus.cc:2243] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.506796 17274 ts_tablet_manager.cc:1434] T 07b76abb029e4555851dfdc73ab31a38 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:33.506928 17194 raft_consensus.cc:2272] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.507213 17258 ts_tablet_manager.cc:1929] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.507335 17258 log.cc:1199] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/ff20cd7d33a440bab24bd4a61fff1f30
I20251025 08:02:33.507618 17258 ts_tablet_manager.cc:1950] T ff20cd7d33a440bab24bd4a61fff1f30 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.508250 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]) successfully deleted
I20251025 08:02:33.508469 17258 tablet_replica.cc:333] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.508644 17258 raft_consensus.cc:2243] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.508828 17258 raft_consensus.cc:2272] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.510241 17274 tablet_bootstrap.cc:492] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.510547 17194 ts_tablet_manager.cc:1916] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.511265 17274 tablet_bootstrap.cc:654] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.512398 17258 ts_tablet_manager.cc:1916] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.512712 17194 ts_tablet_manager.cc:1929] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.512831 17194 log.cc:1199] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/17339d7c0a4b40a78b3252d17481c192
I20251025 08:02:33.513136 17194 ts_tablet_manager.cc:1950] T 17339d7c0a4b40a78b3252d17481c192 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.514488 17258 ts_tablet_manager.cc:1929] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.514600 17258 log.cc:1199] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/64996b8137f647b993923cb1bb093211
I20251025 08:02:33.514685 16390 tablet_bootstrap.cc:492] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:33.514758 16390 ts_tablet_manager.cc:1403] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.001s
I20251025 08:02:33.514885 17258 ts_tablet_manager.cc:1950] T 64996b8137f647b993923cb1bb093211 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.515182 16390 raft_consensus.cc:359] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.515273 16390 raft_consensus.cc:385] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.515311 16390 raft_consensus.cc:740] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.515403 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 64996b8137f647b993923cb1bb093211 (table default.Table_c8ac7973eef94a68bf4ebe1459c2e6e6 [id=3c371b3791fd45be983458cd55d67827]) successfully deleted
I20251025 08:02:33.515411 16390 consensus_queue.cc:260] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.515564 17258 tablet_replica.cc:333] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.515688 16390 ts_tablet_manager.cc:1434] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20251025 08:02:33.515921 15048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.70.1:35401, user_credentials={real_user=slave}} blocked reactor thread for 69640.7us
W20251025 08:02:33.516077 15048 consensus_peers.cc:597] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff20cd7d33a440bab24bd4a61fff1f30. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:33.517621 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet f8576553f17b49f8bd11436ecac471ed with delete_type TABLET_DATA_DELETED (replaced by tablet 61c8a83c2146418184842b7d7dd594fa) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.517743 15086 tablet_service.cc:1552] Processing DeleteTablet for tablet 54de7e83e8ea42ef93218b0204c61ec6 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ae883acfacf451495ae73e1e813ec71) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.517982 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 6b16e4b9ef4c41db83ab3bf55149719b (DEFAULT_TABLE table=default.Table_bf6a70d1926d4a9da3c3ee62f85bf2cf [id=7b0f2a2cf9de45ed9a2dd070deaa13a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.518364 15094 tablet_service.cc:1505] Processing CreateTablet for tablet d0de3ec67dcc4e41a447338869076314 (DEFAULT_TABLE table=default.Table_5f52465815d64efda49e01e13789088e [id=4590a287cbc24df7ab303a5b8ce87007]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.518496 15082 tablet_service.cc:1505] Processing CreateTablet for tablet 0f141107d4674690acd51e499bc4e208 (DEFAULT_TABLE table=default.Table_9ba393cca8d548bcb6a5b34c49969893 [id=ee49c87b7ddc47f28029112a49b5665b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.518728 15087 tablet_service.cc:1505] Processing CreateTablet for tablet aae693881f9d40c789d242c6de5d9905 (DEFAULT_TABLE table=default.Table_8065852bc26846929a54ba0b632cf16b [id=6394f825a52f496c983151503252b502]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.518806 15085 tablet_service.cc:1505] Processing CreateTablet for tablet 334015a0a5aa42c8b127d64e794c2705 (DEFAULT_TABLE table=default.Table_34881ec032724dac94217f71be36dd45 [id=7a1037f752964f4297e98d6179eee165]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.518380 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 2c614480578945839a6662bafc62726c (DEFAULT_TABLE table=default.Table_bd4d865a11f940b183fb4f06cd4da881 [id=b080141fd09a489da6324d45421c2fac]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.519179 15081 tablet_service.cc:1505] Processing CreateTablet for tablet 3caafcc644e34ec1acc0d3741fd34721 (DEFAULT_TABLE table=default.Table_6c9870e0994744ba98aace68eba418f6 [id=984010acd02142579a16d6897862efb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.519510 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 17339d7c0a4b40a78b3252d17481c192 (table default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]) successfully deleted
I20251025 08:02:33.519515 15080 tablet_service.cc:1505] Processing CreateTablet for tablet 12a6b5f9ed8041e9929c9f1673ac212a (DEFAULT_TABLE table=default.Table_8d895bf14fe042d7832bde868edc0e61 [id=270c8b1a2ef34d80a82bb0de00c72db0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.519817 15083 tablet_service.cc:1505] Processing CreateTablet for tablet 5dc32b27b3f743bf8719e39ea8c20e34 (DEFAULT_TABLE table=default.Table_5402989ff9f84c51b18f63d334655e33 [id=adee939435074550bb85b2f00c102367]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.519987 15078 tablet_service.cc:1505] Processing CreateTablet for tablet c079391742cc4d488826c5536ab6d1d1 (DEFAULT_TABLE table=default.Table_8a52f20ffb6e455f9c5bc212cd09c071 [id=0434a2fb173a495a895b11aa307bf44f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.520134 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 879ae11ae94b4d2eab76c1dc74e160ca (DEFAULT_TABLE table=default.Table_e355ea0deef54efd87fb7938c19b9547 [id=141db142f9034f4bb225526996a54b92]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.520313 15077 tablet_service.cc:1505] Processing CreateTablet for tablet ea8a95b8fbf94520a2c219755cdc5d14 (DEFAULT_TABLE table=default.Table_753a908ca3a540568e454f247a3f6fd4 [id=c77692f42923422a853159374c35a59c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.520371 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84d6bed24444dcfab1920efad849932" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.520434 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 76c31d4c83c740dab40bebd6c8d3f161 (DEFAULT_TABLE table=default.Table_ec80f327b59748efb9f7d1b60f08cd7c [id=f2c68f806e5040b5ae0095c7156a0cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.520470 15103 raft_consensus.cc:2468] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:33.520622 15075 tablet_service.cc:1505] Processing CreateTablet for tablet 63085b146f03434b912d639b430a2cfe (DEFAULT_TABLE table=default.Table_24ae0230ee3646e7a2d32c0e4a536dea [id=6e17d76cd39f4556bea24c3197dca4ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.520632 17194 tablet_replica.cc:333] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.520732 15089 tablet_service.cc:1505] Processing CreateTablet for tablet d6cbe1616ced4f47999a6a1365af0092 (DEFAULT_TABLE table=default.Table_7fdb9c6661e241b6a185030c3593d5e2 [id=8b4baee097c94e428a9a26f5d2a22107]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.520988 17194 raft_consensus.cc:2243] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.521044 15084 tablet_service.cc:1505] Processing CreateTablet for tablet f2bc1c43a4724406a9e2cc2c8cb72bec (DEFAULT_TABLE table=default.Table_f35d0fa958084bb9bb792e93fd367806 [id=ae28464385cf4504b39a9292d794460f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.521299 17194 raft_consensus.cc:2272] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.521380 15076 tablet_service.cc:1505] Processing CreateTablet for tablet b1fc8a8cfb73420f81f5b73839d3d3cb (DEFAULT_TABLE table=default.Table_dd5055250bd34b1cb92185869ef6186c [id=114aff0abb5d4c78b98b63d145ec02c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.521486 15090 tablet_service.cc:1505] Processing CreateTablet for tablet f1c15457dfac48e3a33de5a9c3d6f1f1 (DEFAULT_TABLE table=default.Table_42cdcbf9b2a0438b92ed7d428d482506 [id=7a5de3149f6545a680efc1df204128ad]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.519826 15079 tablet_service.cc:1505] Processing CreateTablet for tablet d6243825ae7b4307b5789aaee2473edc (DEFAULT_TABLE table=default.Table_3cb2ab7a99584877a1e8c650a29489db [id=d272aae5be5249ae9f40a67315f3756c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.521044 15086 tablet_service.cc:1505] Processing CreateTablet for tablet cb2a4db00068482fb8d3b5313017e035 (DEFAULT_TABLE table=default.Table_24a3fc5c42d441fab7d881fb258a0ddb [id=866f01db50274ea29407f759600aff90]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.522392 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b16e4b9ef4c41db83ab3bf55149719b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.522547 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 879ae11ae94b4d2eab76c1dc74e160ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.522677 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aae693881f9d40c789d242c6de5d9905. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.523240 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f141107d4674690acd51e499bc4e208. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.524775 15088 tablet_service.cc:1505] Processing CreateTablet for tablet b316ba50a48446338d49435a8e809ff4 (DEFAULT_TABLE table=default.Table_d0bdafcb33804ab48f880343784af6e0 [id=464250cb73944d90b9c1fd39002a9e11]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.524873 15087 tablet_service.cc:1505] Processing CreateTablet for tablet b826067888164df0af7da797d42c0862 (DEFAULT_TABLE table=default.Table_1c42bf37d0434552a8f4ffe93d29d77a [id=7eda6d3807c042d3a7aecf63ebd73fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.524986 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b316ba50a48446338d49435a8e809ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.525084 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b826067888164df0af7da797d42c0862. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.525107 15082 tablet_service.cc:1505] Processing CreateTablet for tablet 91d9fca3965e4ff8bb0a50574ede0209 (DEFAULT_TABLE table=default.Table_47f9104a42ea4104828e1f8ecd279670 [id=bdd0ed6dbdb844bdb993f37e1db34cb8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.525300 15082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91d9fca3965e4ff8bb0a50574ede0209. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.525520 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76c31d4c83c740dab40bebd6c8d3f161. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.526258 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0de3ec67dcc4e41a447338869076314. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.526391 15075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63085b146f03434b912d639b430a2cfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.527099 15080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12a6b5f9ed8041e9929c9f1673ac212a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.527416 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet e2b014e0f49c4f7da8e65b7d4c98ea63 with delete_type TABLET_DATA_DELETED (replaced by tablet 0514d05680994b5f9bf7da9c62dd098a) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.527710 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 17339d7c0a4b40a78b3252d17481c192 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.527796 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 2f64072c416f4a77b1c81855d7db8f01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.527869 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 85c7748077184fdda472821a0826cd77 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.527928 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet ce5ae591c86c4455a1dd3704f1c95d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.528017 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet be8d6685c70c4219947df30f023a59b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.528190 15091 tablet_service.cc:1505] Processing CreateTablet for tablet edfb86283bda491993a456e365f8760f (DEFAULT_TABLE table=default.Table_d9fe75661236465ca4c58953ed0023c4 [id=c0f5ecd0d89d409785fbd905d22e3fc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.528218 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 3c86ceda5c2c4583b9ff388e82b5369f (DEFAULT_TABLE table=default.Table_1af17555bf4d4cd480b16563fa2098e5 [id=767682c0185b4db09bb0bc784a7a971e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.528364 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edfb86283bda491993a456e365f8760f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.528978 15080 tablet_service.cc:1505] Processing CreateTablet for tablet 54ac551e1e9a4bb1970be52edd04c0d3 (DEFAULT_TABLE table=default.Table_df3848a55c7646b1bd519eb12aa88aa1 [id=5160fad54600448f8b2c5bfc942f60a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.529156 15083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc32b27b3f743bf8719e39ea8c20e34. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.529295 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c614480578945839a6662bafc62726c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.529469 15086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb2a4db00068482fb8d3b5313017e035. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.530292 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 334015a0a5aa42c8b127d64e794c2705. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.531142 15083 tablet_service.cc:1505] Processing CreateTablet for tablet d4bf7ad8c26a42c5a2704bc005062ea3 (DEFAULT_TABLE table=default.Table_a9114bb65ce7472fa79f74bed2243563 [id=9e5da7dd17cd45ea800b3361736db041]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.531325 15083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4bf7ad8c26a42c5a2704bc005062ea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.532075 15085 tablet_service.cc:1505] Processing CreateTablet for tablet 9ecb15be5f5c48f1bd68e56b65543fad (DEFAULT_TABLE table=default.Table_05bac665c2114dacac7804da6adfc06e [id=9aee333b5b9f4e1daba6449f643ea43a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.532241 15093 tablet_service.cc:1505] Processing CreateTablet for tablet c23d5d373a30413b94508b50dd4fec89 (DEFAULT_TABLE table=default.Table_0d9ad032e51f4c38aecebf16793e490d [id=2ac1c7a6a67943a5af05c1f2c7e6b65e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.532306 15078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c079391742cc4d488826c5536ab6d1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.532691 15077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea8a95b8fbf94520a2c219755cdc5d14. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.532987 15081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3caafcc644e34ec1acc0d3741fd34721. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.533571 16279 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_48ddda8a36684d438ecffce1ea4dc2d1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.533906 15079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6243825ae7b4307b5789aaee2473edc. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:33.533910 16279 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48ddda8a36684d438ecffce1ea4dc2d1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.534435 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c15457dfac48e3a33de5a9c3d6f1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.534510 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 52765e926e904ec9b052db3135cfb77a (DEFAULT_TABLE table=default.Table_492cb5cd156a4d1a910aa96ecf028de1 [id=6716c87cf323485893ce723e76924979]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.534561 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6cbe1616ced4f47999a6a1365af0092. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.534701 15076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1fc8a8cfb73420f81f5b73839d3d3cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.534969 15084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2bc1c43a4724406a9e2cc2c8cb72bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.535326 15083 tablet_service.cc:1505] Processing CreateTablet for tablet 1dacca1fcbad4795835ec08c8bd0dc3c (DEFAULT_TABLE table=default.Table_0a42fcc0637248fd9048c6d9d9e6055e [id=438ba3cc67564d1bac9cd6653033546e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.535552 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c23d5d373a30413b94508b50dd4fec89. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.536229 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ecb15be5f5c48f1bd68e56b65543fad. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.537966 15085 tablet_service.cc:1505] Processing CreateTablet for tablet d20a130fc8ea40ddba509d2825ac028d (DEFAULT_TABLE table=default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.538712 16281 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_5afcc0049e364501bce48333c6697692"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.539021 16281 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5afcc0049e364501bce48333c6697692 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.538416 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet 86b1873446154249a80fa67b99496545 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fcded6ebe3a42f4a83a65e44c080120) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.539702 15077 tablet_service.cc:1552] Processing DeleteTablet for tablet b4d1c652b6a4420a81e03cd58c6dbc69 with delete_type TABLET_DATA_DELETED (replaced by tablet 9b9ff161e6034353a824cf8ab9489a73) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.515833 16390 tablet_bootstrap.cc:492] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:33.540757 16390 tablet_bootstrap.cc:654] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:33.523514 15183 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.70.1:35401, user_credentials={real_user=slave}} blocked reactor thread for 82715.6us
I20251025 08:02:33.529237 17369 raft_consensus.cc:493] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.541713 17369 raft_consensus.cc:515] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.515739 17258 raft_consensus.cc:2243] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.542016 17369 leader_election.cc:290] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.541726 17372 consensus_queue.cc:1048] T 77f04f445b5d47d2a78fdac0641a7372 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:33.542927 15229 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42704: Illegal state: replica f0f2f8ce3e9f4d9ba3f3f02813397c31 is not leader of this config: current role FOLLOWER
I20251025 08:02:33.542924 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07b76abb029e4555851dfdc73ab31a38" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.543033 15110 raft_consensus.cc:2468] T 07b76abb029e4555851dfdc73ab31a38 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:33.544144 17258 raft_consensus.cc:2272] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.544498 17536 raft_consensus.cc:493] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.544576 17536 raft_consensus.cc:515] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.544932 17536 leader_election.cc:290] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.546998 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c86ceda5c2c4583b9ff388e82b5369f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.547020 15229 tablet_service.cc:1505] Processing CreateTablet for tablet d20a130fc8ea40ddba509d2825ac028d (DEFAULT_TABLE table=default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.547282 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d20a130fc8ea40ddba509d2825ac028d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.549499 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff (DEFAULT_TABLE table=default.Table_5a29e7dba4ba43dfbd0c27981080a1ac [id=8611464429b848fbb277f6a03557cd0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.549705 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.552040 15211 tablet_service.cc:1505] Processing CreateTablet for tablet f102eb1c22004790839b6563bd830786 (DEFAULT_TABLE table=default.Table_45dccafd9b8f494c9fb2c59042be73f9 [id=7b766fed8fb7420aa669e8a45e5ea62c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.552235 15211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f102eb1c22004790839b6563bd830786. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.554802 15229 tablet_service.cc:1505] Processing CreateTablet for tablet de53385f417d4e5eb34ab4537a9b638b (DEFAULT_TABLE table=default.Table_2942acd29f7c42ceb19355a101b68dd8 [id=321b596b7ce44599a5136e0b1fa6886f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.555042 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de53385f417d4e5eb34ab4537a9b638b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.555016 15185 leader_election.cc:304] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.555415 17369 raft_consensus.cc:2804] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.555470 17369 raft_consensus.cc:493] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.555502 17369 raft_consensus.cc:3060] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.556231 16280 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_e23149a55e354b558401b5949cd4ce2b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.556341 17369 raft_consensus.cc:515] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:33.556555 16280 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e23149a55e354b558401b5949cd4ce2b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.556653 17369 leader_election.cc:290] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.556823 15083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dacca1fcbad4795835ec08c8bd0dc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.557349 16287 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_fa9d9b9a535648d89d19b74bb940ed9f" } new_table_name: "default.Table_ce11251d6b4243ac8902b50912f11fc3" modify_external_catalogs: true
W20251025 08:02:33.558046 16283 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet de53385f417d4e5eb34ab4537a9b638b consensus state has no leader
I20251025 08:02:33.558248 16283 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_4b899f935c754aa2876c910eb2e208e3" } modify_external_catalogs: true
I20251025 08:02:33.558332 16283 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_4b899f935c754aa2876c910eb2e208e3" } modify_external_catalogs: true
I20251025 08:02:33.559134 16288 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_492cb5cd156a4d1a910aa96ecf028de1" } new_table_name: "default.Table_e91151e2cc6a437b99b47d5694fa6e80" modify_external_catalogs: true
I20251025 08:02:33.559347 17258 ts_tablet_manager.cc:1916] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:33.559821 16285 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1820be622ead4fd88437c79d95b34caf has no consensus state
I20251025 08:02:33.535831 17595 raft_consensus.cc:493] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.542469 14941 tablet_service.cc:1552] Processing DeleteTablet for tablet 23eedc2695db43afbd6f5dbebb0ea2be with delete_type TABLET_DATA_DELETED (replaced by tablet edfb86283bda491993a456e365f8760f) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.560022 17595 raft_consensus.cc:515] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.560026 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_d54d3a0c7eaa43fa9309f3ee3578c671"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.542518 14943 tablet_service.cc:1552] Processing DeleteTablet for tablet d993e2350f37492bb712d145d03e8afb with delete_type TABLET_DATA_DELETED (replaced by tablet 00ecaed82db64f6f867f5db93e38180a) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.542709 14951 tablet_service.cc:1552] Processing DeleteTablet for tablet e106f20977444dd4a49b6e4ae0f45380 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.542709 14945 tablet_service.cc:1552] Processing DeleteTablet for tablet fbae08a3a1c34dfda60b1985346e7761 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
W20251025 08:02:33.560298 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d54d3a0c7eaa43fa9309f3ee3578c671 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.543087 14952 tablet_service.cc:1552] Processing DeleteTablet for tablet c043ab70d7364e05b0b352ac5c416db1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.560371 17595 leader_election.cc:290] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.560596 15080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ac551e1e9a4bb1970be52edd04c0d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.522466 17194 ts_tablet_manager.cc:1916] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.561332 16284 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b" } modify_external_catalogs: true
I20251025 08:02:33.561417 16284 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b" } modify_external_catalogs: true
I20251025 08:02:33.543393 14953 tablet_service.cc:1552] Processing DeleteTablet for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 with delete_type TABLET_DATA_DELETED (replaced by tablet 9ecb15be5f5c48f1bd68e56b65543fad) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.543418 14950 tablet_service.cc:1552] Processing DeleteTablet for tablet ae3c8e134d164edd8781f27e7bdc3b92 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.543443 14955 tablet_service.cc:1552] Processing DeleteTablet for tablet 6d1979a4f43a4659976b0cd6d1b888ef with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.543473 14948 tablet_service.cc:1552] Processing DeleteTablet for tablet 997c8c5921ad4ec18914fd50c97fc33e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.543498 14959 tablet_service.cc:1552] Processing DeleteTablet for tablet 47b0f93bac664a44989534097be9fd73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.543803 14949 tablet_service.cc:1552] Processing DeleteTablet for tablet ff20cd7d33a440bab24bd4a61fff1f30 with delete_type TABLET_DATA_DELETED (replaced by tablet d20a130fc8ea40ddba509d2825ac028d) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.543885 14946 tablet_service.cc:1552] Processing DeleteTablet for tablet 7e90c358ef454760b8317d78724ee377 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.544014 14947 tablet_service.cc:1552] Processing DeleteTablet for tablet bfdc6022cc5747439edcb8aa865b9437 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.562533 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07b76abb029e4555851dfdc73ab31a38" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:33.561959 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff15c6e28a794271ac61ca111d66a06e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.562625 15110 raft_consensus.cc:3060] T 07b76abb029e4555851dfdc73ab31a38 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.562685 15248 raft_consensus.cc:2468] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:33.562958 14914 leader_election.cc:304] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.563107 17595 raft_consensus.cc:2804] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.563153 17595 raft_consensus.cc:493] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.563194 17595 raft_consensus.cc:3060] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.563458 15110 raft_consensus.cc:2468] T 07b76abb029e4555851dfdc73ab31a38 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:33.564070 15185 leader_election.cc:304] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.547483 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff (DEFAULT_TABLE table=default.Table_5a29e7dba4ba43dfbd0c27981080a1ac [id=8611464429b848fbb277f6a03557cd0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.564226 17372 raft_consensus.cc:2804] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.564302 17372 raft_consensus.cc:697] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:33.564263 17595 raft_consensus.cc:515] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.564373 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.564412 17372 consensus_queue.cc:237] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.551829 14956 tablet_service.cc:1505] Processing CreateTablet for tablet f102eb1c22004790839b6563bd830786 (DEFAULT_TABLE table=default.Table_45dccafd9b8f494c9fb2c59042be73f9 [id=7b766fed8fb7420aa669e8a45e5ea62c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.564728 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f102eb1c22004790839b6563bd830786. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.564800 17595 leader_election.cc:290] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.565742 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d20a130fc8ea40ddba509d2825ac028d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.552129 14958 tablet_service.cc:1505] Processing CreateTablet for tablet de53385f417d4e5eb34ab4537a9b638b (DEFAULT_TABLE table=default.Table_2942acd29f7c42ceb19355a101b68dd8 [id=321b596b7ce44599a5136e0b1fa6886f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.566730 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de53385f417d4e5eb34ab4537a9b638b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.568252 17274 tablet_bootstrap.cc:492] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.568344 17274 ts_tablet_manager.cc:1403] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.000s
I20251025 08:02:33.552277 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 4826826d19fd421a9d04eac17a79a9fb (DEFAULT_TABLE table=default.Table_d03eda3087a54490a502678eeeeeabc8 [id=1297b3a21b8a458d80575525d6df9783]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.568782 17274 raft_consensus.cc:359] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.568843 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4826826d19fd421a9d04eac17a79a9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.568866 17274 raft_consensus.cc:385] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.568893 17274 raft_consensus.cc:740] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.569000 17274 consensus_queue.cc:260] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.569285 17274 ts_tablet_manager.cc:1434] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.569453 17274 tablet_bootstrap.cc:492] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.543118 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet 34c330b5dd544ae686f741cdd85d023d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.546759 16391 tablet_bootstrap.cc:492] T fc485ee4814142cda9be0d937aaa5dc1 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.570854 16391 ts_tablet_manager.cc:1403] T fc485ee4814142cda9be0d937aaa5dc1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.159s user 0.001s sys 0.000s
I20251025 08:02:33.570892 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff15c6e28a794271ac61ca111d66a06e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:33.570987 15248 raft_consensus.cc:3060] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.571303 16391 raft_consensus.cc:359] T fc485ee4814142cda9be0d937aaa5dc1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.571391 16391 raft_consensus.cc:385] T fc485ee4814142cda9be0d937aaa5dc1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.571422 16391 raft_consensus.cc:740] T fc485ee4814142cda9be0d937aaa5dc1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.571525 16391 consensus_queue.cc:260] T fc485ee4814142cda9be0d937aaa5dc1 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.571790 16391 ts_tablet_manager.cc:1434] T fc485ee4814142cda9be0d937aaa5dc1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.571802 15248 raft_consensus.cc:2468] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:33.571967 16391 tablet_bootstrap.cc:492] T 07b76abb029e4555851dfdc73ab31a38 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.572100 14914 leader_election.cc:304] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.572305 17594 raft_consensus.cc:2804] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.572373 17594 raft_consensus.cc:697] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:33.572477 17594 consensus_queue.cc:237] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.572755 16391 tablet_bootstrap.cc:654] T 07b76abb029e4555851dfdc73ab31a38 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.573179 17274 tablet_bootstrap.cc:654] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.578133 15087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52765e926e904ec9b052db3135cfb77a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.579082 17258 ts_tablet_manager.cc:1929] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.579164 16282 catalog_manager.cc:5649] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:33.579528 17194 ts_tablet_manager.cc:1929] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.579470 16282 catalog_manager.cc:5649] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:33.579669 17258 log.cc:1199] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/34c330b5dd544ae686f741cdd85d023d
I20251025 08:02:33.579952 17258 ts_tablet_manager.cc:1950] T 34c330b5dd544ae686f741cdd85d023d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.579953 16282 catalog_manager.cc:5649] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:33.580497 17258 tablet_replica.cc:333] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.580633 17258 raft_consensus.cc:2243] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.580698 17194 log.cc:1199] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/2f64072c416f4a77b1c81855d7db8f01
I20251025 08:02:33.580896 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 34c330b5dd544ae686f741cdd85d023d (table default.Table_aa5c70a86540451b8a07688d25edc3b7 [id=bd246e92f35b47a2864b5da042da3232]) successfully deleted
I20251025 08:02:33.581012 17194 ts_tablet_manager.cc:1950] T 2f64072c416f4a77b1c81855d7db8f01 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.583237 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 2f64072c416f4a77b1c81855d7db8f01 (table default.Table_b9669fd414104dcca80167117a5b0ed7 [id=431195fe6a3847caa5b39d62cb399ffb]) successfully deleted
I20251025 08:02:33.584846 17274 tablet_bootstrap.cc:492] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.584918 17274 ts_tablet_manager.cc:1403] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20251025 08:02:33.585364 17274 raft_consensus.cc:359] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.585450 17274 raft_consensus.cc:385] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.585481 17274 raft_consensus.cc:740] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.585574 17274 consensus_queue.cc:260] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.585906 17274 ts_tablet_manager.cc:1434] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.586079 17274 tablet_bootstrap.cc:492] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.587103 17274 tablet_bootstrap.cc:654] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.587143 16281 master_service.cc:954] ReplaceTablet: received request to replace tablet 2562325ea1c9436a85e1d675574c0a6c from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.587958 16279 master_service.cc:954] ReplaceTablet: received request to replace tablet cb3569ec2cdd4736b264b00abf1fa36a from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.589462 17194 tablet_replica.cc:333] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.589598 17194 raft_consensus.cc:2243] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.589701 17194 raft_consensus.cc:2272] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.583833 15384 consensus_queue.cc:1048] T 56ef6eeb5739448ebeb42d0de38512a7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.590159 17258 raft_consensus.cc:2272] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.590570 17258 ts_tablet_manager.cc:1916] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.590931 17194 ts_tablet_manager.cc:1916] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:33.585201 15183 leader_election.cc:343] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.587570 16390 tablet_bootstrap.cc:492] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:33.591630 16390 ts_tablet_manager.cc:1403] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.076s user 0.002s sys 0.000s
I20251025 08:02:33.592036 16390 raft_consensus.cc:359] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.592110 16390 raft_consensus.cc:385] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.592133 16390 raft_consensus.cc:740] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.592228 16390 consensus_queue.cc:260] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.592448 16390 ts_tablet_manager.cc:1434] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:33.592850 16390 tablet_bootstrap.cc:492] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:33.593787 16390 tablet_bootstrap.cc:654] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:33.595564 15183 leader_election.cc:343] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:33.596092 15183 leader_election.cc:343] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.596242 15183 leader_election.cc:304] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:33.596450 15384 raft_consensus.cc:2749] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:33.597676 15183 leader_election.cc:343] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.597843 15183 leader_election.cc:304] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:33.598073 17373 raft_consensus.cc:2749] T ff15c6e28a794271ac61ca111d66a06e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:33.598467 15183 leader_election.cc:343] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.598640 15183 leader_election.cc:304] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:33.598843 17373 raft_consensus.cc:2749] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:33.599524 17591 tablet.cc:1722] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:33.600926 15297 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:33.601824 16287 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_25e0298aad614dba82f598191e458567" } modify_external_catalogs: true
I20251025 08:02:33.601935 16287 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_25e0298aad614dba82f598191e458567" } modify_external_catalogs: true
W20251025 08:02:33.603065 16288 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 52765e926e904ec9b052db3135cfb77a consensus state has no leader
I20251025 08:02:33.603252 16288 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_a6c6f65ea3444858aa562a65d71c4e77" } modify_external_catalogs: true
I20251025 08:02:33.603322 16288 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_a6c6f65ea3444858aa562a65d71c4e77" } modify_external_catalogs: true
I20251025 08:02:33.604338 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 2562325ea1c9436a85e1d675574c0a6c
I20251025 08:02:33.604624 17194 ts_tablet_manager.cc:1929] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.604683 17194 log.cc:1199] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/85c7748077184fdda472821a0826cd77
I20251025 08:02:33.604796 16283 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_bf6a70d1926d4a9da3c3ee62f85bf2cf" } modify_external_catalogs: true
I20251025 08:02:33.604884 16283 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_bf6a70d1926d4a9da3c3ee62f85bf2cf" } modify_external_catalogs: true
I20251025 08:02:33.606357 17258 ts_tablet_manager.cc:1929] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.607337 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet 2562325ea1c9436a85e1d675574c0a6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.607352 17566 tablet.cc:1722] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:33.607177 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 2562325ea1c9436a85e1d675574c0a6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.607523 17258 log.cc:1199] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/1927cf6a9013402a92c9e6e89e2e1715
I20251025 08:02:33.607769 15242 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5e907ec8e7c420d8d6d68a954cc8beb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:33.608639 15242 raft_consensus.cc:2393] T e5e907ec8e7c420d8d6d68a954cc8beb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:33.610392 17258 ts_tablet_manager.cc:1950] T 1927cf6a9013402a92c9e6e89e2e1715 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.610504 17194 ts_tablet_manager.cc:1950] T 85c7748077184fdda472821a0826cd77 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.611125 17194 tablet_replica.cc:333] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.613951 15242 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84d6bed24444dcfab1920efad849932" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.614058 15242 raft_consensus.cc:2393] T c84d6bed24444dcfab1920efad849932 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:33.614161 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "45a22457031a4eff8e82fa232b6f05bb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.614280 15247 raft_consensus.cc:2393] T 45a22457031a4eff8e82fa232b6f05bb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:33.614912 15245 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29476b0bf2f34dcb913a665e3a008519" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.615003 15245 raft_consensus.cc:2468] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:33.615744 17373 consensus_queue.cc:1048] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.615833 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 1927cf6a9013402a92c9e6e89e2e1715 (table default.Table_d03eda3087a54490a502678eeeeeabc8 [id=1297b3a21b8a458d80575525d6df9783]) successfully deleted
I20251025 08:02:33.616006 17258 tablet_replica.cc:333] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.616178 17194 raft_consensus.cc:2243] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.616338 17258 raft_consensus.cc:2243] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.616533 17194 raft_consensus.cc:2272] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.616673 17258 raft_consensus.cc:2272] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.617024 17258 ts_tablet_manager.cc:1916] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.617398 17194 ts_tablet_manager.cc:1916] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.622606 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dafad70d3f69440c9d42e8ee73123d2d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.622721 14979 raft_consensus.cc:2393] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:33.624934 17258 ts_tablet_manager.cc:1929] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.625465 17258 log.cc:1199] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/5bf286568e8343b7921ac256a9313e63
W20251025 08:02:33.625555 15229 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42704: Illegal state: replica f0f2f8ce3e9f4d9ba3f3f02813397c31 is not leader of this config: current role FOLLOWER
I20251025 08:02:33.625998 17258 ts_tablet_manager.cc:1950] T 5bf286568e8343b7921ac256a9313e63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.626590 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 5bf286568e8343b7921ac256a9313e63 (table default.Table_a9afe52cc64243a295d043eb385ef7d9 [id=46383e9b028a4d2bb7b39e04f147491e]) successfully deleted
I20251025 08:02:33.626807 17258 tablet_replica.cc:333] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.626964 17258 raft_consensus.cc:2243] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.627159 17258 raft_consensus.cc:2272] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.627516 17258 ts_tablet_manager.cc:1916] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.628382 14969 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98baf6e8d8e84b42a83054495ae19e01" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.628850 14969 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dafad70d3f69440c9d42e8ee73123d2d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:33.628968 14969 raft_consensus.cc:2393] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:33.629546 17258 ts_tablet_manager.cc:1929] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.629863 14969 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc485ee4814142cda9be0d937aaa5dc1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.629978 14969 raft_consensus.cc:2468] T fc485ee4814142cda9be0d937aaa5dc1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:33.630450 14969 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adb2c77ec9b84fe8846084cddc23888a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.631492 14969 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc485ee4814142cda9be0d937aaa5dc1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:33.631579 14969 raft_consensus.cc:3060] T fc485ee4814142cda9be0d937aaa5dc1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.632089 16284 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet e03e2e21e3f64bedb04c7e79aea6d49d
I20251025 08:02:33.632395 14969 raft_consensus.cc:2468] T fc485ee4814142cda9be0d937aaa5dc1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:33.633435 17194 ts_tablet_manager.cc:1929] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.633556 17194 log.cc:1199] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/ce5ae591c86c4455a1dd3704f1c95d1c
I20251025 08:02:33.633857 17194 ts_tablet_manager.cc:1950] T ce5ae591c86c4455a1dd3704f1c95d1c P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.634445 14969 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07b76abb029e4555851dfdc73ab31a38" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.634743 17194 tablet_replica.cc:333] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.635598 17620 tablet.cc:1722] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.638811 16279 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet cb3569ec2cdd4736b264b00abf1fa36a
I20251025 08:02:33.634894 17194 raft_consensus.cc:2243] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.638967 17194 raft_consensus.cc:2272] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.639472 16279 catalog_manager.cc:6719] ReplaceTablet: tablet cb3569ec2cdd4736b264b00abf1fa36a deleted and replaced by tablet c994b9b0fa3d46b9bb4c01610437972c
I20251025 08:02:33.640129 17194 ts_tablet_manager.cc:1916] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.641549 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dafad70d3f69440c9d42e8ee73123d2d" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.641708 15103 raft_consensus.cc:2393] T dafad70d3f69440c9d42e8ee73123d2d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:33.641870 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "07b76abb029e4555851dfdc73ab31a38" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:33.642282 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "45a22457031a4eff8e82fa232b6f05bb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.642390 15103 raft_consensus.cc:2468] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:33.643174 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84d6bed24444dcfab1920efad849932" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:33.643280 15103 raft_consensus.cc:3060] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.644119 15103 raft_consensus.cc:2468] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:33.644426 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "dafad70d3f69440c9d42e8ee73123d2d" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:33.644526 15103 raft_consensus.cc:2393] T dafad70d3f69440c9d42e8ee73123d2d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:33.644591 17620 tablet.cc:1722] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.644754 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "45a22457031a4eff8e82fa232b6f05bb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:33.644832 15103 raft_consensus.cc:3060] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.645854 15103 raft_consensus.cc:2468] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:33.649003 16287 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 5522e9c5bf904c63bc4b00a226a0cc45
I20251025 08:02:33.650926 17198 ts_tablet_manager.cc:1929] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.651039 17198 log.cc:1199] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/080d77feb2a242959fb8e375f07e5a5f
W20251025 08:02:33.651139 15049 consensus_peers.cc:597] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fc5f892ca7a246a28a556fe0eb3f5442. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:33.651371 17198 ts_tablet_manager.cc:1950] T 080d77feb2a242959fb8e375f07e5a5f P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:33.632941 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet e03e2e21e3f64bedb04c7e79aea6d49d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.639408 15211 tablet_service.cc:1552] Processing DeleteTablet for tablet cb3569ec2cdd4736b264b00abf1fa36a with delete_type TABLET_DATA_DELETED (replaced by tablet c994b9b0fa3d46b9bb4c01610437972c) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.651422 17258 log.cc:1199] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/6a3ec64b273d4e8c92b1e24061ac7336
I20251025 08:02:33.649618 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 5522e9c5bf904c63bc4b00a226a0cc45 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.651664 17258 ts_tablet_manager.cc:1950] T 6a3ec64b273d4e8c92b1e24061ac7336 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.651993 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 64) took 1330 ms. Trace:
I20251025 08:02:33.652091 17198 rpcz_store.cc:276] 1025 08:02:32.321784 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.321822 (+ 38us) service_pool.cc:225] Handling call
1025 08:02:33.409060 (+1087238us) ts_tablet_manager.cc:1151] Deleting tablet 080d77feb2a242959fb8e375f07e5a5f
1025 08:02:33.409069 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:33.410469 (+ 1400us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:33.650871 (+240402us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:33.651980 (+ 1109us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1087125}
I20251025 08:02:33.652247 17194 ts_tablet_manager.cc:1929] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.652316 17194 log.cc:1199] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/b4d1c652b6a4420a81e03cd58c6dbc69
I20251025 08:02:33.652494 17198 tablet_replica.cc:333] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:33.652676 17198 raft_consensus.cc:2243] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.652873 17198 raft_consensus.cc:2272] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.653156 17258 tablet_replica.cc:333] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.653267 17198 ts_tablet_manager.cc:1916] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.653254 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 6a3ec64b273d4e8c92b1e24061ac7336 (table default.Table_22425928df99434c8c133707c8a809ef [id=79c76995e71143438cb6e30a9df85c31]) successfully deleted
I20251025 08:02:33.653460 17194 ts_tablet_manager.cc:1950] T b4d1c652b6a4420a81e03cd58c6dbc69 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.652490 17620 tablet.cc:1722] T 7dd513b6c7a24dffb91f66c32acc7696 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:33.654649 15049 consensus_peers.cc:597] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bfdc6022cc5747439edcb8aa865b9437. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:33.654853 17258 raft_consensus.cc:2243] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.655309 17536 consensus_queue.cc:1048] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.655565 17258 pending_rounds.cc:70] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 1 pending ops.
I20251025 08:02:33.655612 17258 pending_rounds.cc:77] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609827561844736 op_type: NO_OP noop_request { }
I20251025 08:02:33.656231 17536 consensus_queue.cc:1048] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.656706 15049 leader_election.cc:304] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.656860 17274 tablet_bootstrap.cc:492] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.656929 17274 ts_tablet_manager.cc:1403] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.071s user 0.002s sys 0.000s
I20251025 08:02:33.657158 15642 raft_consensus.cc:2804] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.657218 15642 raft_consensus.cc:493] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.657258 15642 raft_consensus.cc:3060] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.657394 17274 raft_consensus.cc:359] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.657486 17274 raft_consensus.cc:385] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.656445 17620 tablet.cc:1722] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.657516 17274 raft_consensus.cc:740] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.657620 17274 consensus_queue.cc:260] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.657888 17274 ts_tablet_manager.cc:1434] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.658037 17274 tablet_bootstrap.cc:492] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.658998 17274 tablet_bootstrap.cc:654] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.659286 14973 raft_consensus.cc:3060] T 95030a851b5d4155b235a4e896250c80 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.655802 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 4826826d19fd421a9d04eac17a79a9fb (DEFAULT_TABLE table=default.Table_d03eda3087a54490a502678eeeeeabc8 [id=1297b3a21b8a458d80575525d6df9783]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.663425 17258 raft_consensus.cc:2889] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:33.663491 17258 raft_consensus.cc:2272] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.663592 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4826826d19fd421a9d04eac17a79a9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.663643 17194 tablet_replica.cc:333] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.663793 17194 raft_consensus.cc:2243] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.664538 17369 consensus_queue.cc:1048] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.664888 17194 raft_consensus.cc:2272] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.658133 15642 raft_consensus.cc:515] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.656410 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 00ecaed82db64f6f867f5db93e38180a (DEFAULT_TABLE table=default.Table_1ccbe630ac5a41ecb7b00087172bec38 [id=1e716be545914b22887b2f7e069c41c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.665845 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ecaed82db64f6f867f5db93e38180a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.665839 15642 leader_election.cc:290] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.666844 16391 tablet_bootstrap.cc:492] T 07b76abb029e4555851dfdc73ab31a38 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.666920 16391 ts_tablet_manager.cc:1403] T 07b76abb029e4555851dfdc73ab31a38 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.095s user 0.001s sys 0.000s
I20251025 08:02:33.667301 16391 raft_consensus.cc:359] T 07b76abb029e4555851dfdc73ab31a38 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.667384 16391 raft_consensus.cc:385] T 07b76abb029e4555851dfdc73ab31a38 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.667414 16391 raft_consensus.cc:740] T 07b76abb029e4555851dfdc73ab31a38 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.667515 16391 consensus_queue.cc:260] T 07b76abb029e4555851dfdc73ab31a38 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.667780 16391 ts_tablet_manager.cc:1434] T 07b76abb029e4555851dfdc73ab31a38 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.671518 16391 tablet_bootstrap.cc:492] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.671967 17623 tablet.cc:1722] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:33.672251 17624 tablet.cc:1722] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.672484 16391 tablet_bootstrap.cc:654] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.673822 17258 ts_tablet_manager.cc:1916] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.676147 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5e907ec8e7c420d8d6d68a954cc8beb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.676267 15105 raft_consensus.cc:2393] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:33.676860 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5e907ec8e7c420d8d6d68a954cc8beb" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:33.676973 15105 raft_consensus.cc:2393] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:33.677110 17595 raft_consensus.cc:493] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.677166 17595 raft_consensus.cc:515] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.677438 17595 leader_election.cc:290] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.675134 17316 raft_consensus.cc:493] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.678020 17316 raft_consensus.cc:515] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.678349 17316 leader_election.cc:290] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:33.678354 14914 leader_election.cc:343] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: 658a20d894c5444a820ce6bd33e4fdf0
I20251025 08:02:33.678483 16279 master_service.cc:954] ReplaceTablet: received request to replace tablet 685d09c4a80b4d48b477cd4c0fc9db40 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.678946 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88a76d187fae4f09ac879b72e9c05a86" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
W20251025 08:02:33.679221 15185 leader_election.cc:343] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.679700 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff15c6e28a794271ac61ca111d66a06e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.679790 15109 raft_consensus.cc:2468] T ff15c6e28a794271ac61ca111d66a06e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:33.680096 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ff15c6e28a794271ac61ca111d66a06e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:33.680186 15109 raft_consensus.cc:3060] T ff15c6e28a794271ac61ca111d66a06e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.680850 17258 ts_tablet_manager.cc:1929] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.680907 17258 log.cc:1199] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/8362e26d86d44e9780d3c78c6a468556
I20251025 08:02:33.681084 15109 raft_consensus.cc:2468] T ff15c6e28a794271ac61ca111d66a06e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:33.681164 17258 ts_tablet_manager.cc:1950] T 8362e26d86d44e9780d3c78c6a468556 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.681725 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 8362e26d86d44e9780d3c78c6a468556 (table default.Table_5a29e7dba4ba43dfbd0c27981080a1ac [id=8611464429b848fbb277f6a03557cd0d]) successfully deleted
I20251025 08:02:33.681947 17258 tablet_replica.cc:333] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.681957 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "658a20d894c5444a820ce6bd33e4fdf0" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.682080 15109 raft_consensus.cc:2393] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:33.682252 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "e5e907ec8e7c420d8d6d68a954cc8beb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:33.682390 17258 raft_consensus.cc:2243] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.682452 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c84d6bed24444dcfab1920efad849932" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.682559 17258 raft_consensus.cc:2272] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.682902 17258 ts_tablet_manager.cc:1916] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.683092 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "45a22457031a4eff8e82fa232b6f05bb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.684499 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet fbae08a3a1c34dfda60b1985346e7761 (table default.Table_a1c2dd3168ad45ffb213e55c47a2d0d3 [id=fb192136f9d9453a8d0aad2c1103118d]) successfully deleted
I20251025 08:02:33.684526 17194 ts_tablet_manager.cc:1916] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.685601 17623 tablet.cc:1722] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.686021 16287 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_9ab03dea59b04746968d5f6753b931d6" } new_table_name: "default.Table_f5a86fbd3f5440aca8ae7f7f495a983a" modify_external_catalogs: true
I20251025 08:02:33.686498 17194 ts_tablet_manager.cc:1929] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.687076 16284 master_service.cc:954] ReplaceTablet: received request to replace tablet 0078dd6fb0e34d01a54889326dd6dfd7 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.688917 16281 master_service.cc:954] ReplaceTablet: received request to replace tablet 5027b80220e34f5f8e1e8e8479ec41f3 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:33.690505 17274 tablet_bootstrap.cc:492] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.690582 17274 ts_tablet_manager.cc:1403] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.033s user 0.002s sys 0.000s
I20251025 08:02:33.690935 17194 log.cc:1199] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/86b1873446154249a80fa67b99496545
I20251025 08:02:33.690964 17274 raft_consensus.cc:359] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.687283 17620 tablet.cc:1722] T d14e12c45323420b84de06d828238caa P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:33.691208 17194 ts_tablet_manager.cc:1950] T 86b1873446154249a80fa67b99496545 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.691051 17274 raft_consensus.cc:385] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.691892 17274 raft_consensus.cc:740] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.692013 17274 consensus_queue.cc:260] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.692342 17274 ts_tablet_manager.cc:1434] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:33.692503 17274 tablet_bootstrap.cc:492] T acb84bad2f75474faecd00432d187ccf P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.693434 17274 tablet_bootstrap.cc:654] T acb84bad2f75474faecd00432d187ccf P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.693426 17595 raft_consensus.cc:493] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.693491 17595 raft_consensus.cc:515] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.693822 17595 leader_election.cc:290] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:33.663177 15183 leader_election.cc:343] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.692209 17316 raft_consensus.cc:493] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.694267 17316 raft_consensus.cc:515] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.694502 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29476b0bf2f34dcb913a665e3a008519" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.694590 17316 leader_election.cc:290] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.694597 15248 raft_consensus.cc:2468] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:33.694906 17274 tablet_bootstrap.cc:492] T acb84bad2f75474faecd00432d187ccf P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.694892 14914 leader_election.cc:304] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.694994 17274 ts_tablet_manager.cc:1403] T acb84bad2f75474faecd00432d187ccf P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:33.695072 15183 leader_election.cc:304] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:33.695088 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be8d6685c70c4219947df30f023a59b8" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.695209 17316 raft_consensus.cc:2749] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:33.695279 17595 raft_consensus.cc:2804] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.695344 17595 raft_consensus.cc:493] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.695390 17595 raft_consensus.cc:3060] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:33.695461 15185 leader_election.cc:343] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.695472 17274 raft_consensus.cc:359] T acb84bad2f75474faecd00432d187ccf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.695552 17274 raft_consensus.cc:385] T acb84bad2f75474faecd00432d187ccf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.695577 17274 raft_consensus.cc:740] T acb84bad2f75474faecd00432d187ccf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.695672 17274 consensus_queue.cc:260] T acb84bad2f75474faecd00432d187ccf P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:33.695797 15183 leader_election.cc:343] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.695848 15183 leader_election.cc:304] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:33.695931 17274 ts_tablet_manager.cc:1434] T acb84bad2f75474faecd00432d187ccf P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:33.695957 17316 raft_consensus.cc:2749] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:33.696125 17274 tablet_bootstrap.cc:492] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.696107 17316 consensus_queue.cc:1048] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.696224 17595 raft_consensus.cc:515] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.696521 17595 leader_election.cc:290] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:33.696828 15183 leader_election.cc:343] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.697043 17274 tablet_bootstrap.cc:654] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.697238 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29476b0bf2f34dcb913a665e3a008519" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:33.697325 15248 raft_consensus.cc:3060] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.611763 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 85c7748077184fdda472821a0826cd77 (table default.Table_e3dddd8db8a64833bd7de5ad2fec599a [id=9b1cfdaffd964fba879de8e58c7ac93c]) successfully deleted
W20251025 08:02:33.697630 16270 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.14.70.1:35401, user_credentials={real_user=slave}} blocked reactor thread for 85871us
W20251025 08:02:33.697992 15183 leader_election.cc:343] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.698108 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet ce5ae591c86c4455a1dd3704f1c95d1c (table default.Table_9c7e0359120c415cba47b89251b0be94 [id=4510ebbcd6ee43babe7ee133a0ce6ae5]) successfully deleted
I20251025 08:02:33.698169 15248 raft_consensus.cc:2468] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
W20251025 08:02:33.698251 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet be8d6685c70c4219947df30f023a59b8 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet be8d6685c70c4219947df30f023a59b8 already in progress: creating tablet
I20251025 08:02:33.698352 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet b4d1c652b6a4420a81e03cd58c6dbc69 (table default.Table_c2e0c935fdb34bc38f482cac268ad080 [id=62e3c831964e4f71a8ee6aca23069b44]) successfully deleted
I20251025 08:02:33.698451 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 86b1873446154249a80fa67b99496545 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]) successfully deleted
W20251025 08:02:33.698549 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 23eedc2695db43afbd6f5dbebb0ea2be because the tablet was not found. No further retry: Not found: Tablet not found: 23eedc2695db43afbd6f5dbebb0ea2be
I20251025 08:02:33.698561 17536 raft_consensus.cc:493] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251025 08:02:33.698666 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet d993e2350f37492bb712d145d03e8afb because the tablet was not found. No further retry: Not found: Tablet not found: d993e2350f37492bb712d145d03e8afb
I20251025 08:02:33.698637 17536 raft_consensus.cc:515] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:33.698767 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet e106f20977444dd4a49b6e4ae0f45380 because the tablet was not found. No further retry: Not found: Tablet not found: e106f20977444dd4a49b6e4ae0f45380
W20251025 08:02:33.698850 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet fbae08a3a1c34dfda60b1985346e7761 because the tablet was not found. No further retry: Not found: Tablet not found: fbae08a3a1c34dfda60b1985346e7761
I20251025 08:02:33.698973 17536 leader_election.cc:290] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.699174 14914 leader_election.cc:304] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.699376 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet e03e2e21e3f64bedb04c7e79aea6d49d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:41762
W20251025 08:02:33.699505 15183 consensus_peers.cc:597] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 54de7e83e8ea42ef93218b0204c61ec6. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:33.699532 17595 raft_consensus.cc:2804] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.699611 17595 raft_consensus.cc:697] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:33.699702 17595 consensus_queue.cc:237] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.700147 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet cb3569ec2cdd4736b264b00abf1fa36a with delete_type TABLET_DATA_DELETED (replaced by tablet c994b9b0fa3d46b9bb4c01610437972c) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.700265 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 5522e9c5bf904c63bc4b00a226a0cc45 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.700481 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 00ecaed82db64f6f867f5db93e38180a (DEFAULT_TABLE table=default.Table_1ccbe630ac5a41ecb7b00087172bec38 [id=1e716be545914b22887b2f7e069c41c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.700695 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ecaed82db64f6f867f5db93e38180a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.701272 15384 consensus_queue.cc:1048] T 95030a851b5d4155b235a4e896250c80 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.702620 17566 tablet.cc:1722] T 24e0f02dd56644a3930c1cc0a972132e P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:33.703289 15229 tablet_service.cc:1505] Processing CreateTablet for tablet f64222dd274f46e9bf79dba96c5c18b1 (DEFAULT_TABLE table=default.Table_a6c6f65ea3444858aa562a65d71c4e77 [id=2ef2d72066f446619f9045da34df7814]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.703503 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64222dd274f46e9bf79dba96c5c18b1. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:33.704671 15049 consensus_peers.cc:597] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5bf286568e8343b7921ac256a9313e63. This is attempt 1: this message will repeat every 5th retry.
W20251025 08:02:33.705155 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet c043ab70d7364e05b0b352ac5c416db1 because the tablet was not found. No further retry: Not found: Tablet not found: c043ab70d7364e05b0b352ac5c416db1
I20251025 08:02:33.705525 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 52d69474461c427398de1a843fae2389 (DEFAULT_TABLE table=default.Table_631837cf20584c788ca33f5d97ad28db [id=9d351cb68ad04c9babba603360e63284]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:33.705708 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 because the tablet was not found. No further retry: Not found: Tablet not found: 73cdd9616b9c460f8fcd4a40e4a3ccc8
I20251025 08:02:33.705752 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d69474461c427398de1a843fae2389. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.706657 14940 tablet_service.cc:1505] Processing CreateTablet for tablet e03e2e21e3f64bedb04c7e79aea6d49d (DEFAULT_TABLE table=default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b [id=4e47e7759fc64598807f1ee3a973820f]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:33.706841 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet ae3c8e134d164edd8781f27e7bdc3b92 because the tablet was not found. No further retry: Not found: Tablet not found: ae3c8e134d164edd8781f27e7bdc3b92
I20251025 08:02:33.706864 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03e2e21e3f64bedb04c7e79aea6d49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.707191 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be8d6685c70c4219947df30f023a59b8" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.707648 17194 tablet_replica.cc:333] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.707720 15211 tablet_service.cc:1505] Processing CreateTablet for tablet 0948123d65e54a01b94bb40e21a76818 (DEFAULT_TABLE table=default.Table_3049e822186441f189fa1361f0f0224c [id=d0d8ee6036ff408893b909c9b6273790]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:33.707785 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 6d1979a4f43a4659976b0cd6d1b888ef because the tablet was not found. No further retry: Not found: Tablet not found: 6d1979a4f43a4659976b0cd6d1b888ef
I20251025 08:02:33.707790 17194 raft_consensus.cc:2243] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.707873 17194 raft_consensus.cc:2272] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.707923 15211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0948123d65e54a01b94bb40e21a76818. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:33.707912 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 997c8c5921ad4ec18914fd50c97fc33e because the tablet was not found. No further retry: Not found: Tablet not found: 997c8c5921ad4ec18914fd50c97fc33e
I20251025 08:02:33.708947 16391 tablet_bootstrap.cc:492] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.709017 16391 ts_tablet_manager.cc:1403] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.041s user 0.002s sys 0.000s
I20251025 08:02:33.709403 16391 raft_consensus.cc:359] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.709472 16391 raft_consensus.cc:385] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.709496 16391 raft_consensus.cc:740] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.709578 16391 consensus_queue.cc:260] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.709779 16391 ts_tablet_manager.cc:1434] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.710278 16391 tablet_bootstrap.cc:492] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.710565 14958 tablet_service.cc:1505] Processing CreateTablet for tablet f64222dd274f46e9bf79dba96c5c18b1 (DEFAULT_TABLE table=default.Table_a6c6f65ea3444858aa562a65d71c4e77 [id=2ef2d72066f446619f9045da34df7814]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.710785 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64222dd274f46e9bf79dba96c5c18b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.711618 16391 tablet_bootstrap.cc:654] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.712491 17258 ts_tablet_manager.cc:1929] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:33.712723 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 0948123d65e54a01b94bb40e21a76818 (DEFAULT_TABLE table=default.Table_3049e822186441f189fa1361f0f0224c [id=d0d8ee6036ff408893b909c9b6273790]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.712925 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0948123d65e54a01b94bb40e21a76818. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:33.714112 15049 consensus_peers.cc:597] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8362e26d86d44e9780d3c78c6a468556. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:33.712905 15247 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adb2c77ec9b84fe8846084cddc23888a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.714511 17369 consensus_queue.cc:1048] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.714592 15247 raft_consensus.cc:2468] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:33.713104 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29476b0bf2f34dcb913a665e3a008519" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:33.714766 15237 raft_consensus.cc:2393] T 29476b0bf2f34dcb913a665e3a008519 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
W20251025 08:02:33.714493 15183 consensus_peers.cc:597] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ed5ed91e953d42afa9ebf9ab8b89d0e6. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:33.714838 17591 tablet.cc:1722] T 24e0f02dd56644a3930c1cc0a972132e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20251025 08:02:33.714972 15183 leader_election.cc:343] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.715039 15183 leader_election.cc:304] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:33.715148 17258 log.cc:1199] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/16f1ab00a20345a1bb51e685b3fc6c70
I20251025 08:02:33.715366 16391 tablet_bootstrap.cc:492] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.715456 16391 ts_tablet_manager.cc:1403] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251025 08:02:33.715582 17316 raft_consensus.cc:2749] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:33.715870 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88a76d187fae4f09ac879b72e9c05a86" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.716243 17258 ts_tablet_manager.cc:1950] T 16f1ab00a20345a1bb51e685b3fc6c70 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.716203 16391 raft_consensus.cc:359] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.716368 16391 raft_consensus.cc:385] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.716439 16391 raft_consensus.cc:740] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.716624 16391 consensus_queue.cc:260] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.717211 16391 ts_tablet_manager.cc:1434] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:33.717479 16391 tablet_bootstrap.cc:492] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.718453 17194 ts_tablet_manager.cc:1916] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.718568 17591 tablet.cc:1722] T d14e12c45323420b84de06d828238caa P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:33.719142 16391 tablet_bootstrap.cc:654] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.720466 17194 ts_tablet_manager.cc:1929] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.720561 17194 log.cc:1199] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/47b0f93bac664a44989534097be9fd73
I20251025 08:02:33.720888 15049 leader_election.cc:304] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.721185 17534 raft_consensus.cc:2804] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.721261 17534 raft_consensus.cc:493] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.721314 17534 raft_consensus.cc:3060] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.721378 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 16f1ab00a20345a1bb51e685b3fc6c70 (table default.Table_9419360c7ef742d196d6ac96f41241f1 [id=31777251b0174ff684a84b14f630d643]) successfully deleted
W20251025 08:02:33.721870 15183 leader_election.cc:343] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:33.722327 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 1e248b8303b1498e96178d4e46ad691e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1e248b8303b1498e96178d4e46ad691e already in progress: creating tablet
I20251025 08:02:33.722491 15183 leader_election.cc:304] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:33.722708 17258 tablet_replica.cc:333] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.722702 17534 raft_consensus.cc:515] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.722992 17534 leader_election.cc:290] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.722859 17316 raft_consensus.cc:2749] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:33.724661 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adb2c77ec9b84fe8846084cddc23888a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:33.724773 15248 raft_consensus.cc:3060] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.725098 17194 ts_tablet_manager.cc:1950] T 47b0f93bac664a44989534097be9fd73 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.725538 15248 raft_consensus.cc:2468] T adb2c77ec9b84fe8846084cddc23888a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:33.722277 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 52d69474461c427398de1a843fae2389 (DEFAULT_TABLE table=default.Table_631837cf20584c788ca33f5d97ad28db [id=9d351cb68ad04c9babba603360e63284]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.726038 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d69474461c427398de1a843fae2389. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.727095 15049 leader_election.cc:304] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.727136 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 47b0f93bac664a44989534097be9fd73 (table default.Table_2c042f0ac6454365ae570c2cd26b31ca [id=d656394d725244dbbe22b0cfb8e4c89f]) successfully deleted
I20251025 08:02:33.727391 17537 raft_consensus.cc:493] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f2f8ce3e9f4d9ba3f3f02813397c31)
I20251025 08:02:33.727530 17537 raft_consensus.cc:515] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.727814 17537 leader_election.cc:290] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.727886 17537 raft_consensus.cc:2804] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.727946 17537 raft_consensus.cc:697] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:33.728014 15211 tablet_service.cc:1552] Processing DeleteTablet for tablet 1927cf6a9013402a92c9e6e89e2e1715 with delete_type TABLET_DATA_DELETED (replaced by tablet 4826826d19fd421a9d04eac17a79a9fb) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.728062 17537 consensus_queue.cc:237] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.728117 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet bfdc6022cc5747439edcb8aa865b9437 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.728197 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet d709ecb9ac9a4525985c7d2bf10719f5 with delete_type TABLET_DATA_DELETED (replaced by tablet b7bb3d7d89674b7e825868c17495bbb3) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.722512 17620 tablet.cc:1722] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20251025 08:02:33.729244 17258 raft_consensus.cc:2243] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.729374 17258 raft_consensus.cc:2272] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.729689 17258 ts_tablet_manager.cc:1916] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:33.730571 15049 leader_election.cc:343] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: 6d1979a4f43a4659976b0cd6d1b888ef
I20251025 08:02:33.731782 17274 tablet_bootstrap.cc:492] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.731911 17274 ts_tablet_manager.cc:1403] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
W20251025 08:02:33.731951 16271 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet b826067888164df0af7da797d42c0862 (table default.Table_1c42bf37d0434552a8f4ffe93d29d77a [id=7eda6d3807c042d3a7aecf63ebd73fae], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet b826067888164df0af7da797d42c0862 consensus state has no leader
I20251025 08:02:33.732419 17194 tablet_replica.cc:333] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.732422 17274 raft_consensus.cc:359] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:33.732504 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet ff20cd7d33a440bab24bd4a61fff1f30 because the tablet was not found. No further retry: Not found: Tablet not found: ff20cd7d33a440bab24bd4a61fff1f30
I20251025 08:02:33.732542 17274 raft_consensus.cc:385] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.732584 17274 raft_consensus.cc:740] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
W20251025 08:02:33.732638 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 7e90c358ef454760b8317d78724ee377 because the tablet was not found. No further retry: Not found: Tablet not found: 7e90c358ef454760b8317d78724ee377
I20251025 08:02:33.732687 17274 consensus_queue.cc:260] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:33.732731 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet bfdc6022cc5747439edcb8aa865b9437 because the tablet was not found. No further retry: Not found: Tablet not found: bfdc6022cc5747439edcb8aa865b9437
W20251025 08:02:33.732837 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 34c330b5dd544ae686f741cdd85d023d because the tablet was not found. No further retry: Not found: Tablet not found: 34c330b5dd544ae686f741cdd85d023d
I20251025 08:02:33.733029 17274 ts_tablet_manager.cc:1434] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.733191 17274 tablet_bootstrap.cc:492] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.733199 17194 raft_consensus.cc:2243] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.734136 17258 ts_tablet_manager.cc:1929] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:33.734266 17274 tablet_bootstrap.cc:654] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.734315 17194 raft_consensus.cc:2272] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.735495 17274 tablet_bootstrap.cc:492] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.735641 17258 log.cc:1199] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/f5f72ca8cfb94178a21619ddc9fc0352
I20251025 08:02:33.735872 17274 ts_tablet_manager.cc:1403] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20251025 08:02:33.736336 17274 raft_consensus.cc:359] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.736431 17274 raft_consensus.cc:385] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.736487 17274 raft_consensus.cc:740] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.736613 17274 consensus_queue.cc:260] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.736953 17274 ts_tablet_manager.cc:1434] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:33.737113 17274 tablet_bootstrap.cc:492] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.737988 17274 tablet_bootstrap.cc:654] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.736059 17258 ts_tablet_manager.cc:1950] T f5f72ca8cfb94178a21619ddc9fc0352 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.738384 16288 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet f64222dd274f46e9bf79dba96c5c18b1
I20251025 08:02:33.738994 17274 tablet_bootstrap.cc:492] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.739073 17274 ts_tablet_manager.cc:1403] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:33.739192 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet f5f72ca8cfb94178a21619ddc9fc0352 (table default.Table_75b0519af19a461d8dd5bdfd0c7a50c5 [id=b73d5c5cd3824129b9efc54f3aa7c304]) successfully deleted
I20251025 08:02:33.739367 17258 tablet_replica.cc:333] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.739423 17274 raft_consensus.cc:359] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.739480 17258 raft_consensus.cc:2243] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.739506 17274 raft_consensus.cc:385] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.739537 17274 raft_consensus.cc:740] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.739563 17258 raft_consensus.cc:2272] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.739643 17274 consensus_queue.cc:260] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.739882 17274 ts_tablet_manager.cc:1434] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.739893 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_691eab0585894686af636d8eebd4842a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.740044 17274 tablet_bootstrap.cc:492] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:33.740242 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_691eab0585894686af636d8eebd4842a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.741041 17274 tablet_bootstrap.cc:654] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.741606 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet f64222dd274f46e9bf79dba96c5c18b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.741859 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet f64222dd274f46e9bf79dba96c5c18b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.742735 17274 tablet_bootstrap.cc:492] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.742703 17258 ts_tablet_manager.cc:1916] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.742803 17274 ts_tablet_manager.cc:1403] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:33.743213 17274 raft_consensus.cc:359] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.743291 17274 raft_consensus.cc:385] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.743319 17274 raft_consensus.cc:740] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.743412 17274 consensus_queue.cc:260] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.743635 17274 ts_tablet_manager.cc:1434] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.743793 17274 tablet_bootstrap.cc:492] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.744459 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 6b16e4b9ef4c41db83ab3bf55149719b
I20251025 08:02:33.744630 17274 tablet_bootstrap.cc:654] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.745354 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 6b16e4b9ef4c41db83ab3bf55149719b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.745486 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 6b16e4b9ef4c41db83ab3bf55149719b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.746136 17258 ts_tablet_manager.cc:1929] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.746224 17258 log.cc:1199] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/8b6ae6527fd64c3bb5999dec97db861d
I20251025 08:02:33.746490 17258 ts_tablet_manager.cc:1950] T 8b6ae6527fd64c3bb5999dec97db861d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.746959 17258 tablet_replica.cc:333] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.747066 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 8b6ae6527fd64c3bb5999dec97db861d (table default.Table_599c0d46a95d45b4aa9bab3b54b52470 [id=b8e6ffed1a2e442db3c9ee5ac1a6ff3d]) successfully deleted
I20251025 08:02:33.747085 17258 raft_consensus.cc:2243] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.747258 17258 raft_consensus.cc:2272] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.747614 17258 ts_tablet_manager.cc:1916] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.748615 17274 tablet_bootstrap.cc:492] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.748737 17274 ts_tablet_manager.cc:1403] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
W20251025 08:02:33.748762 15183 consensus_peers.cc:597] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 85c7748077184fdda472821a0826cd77. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:33.749343 17274 raft_consensus.cc:359] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.749503 17274 raft_consensus.cc:385] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.749539 17258 ts_tablet_manager.cc:1929] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.749580 17274 raft_consensus.cc:740] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.749637 17258 log.cc:1199] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/ed5ed91e953d42afa9ebf9ab8b89d0e6
I20251025 08:02:33.749739 17274 consensus_queue.cc:260] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.749926 17258 ts_tablet_manager.cc:1950] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.750594 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet ed5ed91e953d42afa9ebf9ab8b89d0e6 (table default.Table_a901c364849c4301910d7c32f0ec25fc [id=cadc2427db7c404cbbf9d3542145cccc]) successfully deleted
I20251025 08:02:33.750620 17274 ts_tablet_manager.cc:1434] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:33.750761 17274 tablet_bootstrap.cc:492] T cfe93efc1a0c4dda95b5c2e58cdcec82 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.750798 17258 tablet_replica.cc:333] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.750922 17258 raft_consensus.cc:2243] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.751137 17258 raft_consensus.cc:2272] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.751449 17258 ts_tablet_manager.cc:1916] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.751701 17274 tablet_bootstrap.cc:654] T cfe93efc1a0c4dda95b5c2e58cdcec82 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.752923 17274 tablet_bootstrap.cc:492] T cfe93efc1a0c4dda95b5c2e58cdcec82 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.753108 17274 ts_tablet_manager.cc:1403] T cfe93efc1a0c4dda95b5c2e58cdcec82 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:33.753934 17258 ts_tablet_manager.cc:1929] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20251025 08:02:33.754060 17258 log.cc:1199] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/f8576553f17b49f8bd11436ecac471ed
I20251025 08:02:33.754621 17258 ts_tablet_manager.cc:1950] T f8576553f17b49f8bd11436ecac471ed P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.754842 17274 raft_consensus.cc:359] T cfe93efc1a0c4dda95b5c2e58cdcec82 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.755045 17274 raft_consensus.cc:385] T cfe93efc1a0c4dda95b5c2e58cdcec82 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.755182 17274 raft_consensus.cc:740] T cfe93efc1a0c4dda95b5c2e58cdcec82 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.755255 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet f8576553f17b49f8bd11436ecac471ed (table default.Table_d80d24fe6db14f0da8149898449ae86e [id=2283253a9522485d93d6c484c5eef6e4]) successfully deleted
I20251025 08:02:33.755498 17258 tablet_replica.cc:333] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.755470 17274 consensus_queue.cc:260] T cfe93efc1a0c4dda95b5c2e58cdcec82 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.755656 17258 raft_consensus.cc:2243] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.755851 17258 raft_consensus.cc:2272] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.756093 17274 ts_tablet_manager.cc:1434] T cfe93efc1a0c4dda95b5c2e58cdcec82 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:33.756239 17258 ts_tablet_manager.cc:1916] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.756420 17274 tablet_bootstrap.cc:492] T fc62afd62257471e8590d28e49a50cb2 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.757827 17274 tablet_bootstrap.cc:654] T fc62afd62257471e8590d28e49a50cb2 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.758159 17258 ts_tablet_manager.cc:1929] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.758291 17258 log.cc:1199] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/54de7e83e8ea42ef93218b0204c61ec6
I20251025 08:02:33.758615 17258 ts_tablet_manager.cc:1950] T 54de7e83e8ea42ef93218b0204c61ec6 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.759155 17258 tablet_replica.cc:333] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.759280 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 54de7e83e8ea42ef93218b0204c61ec6 (table default.Table_a6bf9c572cb3485f9ecced6d0d55877d [id=26a6f00041d04924b3e8eb2b279b55de]) successfully deleted
I20251025 08:02:33.759438 17258 raft_consensus.cc:2243] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.759569 17258 raft_consensus.cc:2272] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.759873 17258 ts_tablet_manager.cc:1916] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.761188 16390 tablet_bootstrap.cc:492] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:33.761270 16390 ts_tablet_manager.cc:1403] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.168s user 0.002s sys 0.000s
I20251025 08:02:33.761613 16390 raft_consensus.cc:359] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.761662 17258 ts_tablet_manager.cc:1929] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.761690 16390 raft_consensus.cc:385] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.761718 16390 raft_consensus.cc:740] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.761721 17258 log.cc:1199] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/e2b014e0f49c4f7da8e65b7d4c98ea63
I20251025 08:02:33.761824 16390 consensus_queue.cc:260] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.762001 17258 ts_tablet_manager.cc:1950] T e2b014e0f49c4f7da8e65b7d4c98ea63 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.762044 16390 ts_tablet_manager.cc:1434] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.762234 16390 tablet_bootstrap.cc:492] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:33.762560 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet e2b014e0f49c4f7da8e65b7d4c98ea63 (table default.Table_5228048f3783458dbb44280a7a6e4816 [id=7fe739c2f676459d8c73632266babedb]) successfully deleted
I20251025 08:02:33.762938 16390 tablet_bootstrap.cc:654] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.763979 16283 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_cc907ef022d94e439041d73d82596b73"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.764348 16283 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cc907ef022d94e439041d73d82596b73 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.765008 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_e7e5d606f2194dce86fec95bb0654a4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.765307 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e7e5d606f2194dce86fec95bb0654a4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.766104 16280 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_b4260045775a4239b82e06034162a6f9" } new_table_name: "default.Table_090f351e0a1a4c0e9823a9f773cdd2c3" modify_external_catalogs: true
I20251025 08:02:33.773330 17595 raft_consensus.cc:493] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.773416 17595 raft_consensus.cc:515] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.773795 17595 leader_election.cc:290] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.774127 17258 tablet_replica.cc:333] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.774317 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ddb3795876b486e992b58cea711afb3" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.774499 15248 raft_consensus.cc:2468] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
W20251025 08:02:33.774354 15229 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42704: Illegal state: replica f0f2f8ce3e9f4d9ba3f3f02813397c31 is not leader of this config: current role FOLLOWER
I20251025 08:02:33.774570 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_6cb8acd51e814a82a5604f5c3b0aa5f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.774690 17258 raft_consensus.cc:2243] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.774758 14914 leader_election.cc:304] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
W20251025 08:02:33.774853 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6cb8acd51e814a82a5604f5c3b0aa5f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.774857 17258 raft_consensus.cc:2272] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.774902 17595 raft_consensus.cc:2804] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.774941 17595 raft_consensus.cc:493] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.775004 17595 raft_consensus.cc:3060] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.775187 17258 ts_tablet_manager.cc:1916] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.775588 16284 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 0078dd6fb0e34d01a54889326dd6dfd7
I20251025 08:02:33.775838 16284 catalog_manager.cc:6719] ReplaceTablet: tablet 0078dd6fb0e34d01a54889326dd6dfd7 deleted and replaced by tablet 2fde39be14794d8680c332bb05c59292
I20251025 08:02:33.776015 17595 raft_consensus.cc:515] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.776015 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_f84c2db0d0cf48058a70b69d1213c90b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.776152 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 0078dd6fb0e34d01a54889326dd6dfd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 2fde39be14794d8680c332bb05c59292) from {username='slave'} at 127.0.0.1:41762
W20251025 08:02:33.776302 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f84c2db0d0cf48058a70b69d1213c90b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.776353 17595 leader_election.cc:290] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.776762 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ddb3795876b486e992b58cea711afb3" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:33.776857 15248 raft_consensus.cc:3060] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.777649 15248 raft_consensus.cc:2468] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:33.777629 16285 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e3c8607d64ae4ee1b9c2d05ed6cb8eb6" } new_table_name: "default.Table_c6019b486de543f29a1350bf7a073b96" modify_external_catalogs: true
I20251025 08:02:33.777901 14914 leader_election.cc:304] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.778342 17595 raft_consensus.cc:2804] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.778424 17595 raft_consensus.cc:697] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:33.778537 17372 raft_consensus.cc:493] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.778564 17595 consensus_queue.cc:237] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.778609 17372 raft_consensus.cc:515] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.778898 17372 leader_election.cc:290] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.779423 16282 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_258c905a78d94ba197752a61781fa019 [id=ef3a1760f2c44935bbb79e518510905f] alter complete (version 4)
I20251025 08:02:33.780233 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a40c5721a4304345b471960ed1691930" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.780328 14979 raft_consensus.cc:2468] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:33.780825 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 0078dd6fb0e34d01a54889326dd6dfd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 2fde39be14794d8680c332bb05c59292) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.780885 15183 leader_election.cc:304] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.781029 17316 raft_consensus.cc:2804] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.781067 17316 raft_consensus.cc:493] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.781100 17316 raft_consensus.cc:3060] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.781553 17258 ts_tablet_manager.cc:1929] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.781612 17258 log.cc:1199] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/17339d7c0a4b40a78b3252d17481c192
I20251025 08:02:33.781767 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a40c5721a4304345b471960ed1691930" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.781854 17258 ts_tablet_manager.cc:1950] T 17339d7c0a4b40a78b3252d17481c192 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.781881 15111 raft_consensus.cc:2468] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:33.782029 17316 raft_consensus.cc:515] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.782603 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 17339d7c0a4b40a78b3252d17481c192 (table default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]) successfully deleted
I20251025 08:02:33.782832 17258 tablet_replica.cc:333] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.782868 17316 leader_election.cc:290] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.783062 17258 raft_consensus.cc:2243] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.783211 17258 raft_consensus.cc:2272] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.783574 17258 ts_tablet_manager.cc:1916] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.783563 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a40c5721a4304345b471960ed1691930" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:33.783654 14976 raft_consensus.cc:3060] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.784548 14976 raft_consensus.cc:2468] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:33.785224 17274 tablet_bootstrap.cc:492] T fc62afd62257471e8590d28e49a50cb2 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.785303 17274 ts_tablet_manager.cc:1403] T fc62afd62257471e8590d28e49a50cb2 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.029s user 0.002s sys 0.000s
I20251025 08:02:33.785456 17258 ts_tablet_manager.cc:1929] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.785506 17258 log.cc:1199] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/2f64072c416f4a77b1c81855d7db8f01
I20251025 08:02:33.785739 17258 ts_tablet_manager.cc:1950] T 2f64072c416f4a77b1c81855d7db8f01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.785797 15183 leader_election.cc:304] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.785796 17274 raft_consensus.cc:359] T fc62afd62257471e8590d28e49a50cb2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.785889 17274 raft_consensus.cc:385] T fc62afd62257471e8590d28e49a50cb2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.785919 17274 raft_consensus.cc:740] T fc62afd62257471e8590d28e49a50cb2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.786010 17274 consensus_queue.cc:260] T fc62afd62257471e8590d28e49a50cb2 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.786111 17372 raft_consensus.cc:2804] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.786212 17372 raft_consensus.cc:697] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:33.786332 17274 ts_tablet_manager.cc:1434] T fc62afd62257471e8590d28e49a50cb2 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.786345 17372 consensus_queue.cc:237] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.786404 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 2f64072c416f4a77b1c81855d7db8f01 (table default.Table_b9669fd414104dcca80167117a5b0ed7 [id=431195fe6a3847caa5b39d62cb399ffb]) successfully deleted
I20251025 08:02:33.786509 17274 tablet_bootstrap.cc:492] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.787400 17274 tablet_bootstrap.cc:654] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.788460 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "a40c5721a4304345b471960ed1691930" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:33.788547 15111 raft_consensus.cc:3060] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.789213 16281 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 5027b80220e34f5f8e1e8e8479ec41f3
I20251025 08:02:33.789423 15111 raft_consensus.cc:2468] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:33.789623 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 5027b80220e34f5f8e1e8e8479ec41f3 with delete_type TABLET_DATA_DELETED (replaced by tablet bce04638a32443bc853ae242c6651ac5) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:33.789886 16281 catalog_manager.cc:6719] ReplaceTablet: tablet 5027b80220e34f5f8e1e8e8479ec41f3 deleted and replaced by tablet bce04638a32443bc853ae242c6651ac5
I20251025 08:02:33.790225 17258 tablet_replica.cc:333] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.790191 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 5027b80220e34f5f8e1e8e8479ec41f3 with delete_type TABLET_DATA_DELETED (replaced by tablet bce04638a32443bc853ae242c6651ac5) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.790431 17258 raft_consensus.cc:2243] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.790550 17258 raft_consensus.cc:2272] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.791002 17258 ts_tablet_manager.cc:1916] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.792598 16281 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_070334199e524a3ab6f7cf59e619d05c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.792995 16281 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_070334199e524a3ab6f7cf59e619d05c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.794250 17258 ts_tablet_manager.cc:1929] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:33.794313 17274 tablet_bootstrap.cc:492] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.794386 17258 log.cc:1199] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/be8d6685c70c4219947df30f023a59b8
I20251025 08:02:33.794394 17274 ts_tablet_manager.cc:1403] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20251025 08:02:33.794637 17258 ts_tablet_manager.cc:1950] T be8d6685c70c4219947df30f023a59b8 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.794840 17274 raft_consensus.cc:359] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.794929 17274 raft_consensus.cc:385] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.794962 17274 raft_consensus.cc:740] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.795100 17274 consensus_queue.cc:260] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.795380 17274 ts_tablet_manager.cc:1434] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.795542 17274 tablet_bootstrap.cc:492] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.795686 16279 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 685d09c4a80b4d48b477cd4c0fc9db40
I20251025 08:02:33.796119 16279 catalog_manager.cc:6719] ReplaceTablet: tablet 685d09c4a80b4d48b477cd4c0fc9db40 deleted and replaced by tablet 37517c4c32c042eabcc8270de33af834
I20251025 08:02:33.796451 17274 tablet_bootstrap.cc:654] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.796517 16279 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_e0594fc0f0ec4d78b26142d30f694397"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.796741 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet be8d6685c70c4219947df30f023a59b8 (table default.Table_165ff894c5ab455e8daf5d1cf318b785 [id=325e0a7553e840c58179c04253e874dc]) successfully deleted
I20251025 08:02:33.796759 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 685d09c4a80b4d48b477cd4c0fc9db40 with delete_type TABLET_DATA_DELETED (replaced by tablet 37517c4c32c042eabcc8270de33af834) from {username='slave'} at 127.0.0.1:41762
W20251025 08:02:33.796854 16279 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e0594fc0f0ec4d78b26142d30f694397 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.796880 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 685d09c4a80b4d48b477cd4c0fc9db40 with delete_type TABLET_DATA_DELETED (replaced by tablet 37517c4c32c042eabcc8270de33af834) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.797447 17258 tablet_replica.cc:333] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.797590 17258 raft_consensus.cc:2243] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.799048 17258 raft_consensus.cc:2272] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.799482 17258 ts_tablet_manager.cc:1916] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.802166 17591 tablet.cc:1722] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.802358 15642 raft_consensus.cc:493] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.802428 15642 raft_consensus.cc:515] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.802747 15642 leader_election.cc:290] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.802923 17623 tablet.cc:1722] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.803231 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2be36d176bf34fb6bd3c70b42af15cc9" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.803323 15248 raft_consensus.cc:2468] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:33.803542 15049 leader_election.cc:304] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.803697 15642 raft_consensus.cc:2804] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.803743 15642 raft_consensus.cc:493] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.803756 17258 ts_tablet_manager.cc:1929] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.803790 15642 raft_consensus.cc:3060] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.803854 17258 log.cc:1199] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/85c7748077184fdda472821a0826cd77
I20251025 08:02:33.804116 17258 ts_tablet_manager.cc:1950] T 85c7748077184fdda472821a0826cd77 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.804289 17274 tablet_bootstrap.cc:492] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.804425 17274 ts_tablet_manager.cc:1403] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s
I20251025 08:02:33.804760 15642 raft_consensus.cc:515] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.805125 15642 leader_election.cc:290] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.805716 17274 raft_consensus.cc:359] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.805924 17274 raft_consensus.cc:385] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.806010 17274 raft_consensus.cc:740] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.806274 17274 consensus_queue.cc:260] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.806819 17274 ts_tablet_manager.cc:1434] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:33.805620 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2be36d176bf34fb6bd3c70b42af15cc9" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:33.807165 15248 raft_consensus.cc:3060] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.807627 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 85c7748077184fdda472821a0826cd77 (table default.Table_e3dddd8db8a64833bd7de5ad2fec599a [id=9b1cfdaffd964fba879de8e58c7ac93c]) successfully deleted
I20251025 08:02:33.807807 17258 tablet_replica.cc:333] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.808028 15248 raft_consensus.cc:2468] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:33.808221 17258 raft_consensus.cc:2243] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.808254 15049 leader_election.cc:304] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.808343 17258 raft_consensus.cc:2272] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.808575 15642 raft_consensus.cc:2804] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.808655 15642 raft_consensus.cc:697] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:33.808746 15642 consensus_queue.cc:237] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.809671 17274 tablet_bootstrap.cc:492] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.809921 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99 (DEFAULT_TABLE table=default.Table_7a0da42c26a9414996eb1aeaea64f82d [id=89c01fd911ca487b9b29576adec1fbee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.810156 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.812251 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 5522e9c5bf904c63bc4b00a226a0cc45 (DEFAULT_TABLE table=default.Table_25e0298aad614dba82f598191e458567 [id=7edb1b5b68864e54b6366186a8915fcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.812431 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5522e9c5bf904c63bc4b00a226a0cc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.814304 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 6d526e6cd8334742afea21ece24596ec (DEFAULT_TABLE table=default.Table_4c672efab2bb448ab1dcfd4325e8c053 [id=0db3af0dc90e4ea5ac9a029e3864ce58]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.814479 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d526e6cd8334742afea21ece24596ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.816335 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29476b0bf2f34dcb913a665e3a008519" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.822886 17274 tablet_bootstrap.cc:654] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.828778 17566 tablet.cc:1722] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:33.829161 17641 consensus_queue.cc:1175] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ab02c9d78a9d42f193755d436c8d44b2" status { last_received { term: 1 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 1 index: 3 } }
I20251025 08:02:33.832554 17198 ts_tablet_manager.cc:1929] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.832628 17198 log.cc:1199] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/43da3f4fc9604562a95dff59da3c574b
I20251025 08:02:33.832906 17198 ts_tablet_manager.cc:1950] T 43da3f4fc9604562a95dff59da3c574b P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:33.833407 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 65) took 1511 ms. Trace:
I20251025 08:02:33.833509 17198 rpcz_store.cc:276] 1025 08:02:32.321849 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.321964 (+ 115us) service_pool.cc:225] Handling call
1025 08:02:33.652467 (+1330503us) ts_tablet_manager.cc:1151] Deleting tablet 43da3f4fc9604562a95dff59da3c574b
1025 08:02:33.652475 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:33.654454 (+ 1979us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:33.832499 (+178045us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:33.833395 (+ 896us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1330423}
I20251025 08:02:33.833986 17198 tablet_replica.cc:333] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:33.834156 17198 raft_consensus.cc:2243] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.834328 17198 raft_consensus.cc:2272] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.834667 17198 ts_tablet_manager.cc:1916] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.836043 17258 ts_tablet_manager.cc:1916] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.812040 15229 tablet_service.cc:1505] Processing CreateTablet for tablet 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99 (DEFAULT_TABLE table=default.Table_7a0da42c26a9414996eb1aeaea64f82d [id=89c01fd911ca487b9b29576adec1fbee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.837240 15229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.838495 17372 raft_consensus.cc:493] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.838565 17372 raft_consensus.cc:515] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.838833 17372 leader_election.cc:290] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.839003 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet e762c440cb0947deb7e6a4186deebdc1 with delete_type TABLET_DATA_DELETED (replaced by tablet 14b47bf733754b72b34bd74aa033afa3) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.839092 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 14b47bf733754b72b34bd74aa033afa3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.839154 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet ed5ed91e953d42afa9ebf9ab8b89d0e6 with delete_type TABLET_DATA_DELETED (replaced by tablet 32ef1622f95f497ba839271dacf29841) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.839216 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet cfe9add2f8bf450bb6f49ad57be2caae with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.839531 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet f5f72ca8cfb94178a21619ddc9fc0352 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.839614 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 31c9e3906dac487e8585daa13d3fe4b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.839668 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 16f1ab00a20345a1bb51e685b3fc6c70 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.839718 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 8b6ae6527fd64c3bb5999dec97db861d with delete_type TABLET_DATA_DELETED (replaced by tablet 774988b980d8474e9b41518410c5dc9b) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.839767 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 736f75f26af142e59e7996c2ebb80868 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.839815 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 47b0f93bac664a44989534097be9fd73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.839864 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet 34c330b5dd544ae686f741cdd85d023d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.840049 15229 tablet_service.cc:1552] Processing DeleteTablet for tablet bea55cdfbf454d76920806886c3d2c4e with delete_type TABLET_DATA_DELETED (replaced by tablet 17339d7c0a4b40a78b3252d17481c192) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.814071 15211 tablet_service.cc:1505] Processing CreateTablet for tablet 5522e9c5bf904c63bc4b00a226a0cc45 (DEFAULT_TABLE table=default.Table_25e0298aad614dba82f598191e458567 [id=7edb1b5b68864e54b6366186a8915fcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.840253 15211 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5522e9c5bf904c63bc4b00a226a0cc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.818655 15210 tablet_service.cc:1552] Processing DeleteTablet for tablet 54de7e83e8ea42ef93218b0204c61ec6 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ae883acfacf451495ae73e1e813ec71) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.818995 15228 tablet_service.cc:1552] Processing DeleteTablet for tablet f8576553f17b49f8bd11436ecac471ed with delete_type TABLET_DATA_DELETED (replaced by tablet 61c8a83c2146418184842b7d7dd594fa) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.819073 15216 tablet_service.cc:1552] Processing DeleteTablet for tablet 8362e26d86d44e9780d3c78c6a468556 with delete_type TABLET_DATA_DELETED (replaced by tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.819253 15221 tablet_service.cc:1552] Processing DeleteTablet for tablet fc5f892ca7a246a28a556fe0eb3f5442 with delete_type TABLET_DATA_DELETED (replaced by tablet e03e2e21e3f64bedb04c7e79aea6d49d) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.819473 15219 tablet_service.cc:1552] Processing DeleteTablet for tablet d5cd481a98514f16bed3fb0bf5003526 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:28 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.819794 15222 tablet_service.cc:1552] Processing DeleteTablet for tablet 64996b8137f647b993923cb1bb093211 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.819983 15214 tablet_service.cc:1552] Processing DeleteTablet for tablet a40c5721a4304345b471960ed1691930 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.820525 15226 tablet_service.cc:1552] Processing DeleteTablet for tablet ff20cd7d33a440bab24bd4a61fff1f30 with delete_type TABLET_DATA_DELETED (replaced by tablet d20a130fc8ea40ddba509d2825ac028d) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.820845 15212 tablet_service.cc:1552] Processing DeleteTablet for tablet 5bf286568e8343b7921ac256a9313e63 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.821525 15227 tablet_service.cc:1552] Processing DeleteTablet for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d with delete_type TABLET_DATA_DELETED (replaced by tablet 1ab6b9d8278045ae92043ada5ce6dd71) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.821889 15225 tablet_service.cc:1552] Processing DeleteTablet for tablet 6a3ec64b273d4e8c92b1e24061ac7336 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.822232 15220 tablet_service.cc:1552] Processing DeleteTablet for tablet 23eedc2695db43afbd6f5dbebb0ea2be with delete_type TABLET_DATA_DELETED (replaced by tablet edfb86283bda491993a456e365f8760f) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.822464 15213 tablet_service.cc:1552] Processing DeleteTablet for tablet 17339d7c0a4b40a78b3252d17481c192 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.823488 15217 tablet_service.cc:1552] Processing DeleteTablet for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.823670 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet ae3c8e134d164edd8781f27e7bdc3b92 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.824469 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 93d383e3e2f4493d9cc8a71a4284e107 with delete_type TABLET_DATA_DELETED (replaced by tablet 82b93b7537c047aea430658ae2c2654b) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.824815 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet 658a20d894c5444a820ce6bd33e4fdf0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5522e9c5bf904c63bc4b00a226a0cc45) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.809568 15218 tablet_service.cc:1505] Processing CreateTablet for tablet e03e2e21e3f64bedb04c7e79aea6d49d (DEFAULT_TABLE table=default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b [id=4e47e7759fc64598807f1ee3a973820f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.843492 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfe93efc1a0c4dda95b5c2e58cdcec82" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.843560 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03e2e21e3f64bedb04c7e79aea6d49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.843591 15109 raft_consensus.cc:2468] T cfe93efc1a0c4dda95b5c2e58cdcec82 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:33.843835 15185 leader_election.cc:304] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.844671 14915 leader_election.cc:304] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:33.845153 17595 raft_consensus.cc:2749] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251025 08:02:33.845717 17316 raft_consensus.cc:2804] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.845768 17316 raft_consensus.cc:493] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.845801 17316 raft_consensus.cc:3060] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.846658 17316 raft_consensus.cc:515] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.846946 17316 leader_election.cc:290] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.847858 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfe93efc1a0c4dda95b5c2e58cdcec82" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:33.848654 15183 leader_election.cc:343] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.848884 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfe93efc1a0c4dda95b5c2e58cdcec82" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:33.849226 15183 leader_election.cc:343] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.849622 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cfe93efc1a0c4dda95b5c2e58cdcec82" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:33.849725 15109 raft_consensus.cc:3060] T cfe93efc1a0c4dda95b5c2e58cdcec82 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.850698 15109 raft_consensus.cc:2468] T cfe93efc1a0c4dda95b5c2e58cdcec82 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:33.851001 15185 leader_election.cc:304] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:33.851269 17372 raft_consensus.cc:2804] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.851369 17372 raft_consensus.cc:697] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:33.851495 17372 consensus_queue.cc:237] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.854846 17194 ts_tablet_manager.cc:1916] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.855803 16390 tablet_bootstrap.cc:492] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:33.855873 16390 ts_tablet_manager.cc:1403] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.094s user 0.001s sys 0.000s
I20251025 08:02:33.856271 16390 raft_consensus.cc:359] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.856348 16390 raft_consensus.cc:385] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.856384 16390 raft_consensus.cc:740] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.856477 16390 consensus_queue.cc:260] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.856750 16390 ts_tablet_manager.cc:1434] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.856828 17194 ts_tablet_manager.cc:1929] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:33.856885 17194 log.cc:1199] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/2562325ea1c9436a85e1d675574c0a6c
I20251025 08:02:33.856907 16390 tablet_bootstrap.cc:492] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:33.857142 17194 ts_tablet_manager.cc:1950] T 2562325ea1c9436a85e1d675574c0a6c P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.857719 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 2562325ea1c9436a85e1d675574c0a6c (table default.Table_4b899f935c754aa2876c910eb2e208e3 [id=8a0e4fe9e4544c539cb23b0279c1deaf]) successfully deleted
I20251025 08:02:33.857759 16390 tablet_bootstrap.cc:654] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.857851 15642 raft_consensus.cc:493] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.857916 15642 raft_consensus.cc:515] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:33.858493 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet e03e2e21e3f64bedb04c7e79aea6d49d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e03e2e21e3f64bedb04c7e79aea6d49d already in progress: creating tablet
I20251025 08:02:33.858708 17194 tablet_replica.cc:333] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.858858 17194 raft_consensus.cc:2243] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.858985 15642 leader_election.cc:290] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.859234 17194 raft_consensus.cc:2272] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.859685 17194 ts_tablet_manager.cc:1916] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.860332 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 6d526e6cd8334742afea21ece24596ec (DEFAULT_TABLE table=default.Table_4c672efab2bb448ab1dcfd4325e8c053 [id=0db3af0dc90e4ea5ac9a029e3864ce58]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.860545 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d526e6cd8334742afea21ece24596ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.860713 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "947b2d44ffa04370a04d5b4c24e11083" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:33.861028 15049 leader_election.cc:343] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.861719 15642 raft_consensus.cc:493] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.861796 15642 raft_consensus.cc:515] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.862087 15642 leader_election.cc:290] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.862434 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29b4798bac204280b9c56ebb0f44302d" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:33.862699 15049 leader_election.cc:343] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.863154 17194 ts_tablet_manager.cc:1929] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.863233 17194 log.cc:1199] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/cb3569ec2cdd4736b264b00abf1fa36a
I20251025 08:02:33.863456 17194 ts_tablet_manager.cc:1950] T cb3569ec2cdd4736b264b00abf1fa36a P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.863662 15218 tablet_service.cc:1505] Processing CreateTablet for tablet db4e3d9c58564fac9cd2f46b6458df6f (DEFAULT_TABLE table=default.Table_b4260045775a4239b82e06034162a6f9 [id=0864c970ad1c4ad3a0179e640dcc4859]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.863817 14958 tablet_service.cc:1505] Processing CreateTablet for tablet db4e3d9c58564fac9cd2f46b6458df6f (DEFAULT_TABLE table=default.Table_b4260045775a4239b82e06034162a6f9 [id=0864c970ad1c4ad3a0179e640dcc4859]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.863957 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4e3d9c58564fac9cd2f46b6458df6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.864030 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4e3d9c58564fac9cd2f46b6458df6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.864135 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet cb3569ec2cdd4736b264b00abf1fa36a (table default.Table_08073379da334076bcc5503770a32982 [id=1ee33ee129d749d0bd7f26dc49fca0fe]) successfully deleted
W20251025 08:02:33.864398 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 5522e9c5bf904c63bc4b00a226a0cc45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5522e9c5bf904c63bc4b00a226a0cc45 already in progress: creating tablet
W20251025 08:02:33.864734 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet f64222dd274f46e9bf79dba96c5c18b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f64222dd274f46e9bf79dba96c5c18b1 already in progress: creating tablet
W20251025 08:02:33.865114 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 6b16e4b9ef4c41db83ab3bf55149719b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b16e4b9ef4c41db83ab3bf55149719b already in progress: creating tablet
I20251025 08:02:33.865311 17194 tablet_replica.cc:333] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.865453 17194 raft_consensus.cc:2243] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.865536 17194 raft_consensus.cc:2272] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.865829 17194 ts_tablet_manager.cc:1916] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.867213 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29476b0bf2f34dcb913a665e3a008519" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:33.867888 17194 ts_tablet_manager.cc:1929] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.868520 15642 raft_consensus.cc:493] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.868597 15642 raft_consensus.cc:515] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.868853 15642 leader_election.cc:290] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:33.870462 15049 leader_election.cc:343] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: 16f1ab00a20345a1bb51e685b3fc6c70
I20251025 08:02:33.871250 17258 ts_tablet_manager.cc:1929] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.871332 17258 log.cc:1199] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/ce5ae591c86c4455a1dd3704f1c95d1c
I20251025 08:02:33.871569 17258 ts_tablet_manager.cc:1950] T ce5ae591c86c4455a1dd3704f1c95d1c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.872684 17258 tablet_replica.cc:333] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.872810 17258 raft_consensus.cc:2243] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.872839 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet ce5ae591c86c4455a1dd3704f1c95d1c (table default.Table_9c7e0359120c415cba47b89251b0be94 [id=4510ebbcd6ee43babe7ee133a0ce6ae5]) successfully deleted
I20251025 08:02:33.872997 17258 raft_consensus.cc:2272] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.874068 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 080d77feb2a242959fb8e375f07e5a5f (table default.Table_4c672efab2bb448ab1dcfd4325e8c053 [id=0db3af0dc90e4ea5ac9a029e3864ce58]) successfully deleted
I20251025 08:02:33.878221 17194 log.cc:1199] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/0078dd6fb0e34d01a54889326dd6dfd7
I20251025 08:02:33.878494 17194 ts_tablet_manager.cc:1950] T 0078dd6fb0e34d01a54889326dd6dfd7 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.879009 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 0078dd6fb0e34d01a54889326dd6dfd7 (table default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b]) successfully deleted
W20251025 08:02:33.879328 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 5027b80220e34f5f8e1e8e8479ec41f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5027b80220e34f5f8e1e8e8479ec41f3 already in progress: creating tablet
I20251025 08:02:33.879356 17194 tablet_replica.cc:333] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:33.879498 17194 raft_consensus.cc:2243] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:33.879611 17194 raft_consensus.cc:2272] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.879901 17194 ts_tablet_manager.cc:1916] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.880630 15642 raft_consensus.cc:493] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.880704 15642 raft_consensus.cc:515] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.881038 15642 leader_election.cc:290] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.881345 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a4b060efd054726b07702b691876147" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:33.881640 15049 leader_election.cc:343] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.882725 17274 tablet_bootstrap.cc:492] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.882797 17274 ts_tablet_manager.cc:1403] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.076s user 0.002s sys 0.000s
I20251025 08:02:33.883181 17274 raft_consensus.cc:359] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.883277 17274 raft_consensus.cc:385] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.883303 17274 raft_consensus.cc:740] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.883388 17274 consensus_queue.cc:260] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.883452 16283 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_70d3bae6c09d4f1991a55be992847626"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:33.883574 17274 ts_tablet_manager.cc:1434] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.883729 17274 tablet_bootstrap.cc:492] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:33.883756 16283 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70d3bae6c09d4f1991a55be992847626 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.884557 16288 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_a6bf9c572cb3485f9ecced6d0d55877d" } new_table_name: "default.Table_197dba326ac544d29c90a004200413bc" modify_external_catalogs: true
I20251025 08:02:33.884642 17274 tablet_bootstrap.cc:654] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.885380 17537 raft_consensus.cc:493] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.885452 17537 raft_consensus.cc:515] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.885739 17537 leader_election.cc:290] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.886024 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5027b80220e34f5f8e1e8e8479ec41f3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:33.886400 15049 leader_election.cc:343] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.886812 17369 consensus_queue.cc:1048] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.887291 17591 tablet.cc:1722] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.888326 17274 tablet_bootstrap.cc:492] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.888403 17274 ts_tablet_manager.cc:1403] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:33.888860 17274 raft_consensus.cc:359] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.888944 17274 raft_consensus.cc:385] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.888986 17274 raft_consensus.cc:740] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.889071 17620 tablet.cc:1722] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.889079 17274 consensus_queue.cc:260] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.889318 17274 ts_tablet_manager.cc:1434] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.889470 17274 tablet_bootstrap.cc:492] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.890386 17274 tablet_bootstrap.cc:654] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.892926 17372 consensus_queue.cc:1048] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:33.897213 16280 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet db4e3d9c58564fac9cd2f46b6458df6f consensus state has no leader
I20251025 08:02:33.897410 16280 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_1af17555bf4d4cd480b16563fa2098e5" } new_table_name: "default.Table_a24e0514b7d94c60a5b075e650077668" modify_external_catalogs: true
I20251025 08:02:33.902041 17274 tablet_bootstrap.cc:492] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.902222 17274 ts_tablet_manager.cc:1403] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20251025 08:02:33.903728 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 765cb9954ff544a4b6dc25c675f6e1e0 (DEFAULT_TABLE table=default.Table_19e7c7e83016475789438a6a289ef69e [id=04f310fb73dd4997906783f12322d139]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.903816 17258 ts_tablet_manager.cc:1916] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.903793 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 765cb9954ff544a4b6dc25c675f6e1e0 (DEFAULT_TABLE table=default.Table_19e7c7e83016475789438a6a289ef69e [id=04f310fb73dd4997906783f12322d139]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.904016 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765cb9954ff544a4b6dc25c675f6e1e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.903973 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765cb9954ff544a4b6dc25c675f6e1e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.908221 17316 consensus_queue.cc:1048] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.910475 17258 ts_tablet_manager.cc:1929] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.910571 17258 log.cc:1199] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/86b1873446154249a80fa67b99496545
I20251025 08:02:33.910830 17258 ts_tablet_manager.cc:1950] T 86b1873446154249a80fa67b99496545 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.911450 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 86b1873446154249a80fa67b99496545 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]) successfully deleted
I20251025 08:02:33.911676 17258 tablet_replica.cc:333] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.905457 15079 tablet_service.cc:1552] Processing DeleteTablet for tablet 736f75f26af142e59e7996c2ebb80868 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.912070 15079 tablet_service.cc:1552] Processing DeleteTablet for tablet 685d09c4a80b4d48b477cd4c0fc9db40 with delete_type TABLET_DATA_DELETED (replaced by tablet 37517c4c32c042eabcc8270de33af834) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.912268 15079 tablet_service.cc:1505] Processing CreateTablet for tablet e03e2e21e3f64bedb04c7e79aea6d49d (DEFAULT_TABLE table=default.Table_0a2f6d5c51c14b61afdb71a5f7e48c3b [id=4e47e7759fc64598807f1ee3a973820f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.912495 15079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03e2e21e3f64bedb04c7e79aea6d49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.905548 15078 tablet_service.cc:1552] Processing DeleteTablet for tablet d162f3ee21bd40ce9a9c74b7863a3878 with delete_type TABLET_DATA_DELETED (replaced by tablet f64222dd274f46e9bf79dba96c5c18b1) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.914381 15078 tablet_service.cc:1505] Processing CreateTablet for tablet 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99 (DEFAULT_TABLE table=default.Table_7a0da42c26a9414996eb1aeaea64f82d [id=89c01fd911ca487b9b29576adec1fbee]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.914585 15078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.916193 17274 raft_consensus.cc:359] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.916332 17274 raft_consensus.cc:385] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.916394 17274 raft_consensus.cc:740] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.916483 15078 tablet_service.cc:1505] Processing CreateTablet for tablet 5522e9c5bf904c63bc4b00a226a0cc45 (DEFAULT_TABLE table=default.Table_25e0298aad614dba82f598191e458567 [id=7edb1b5b68864e54b6366186a8915fcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.916654 15078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5522e9c5bf904c63bc4b00a226a0cc45. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.916577 17274 consensus_queue.cc:260] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.917091 17274 ts_tablet_manager.cc:1434] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:33.917344 17274 tablet_bootstrap.cc:492] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.905612 15076 tablet_service.cc:1552] Processing DeleteTablet for tablet 93d383e3e2f4493d9cc8a71a4284e107 with delete_type TABLET_DATA_DELETED (replaced by tablet 82b93b7537c047aea430658ae2c2654b) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.918380 15076 tablet_service.cc:1505] Processing CreateTablet for tablet 6d526e6cd8334742afea21ece24596ec (DEFAULT_TABLE table=default.Table_4c672efab2bb448ab1dcfd4325e8c053 [id=0db3af0dc90e4ea5ac9a029e3864ce58]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.918576 15076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d526e6cd8334742afea21ece24596ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.919061 17274 tablet_bootstrap.cc:654] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.919373 17566 tablet.cc:1722] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:33.920321 14958 tablet_service.cc:1505] Processing CreateTablet for tablet a67d80dba81049279f536d8c6481f3f2 (DEFAULT_TABLE table=default.Table_bda70e09b01847069a68d129053e6b26 [id=ec62cd99f7d049c6bdd8b0de71ed6367]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.920528 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67d80dba81049279f536d8c6481f3f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.920559 15076 tablet_service.cc:1505] Processing CreateTablet for tablet db4e3d9c58564fac9cd2f46b6458df6f (DEFAULT_TABLE table=default.Table_b4260045775a4239b82e06034162a6f9 [id=0864c970ad1c4ad3a0179e640dcc4859]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.920727 15076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet db4e3d9c58564fac9cd2f46b6458df6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.921244 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 35bddef8fd2d4971a636e0689ac37d3a (DEFAULT_TABLE table=default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.921454 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35bddef8fd2d4971a636e0689ac37d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.905797 15086 tablet_service.cc:1505] Processing CreateTablet for tablet f102eb1c22004790839b6563bd830786 (DEFAULT_TABLE table=default.Table_45dccafd9b8f494c9fb2c59042be73f9 [id=7b766fed8fb7420aa669e8a45e5ea62c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.905918 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet 2562325ea1c9436a85e1d675574c0a6c with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.922410 15085 tablet_service.cc:1505] Processing CreateTablet for tablet 765cb9954ff544a4b6dc25c675f6e1e0 (DEFAULT_TABLE table=default.Table_19e7c7e83016475789438a6a289ef69e [id=04f310fb73dd4997906783f12322d139]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.922595 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765cb9954ff544a4b6dc25c675f6e1e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.923115 14940 tablet_service.cc:1505] Processing CreateTablet for tablet e0f08e0726a447848747ea33588867eb (DEFAULT_TABLE table=default.Table_82dd4283c4d44377ad2a4834aa04ebfe [id=912da5ef8bbf4af29528c084ea7fa633]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.923316 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f08e0726a447848747ea33588867eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.923415 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 62db0ba07ab64d3691bac134d10db771 (DEFAULT_TABLE table=default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.923604 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62db0ba07ab64d3691bac134d10db771. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.906034 15082 tablet_service.cc:1552] Processing DeleteTablet for tablet e03e2e21e3f64bedb04c7e79aea6d49d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.906101 15080 tablet_service.cc:1552] Processing DeleteTablet for tablet cb3569ec2cdd4736b264b00abf1fa36a with delete_type TABLET_DATA_DELETED (replaced by tablet c994b9b0fa3d46b9bb4c01610437972c) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.906137 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 52d69474461c427398de1a843fae2389 (DEFAULT_TABLE table=default.Table_631837cf20584c788ca33f5d97ad28db [id=9d351cb68ad04c9babba603360e63284]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.923902 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52d69474461c427398de1a843fae2389. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.906356 15081 tablet_service.cc:1505] Processing CreateTablet for tablet 0948123d65e54a01b94bb40e21a76818 (DEFAULT_TABLE table=default.Table_3049e822186441f189fa1361f0f0224c [id=d0d8ee6036ff408893b909c9b6273790]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.925087 15081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0948123d65e54a01b94bb40e21a76818. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.926340 15086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f102eb1c22004790839b6563bd830786. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.906567 15087 tablet_service.cc:1552] Processing DeleteTablet for tablet 6b16e4b9ef4c41db83ab3bf55149719b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.906602 15083 tablet_service.cc:1552] Processing DeleteTablet for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.906742 15089 tablet_service.cc:1505] Processing CreateTablet for tablet f64222dd274f46e9bf79dba96c5c18b1 (DEFAULT_TABLE table=default.Table_a6c6f65ea3444858aa562a65d71c4e77 [id=2ef2d72066f446619f9045da34df7814]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.927925 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 35bddef8fd2d4971a636e0689ac37d3a (DEFAULT_TABLE table=default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.928097 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f64222dd274f46e9bf79dba96c5c18b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.928164 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35bddef8fd2d4971a636e0689ac37d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.906742 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff (DEFAULT_TABLE table=default.Table_5a29e7dba4ba43dfbd0c27981080a1ac [id=8611464429b848fbb277f6a03557cd0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.906867 15093 tablet_service.cc:1505] Processing CreateTablet for tablet de53385f417d4e5eb34ab4537a9b638b (DEFAULT_TABLE table=default.Table_2942acd29f7c42ceb19355a101b68dd8 [id=321b596b7ce44599a5136e0b1fa6886f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.929293 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.930049 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 62db0ba07ab64d3691bac134d10db771 (DEFAULT_TABLE table=default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.930270 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62db0ba07ab64d3691bac134d10db771. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.906571 15077 tablet_service.cc:1552] Processing DeleteTablet for tablet 0078dd6fb0e34d01a54889326dd6dfd7 with delete_type TABLET_DATA_DELETED (replaced by tablet 2fde39be14794d8680c332bb05c59292) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.907066 15075 tablet_service.cc:1505] Processing CreateTablet for tablet 4826826d19fd421a9d04eac17a79a9fb (DEFAULT_TABLE table=default.Table_d03eda3087a54490a502678eeeeeabc8 [id=1297b3a21b8a458d80575525d6df9783]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.907361 15090 tablet_service.cc:1552] Processing DeleteTablet for tablet 5027b80220e34f5f8e1e8e8479ec41f3 with delete_type TABLET_DATA_DELETED (replaced by tablet bce04638a32443bc853ae242c6651ac5) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.907433 15084 tablet_service.cc:1552] Processing DeleteTablet for tablet 5522e9c5bf904c63bc4b00a226a0cc45 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.907578 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 00ecaed82db64f6f867f5db93e38180a (DEFAULT_TABLE table=default.Table_1ccbe630ac5a41ecb7b00087172bec38 [id=1e716be545914b22887b2f7e069c41c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.907668 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet f64222dd274f46e9bf79dba96c5c18b1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:33.930627 15075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4826826d19fd421a9d04eac17a79a9fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.930709 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ecaed82db64f6f867f5db93e38180a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.931730 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de53385f417d4e5eb34ab4537a9b638b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.933820 15218 tablet_service.cc:1505] Processing CreateTablet for tablet a67d80dba81049279f536d8c6481f3f2 (DEFAULT_TABLE table=default.Table_bda70e09b01847069a68d129053e6b26 [id=ec62cd99f7d049c6bdd8b0de71ed6367]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:33.934005 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67d80dba81049279f536d8c6481f3f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:33.934422 17316 raft_consensus.cc:493] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.934505 17316 raft_consensus.cc:515] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.934836 17316 leader_election.cc:290] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.935200 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "acb84bad2f75474faecd00432d187ccf" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.935199 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "acb84bad2f75474faecd00432d187ccf" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:33.935302 15110 raft_consensus.cc:2468] T acb84bad2f75474faecd00432d187ccf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:33.935580 15185 leader_election.cc:304] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.935708 17316 raft_consensus.cc:2804] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.935739 17316 raft_consensus.cc:493] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.935768 17316 raft_consensus.cc:3060] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:33.935986 15183 leader_election.cc:343] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.936620 17316 raft_consensus.cc:515] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.936916 17316 leader_election.cc:290] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.937343 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "acb84bad2f75474faecd00432d187ccf" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:33.937621 15183 leader_election.cc:343] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.938148 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "acb84bad2f75474faecd00432d187ccf" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:33.938264 15110 raft_consensus.cc:3060] T acb84bad2f75474faecd00432d187ccf P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.939002 15110 raft_consensus.cc:2468] T acb84bad2f75474faecd00432d187ccf P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:33.939532 17258 raft_consensus.cc:2243] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.939592 15185 leader_election.cc:304] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:33.939762 17258 raft_consensus.cc:2272] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.939976 17316 raft_consensus.cc:2804] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.940140 17258 ts_tablet_manager.cc:1916] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.940117 17316 raft_consensus.cc:697] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:33.940320 17316 consensus_queue.cc:237] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:33.941825 15183 consensus_peers.cc:597] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0078dd6fb0e34d01a54889326dd6dfd7. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:33.943384 17194 ts_tablet_manager.cc:1929] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.943536 17194 log.cc:1199] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/685d09c4a80b4d48b477cd4c0fc9db40
I20251025 08:02:33.943784 17194 ts_tablet_manager.cc:1950] T 685d09c4a80b4d48b477cd4c0fc9db40 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:33.944358 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 685d09c4a80b4d48b477cd4c0fc9db40 (table default.Table_27c6a21fc727493fba3613698ba9e108 [id=8e0aa39fb7de4352b22bd41fb1313236]) successfully deleted
I20251025 08:02:33.945410 16287 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_15d9c5aa50e643adb2dae30a80b6fcd4" } modify_external_catalogs: true
I20251025 08:02:33.945501 16287 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_15d9c5aa50e643adb2dae30a80b6fcd4" } modify_external_catalogs: true
I20251025 08:02:33.945783 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_d1dd8988206f424faa2ebf7b9d0659a5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:33.946077 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1dd8988206f424faa2ebf7b9d0659a5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:33.951049 17369 consensus_queue.cc:1048] T dafad70d3f69440c9d42e8ee73123d2d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.953235 17274 tablet_bootstrap.cc:492] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.953312 17274 ts_tablet_manager.cc:1403] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.036s user 0.002s sys 0.000s
I20251025 08:02:33.953727 17258 ts_tablet_manager.cc:1929] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.953786 17258 log.cc:1199] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/b4d1c652b6a4420a81e03cd58c6dbc69
I20251025 08:02:33.953735 17274 raft_consensus.cc:359] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.953815 17274 raft_consensus.cc:385] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.953851 17274 raft_consensus.cc:740] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.953960 17274 consensus_queue.cc:260] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.954027 17258 ts_tablet_manager.cc:1950] T b4d1c652b6a4420a81e03cd58c6dbc69 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.954264 17274 ts_tablet_manager.cc:1434] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.954401 17274 tablet_bootstrap.cc:492] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.955202 17274 tablet_bootstrap.cc:654] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.957880 17274 tablet_bootstrap.cc:492] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.957942 17274 ts_tablet_manager.cc:1403] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20251025 08:02:33.957973 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet b4d1c652b6a4420a81e03cd58c6dbc69 (table default.Table_c2e0c935fdb34bc38f482cac268ad080 [id=62e3c831964e4f71a8ee6aca23069b44]) successfully deleted
I20251025 08:02:33.958141 17258 tablet_replica.cc:333] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.958276 17258 raft_consensus.cc:2243] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.958302 17274 raft_consensus.cc:359] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.958386 17274 raft_consensus.cc:385] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.958412 17274 raft_consensus.cc:740] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.958425 17258 raft_consensus.cc:2272] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.958499 17274 consensus_queue.cc:260] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.958731 17274 ts_tablet_manager.cc:1434] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.958849 17274 tablet_bootstrap.cc:492] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.959774 17274 tablet_bootstrap.cc:654] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.959892 17258 ts_tablet_manager.cc:1916] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.961709 17595 consensus_queue.cc:1048] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.961936 17274 tablet_bootstrap.cc:492] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.962026 17274 ts_tablet_manager.cc:1403] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20251025 08:02:33.962451 17274 raft_consensus.cc:359] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.962549 17274 raft_consensus.cc:385] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.962589 17274 raft_consensus.cc:740] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.962687 17274 consensus_queue.cc:260] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.962924 17274 ts_tablet_manager.cc:1434] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.962934 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 6cedb44483cf4f62acf52b90b6708dfb with delete_type TABLET_DATA_DELETED (replaced by tablet 86b1873446154249a80fa67b99496545) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.963189 17274 tablet_bootstrap.cc:492] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.963188 17258 ts_tablet_manager.cc:1929] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:33.963265 17258 log.cc:1199] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/2562325ea1c9436a85e1d675574c0a6c
I20251025 08:02:33.964105 17274 tablet_bootstrap.cc:654] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.964135 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 98baf6e8d8e84b42a83054495ae19e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.964262 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 with delete_type TABLET_DATA_DELETED (replaced by tablet e7a34f24b89b4003b6590f8259a57199) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.964330 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 7e90c358ef454760b8317d78724ee377 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.963436 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:29 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.964366 15217 tablet_service.cc:1552] Processing DeleteTablet for tablet 6dd0f695a2904df5b750b45782a21ce2 with delete_type TABLET_DATA_DELETED (replaced by tablet f3f42babc0b2421fa80b265997effe36) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.964470 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet e106f20977444dd4a49b6e4ae0f45380 with delete_type TABLET_DATA_DELETED (replaced by tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c) from {username='slave'} at 127.0.0.1:42704
W20251025 08:02:33.964497 16286 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.14.70.3:37907 (request call id 220) took 913 ms (client timeout 1000 ms). Trace:
I20251025 08:02:33.964268 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet a3379087113041beba7ddbc6596c3b0a with delete_type TABLET_DATA_DELETED (replaced by tablet bc56844d88604fa5be02cd82b5856cd1) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:33.964869 17258 ts_tablet_manager.cc:1950] T 2562325ea1c9436a85e1d675574c0a6c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:33.964547 16286 rpcz_store.cc:269] 1025 08:02:33.051334 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.051375 (+ 41us) service_pool.cc:225] Handling call
1025 08:02:33.964486 (+913111us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1025 08:02:33.324400 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:33.324457 (+ 57us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:33.324459 (+ 2us) write_op.cc:435] Acquired schema lock
1025 08:02:33.324460 (+ 1us) tablet.cc:660] Decoding operations
1025 08:02:33.324517 (+ 57us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:33.324522 (+ 5us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:33.324526 (+ 4us) tablet.cc:683] Acquiring locks for 3 operations
1025 08:02:33.324569 (+ 43us) tablet.cc:699] Row locks acquired
1025 08:02:33.324570 (+ 1us) write_op.cc:260] PREPARE: finished
1025 08:02:33.324589 (+ 19us) write_op.cc:270] Start()
1025 08:02:33.324609 (+ 20us) write_op.cc:276] Timestamp: P: 1761379353324551 usec, L: 0
1025 08:02:33.324611 (+ 2us) op_driver.cc:348] REPLICATION: starting
1025 08:02:33.324701 (+ 90us) log.cc:844] Serialized 1275 byte log entry
1025 08:02:33.328667 (+ 3966us) op_driver.cc:464] REPLICATION: finished
1025 08:02:33.329478 (+ 811us) write_op.cc:301] APPLY: starting
1025 08:02:33.329485 (+ 7us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:33.329504 (+ 19us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:33.329514 (+ 10us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:33.329552 (+ 38us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:33.329571 (+ 19us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
1025 08:02:33.329574 (+ 3us) write_op.cc:312] APPLY: finished
1025 08:02:33.329609 (+ 35us) log.cc:844] Serialized 35 byte log entry
1025 08:02:33.329632 (+ 23us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:33.329640 (+ 8us) write_op.cc:454] Released schema lock
1025 08:02:33.329643 (+ 3us) write_op.cc:341] FINISH: Updating metrics
1025 08:02:33.329689 (+ 46us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:33.329691 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
1025 08:02:33.399909 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:33.399961 (+ 52us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:33.399964 (+ 3us) write_op.cc:435] Acquired schema lock
1025 08:02:33.399965 (+ 1us) tablet.cc:660] Decoding operations
1025 08:02:33.400000 (+ 35us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:33.400003 (+ 3us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:33.400006 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
1025 08:02:33.400028 (+ 22us) tablet.cc:699] Row locks acquired
1025 08:02:33.400029 (+ 1us) write_op.cc:260] PREPARE: finished
1025 08:02:33.400044 (+ 15us) write_op.cc:270] Start()
1025 08:02:33.400057 (+ 13us) write_op.cc:276] Timestamp: P: 1761379353400002 usec, L: 0
1025 08:02:33.400058 (+ 1us) op_driver.cc:348] REPLICATION: starting
1025 08:02:33.400126 (+ 68us) log.cc:844] Serialized 356 byte log entry
1025 08:02:33.457094 (+ 56968us) op_driver.cc:464] REPLICATION: finished
1025 08:02:33.457888 (+ 794us) write_op.cc:301] APPLY: starting
1025 08:02:33.457893 (+ 5us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:33.457906 (+ 13us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:33.457913 (+ 7us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:33.457929 (+ 16us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:33.457942 (+ 13us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
1025 08:02:33.457945 (+ 3us) write_op.cc:312] APPLY: finished
1025 08:02:33.457971 (+ 26us) log.cc:844] Serialized 23 byte log entry
1025 08:02:33.457997 (+ 26us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:33.458003 (+ 6us) write_op.cc:454] Released schema lock
1025 08:02:33.458005 (+ 2us) write_op.cc:341] FINISH: Updating metrics
1025 08:02:33.458037 (+ 32us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:33.458039 (+ 2us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":138,"child_traces":[["op",{"apply.queue_time_us":790,"apply.run_cpu_time_us":204,"apply.run_wall_time_us":204,"num_ops":3,"prepare.queue_time_us":34,"prepare.run_cpu_time_us":337,"prepare.run_wall_time_us":337,"replication_time_us":4045}],["op",{"apply.queue_time_us":777,"apply.run_cpu_time_us":144,"apply.run_wall_time_us":144,"num_ops":1,"prepare.queue_time_us":337,"prepare.run_cpu_time_us":257,"prepare.run_wall_time_us":256,"replication_time_us":57027}]]}
I20251025 08:02:33.965540 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 2562325ea1c9436a85e1d675574c0a6c (table default.Table_4b899f935c754aa2876c910eb2e208e3 [id=8a0e4fe9e4544c539cb23b0279c1deaf]) successfully deleted
I20251025 08:02:33.966008 16390 tablet_bootstrap.cc:492] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:33.966074 16390 ts_tablet_manager.cc:1403] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.109s user 0.002s sys 0.000s
I20251025 08:02:33.966276 17274 tablet_bootstrap.cc:492] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:33.966367 17274 ts_tablet_manager.cc:1403] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:33.966416 16390 raft_consensus.cc:359] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.966495 16390 raft_consensus.cc:385] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.966521 16390 raft_consensus.cc:740] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.966614 16390 consensus_queue.cc:260] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.966846 16390 ts_tablet_manager.cc:1434] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:33.966917 17274 raft_consensus.cc:359] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.967012 16390 tablet_bootstrap.cc:492] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:33.967031 17274 raft_consensus.cc:385] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.967060 17274 raft_consensus.cc:740] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.967200 17274 consensus_queue.cc:260] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.967621 17274 ts_tablet_manager.cc:1434] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:33.967751 16390 tablet_bootstrap.cc:654] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.967808 17274 tablet_bootstrap.cc:492] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:33.968853 17594 consensus_queue.cc:1048] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.970113 15642 raft_consensus.cc:493] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.970189 15642 raft_consensus.cc:515] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.970459 15642 leader_election.cc:290] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.970778 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "879ae11ae94b4d2eab76c1dc74e160ca" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.970937 17258 tablet_replica.cc:333] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.971048 17258 raft_consensus.cc:2243] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.971190 17258 raft_consensus.cc:2272] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.971485 17258 ts_tablet_manager.cc:1916] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:33.971812 15049 leader_election.cc:343] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:33.972028 15049 consensus_peers.cc:597] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b6ae6527fd64c3bb5999dec97db861d. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:33.972281 15642 raft_consensus.cc:493] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.972378 15642 raft_consensus.cc:515] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.972667 15642 leader_election.cc:290] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.972201 17274 tablet_bootstrap.cc:654] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.972951 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76c31d4c83c740dab40bebd6c8d3f161" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:33.973266 15049 leader_election.cc:343] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:33.973870 17258 ts_tablet_manager.cc:1929] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.974296 15642 raft_consensus.cc:493] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251025 08:02:33.974272 15183 consensus_peers.cc:597] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 685d09c4a80b4d48b477cd4c0fc9db40. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:33.974371 15642 raft_consensus.cc:515] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.974419 17258 log.cc:1199] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/cb3569ec2cdd4736b264b00abf1fa36a
I20251025 08:02:33.974675 15642 leader_election.cc:290] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.974799 14915 leader_election.cc:304] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:33.974968 17258 ts_tablet_manager.cc:1950] T cb3569ec2cdd4736b264b00abf1fa36a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.974977 17594 raft_consensus.cc:3060] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.975510 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet cb3569ec2cdd4736b264b00abf1fa36a (table default.Table_08073379da334076bcc5503770a32982 [id=1ee33ee129d749d0bd7f26dc49fca0fe]) successfully deleted
I20251025 08:02:33.975955 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adb2c77ec9b84fe8846084cddc23888a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.976234 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88a76d187fae4f09ac879b72e9c05a86" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:33.976229 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adb2c77ec9b84fe8846084cddc23888a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:33.976338 15249 raft_consensus.cc:2468] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:33.976550 15642 raft_consensus.cc:493] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.976621 15642 raft_consensus.cc:515] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:33.976646 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet e03e2e21e3f64bedb04c7e79aea6d49d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e03e2e21e3f64bedb04c7e79aea6d49d already in progress: creating tablet
I20251025 08:02:33.975962 17594 raft_consensus.cc:2749] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:33.976940 15642 leader_election.cc:290] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:33.977056 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 5522e9c5bf904c63bc4b00a226a0cc45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5522e9c5bf904c63bc4b00a226a0cc45 already in progress: creating tablet
W20251025 08:02:33.978436 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 1927cf6a9013402a92c9e6e89e2e1715 because the tablet was not found. No further retry: Not found: Tablet not found: 1927cf6a9013402a92c9e6e89e2e1715
I20251025 08:02:33.978576 15049 leader_election.cc:304] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
W20251025 08:02:33.978785 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet bfdc6022cc5747439edcb8aa865b9437 because the tablet was not found. No further retry: Not found: Tablet not found: bfdc6022cc5747439edcb8aa865b9437
W20251025 08:02:33.979110 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet d709ecb9ac9a4525985c7d2bf10719f5 because the tablet was not found. No further retry: Not found: Tablet not found: d709ecb9ac9a4525985c7d2bf10719f5
W20251025 08:02:33.979560 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet f64222dd274f46e9bf79dba96c5c18b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f64222dd274f46e9bf79dba96c5c18b1 already in progress: creating tablet
W20251025 08:02:33.979916 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 6b16e4b9ef4c41db83ab3bf55149719b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6b16e4b9ef4c41db83ab3bf55149719b already in progress: creating tablet
I20251025 08:02:33.980100 17258 tablet_replica.cc:333] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
W20251025 08:02:33.980181 15049 leader_election.cc:343] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: be8d6685c70c4219947df30f023a59b8
I20251025 08:02:33.980232 17258 raft_consensus.cc:2243] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.980299 15642 raft_consensus.cc:2804] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:33.980350 15642 raft_consensus.cc:493] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:33.980394 15642 raft_consensus.cc:3060] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.980464 17258 raft_consensus.cc:2272] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.981186 15642 raft_consensus.cc:515] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.981240 17258 ts_tablet_manager.cc:1916] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.981464 15642 leader_election.cc:290] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:33.981621 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2be36d176bf34fb6bd3c70b42af15cc9" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:33.982175 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88a76d187fae4f09ac879b72e9c05a86" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:33.982302 15249 raft_consensus.cc:3060] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:33.983126 15249 raft_consensus.cc:2468] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:33.983541 17198 ts_tablet_manager.cc:1929] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.983634 17198 log.cc:1199] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/d993e2350f37492bb712d145d03e8afb
I20251025 08:02:33.983978 15049 leader_election.cc:304] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:33.984447 15642 raft_consensus.cc:2804] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:33.984524 17198 ts_tablet_manager.cc:1950] T d993e2350f37492bb712d145d03e8afb P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:33.984607 15642 raft_consensus.cc:697] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:33.984694 17258 ts_tablet_manager.cc:1929] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:33.984771 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 66) took 1625 ms. Trace:
I20251025 08:02:33.984751 15642 consensus_queue.cc:237] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.986335 17258 log.cc:1199] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/0078dd6fb0e34d01a54889326dd6dfd7
I20251025 08:02:33.986649 17258 ts_tablet_manager.cc:1950] T 0078dd6fb0e34d01a54889326dd6dfd7 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.987195 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 0078dd6fb0e34d01a54889326dd6dfd7 (table default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b]) successfully deleted
W20251025 08:02:33.987561 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 5027b80220e34f5f8e1e8e8479ec41f3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5027b80220e34f5f8e1e8e8479ec41f3 already in progress: creating tablet
I20251025 08:02:33.987763 17258 tablet_replica.cc:333] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:33.988637 17594 consensus_queue.cc:1048] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:33.989001 17258 raft_consensus.cc:2243] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:33.989189 17258 raft_consensus.cc:2272] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:33.989549 17258 ts_tablet_manager.cc:1916] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:33.993783 17258 ts_tablet_manager.cc:1929] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:33.994670 16391 tablet_bootstrap.cc:492] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:33.994747 16391 ts_tablet_manager.cc:1403] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.277s user 0.000s sys 0.002s
I20251025 08:02:33.995187 16391 raft_consensus.cc:359] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.995270 16391 raft_consensus.cc:385] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:33.995296 16391 raft_consensus.cc:740] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:33.995389 16391 consensus_queue.cc:260] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.995626 16391 ts_tablet_manager.cc:1434] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:33.995774 16391 tablet_bootstrap.cc:492] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:33.996654 16391 tablet_bootstrap.cc:654] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:33.997260 17258 log.cc:1199] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/685d09c4a80b4d48b477cd4c0fc9db40
I20251025 08:02:33.997552 17258 ts_tablet_manager.cc:1950] T 685d09c4a80b4d48b477cd4c0fc9db40 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:33.998422 17372 raft_consensus.cc:493] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:33.998504 17372 raft_consensus.cc:515] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:33.998807 17372 leader_election.cc:290] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:33.999369 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "947b2d44ffa04370a04d5b4c24e11083" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:33.999648 15183 leader_election.cc:343] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.000315 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "947b2d44ffa04370a04d5b4c24e11083" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.000425 15110 raft_consensus.cc:2468] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
W20251025 08:02:34.003516 16285 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb798a7e37434ec49c10ebcd7629be89 has no consensus state
I20251025 08:02:34.003520 15185 leader_election.cc:304] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:34.003705 16282 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_89038955e92b42c2af35921ad16899d4 [id=e3c0ae796ee2421abe38408b729dd2a6] alter complete (version 1)
I20251025 08:02:34.003741 17316 raft_consensus.cc:2804] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.003786 17316 raft_consensus.cc:493] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.003825 17316 raft_consensus.cc:3060] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.004705 17316 raft_consensus.cc:515] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.006223 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "947b2d44ffa04370a04d5b4c24e11083" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:34.006800 15183 leader_election.cc:343] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.006909 16282 master_service.cc:954] ReplaceTablet: received request to replace tablet d05bf0056dfc43eeb4105af559497bdc from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.007062 17316 leader_election.cc:290] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.007261 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 736f75f26af142e59e7996c2ebb80868 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.007407 17194 tablet_replica.cc:333] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.007490 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "947b2d44ffa04370a04d5b4c24e11083" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:34.007521 17194 raft_consensus.cc:2243] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.007572 15110 raft_consensus.cc:3060] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.007612 17194 raft_consensus.cc:2272] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.008337 17194 ts_tablet_manager.cc:1916] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.008368 15110 raft_consensus.cc:2468] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:34.009313 17591 tablet.cc:1722] T 1019d033e1f24ab596309462cbeb9c73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.010331 17194 ts_tablet_manager.cc:1929] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.010385 17194 log.cc:1199] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/736f75f26af142e59e7996c2ebb80868
I20251025 08:02:34.010594 17194 ts_tablet_manager.cc:1950] T 736f75f26af142e59e7996c2ebb80868 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.011179 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 736f75f26af142e59e7996c2ebb80868 (table default.Table_d77beb2fdfdd42e5b1a16072888cfcac [id=6a04bdbf8b9046c59dc87dd393367134]) successfully deleted
I20251025 08:02:34.011595 15185 leader_election.cc:304] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:34.012073 17316 raft_consensus.cc:2804] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.012140 17316 raft_consensus.cc:697] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:34.012121 17594 consensus_queue.cc:1048] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.012233 17316 consensus_queue.cc:237] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.007391 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 658a20d894c5444a820ce6bd33e4fdf0 with delete_type TABLET_DATA_DELETED (replaced by tablet 5522e9c5bf904c63bc4b00a226a0cc45) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.013720 17194 tablet_replica.cc:333] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.013828 17194 raft_consensus.cc:2243] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.013886 15642 raft_consensus.cc:493] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f2f8ce3e9f4d9ba3f3f02813397c31)
I20251025 08:02:34.013911 17194 raft_consensus.cc:2272] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.013953 15642 raft_consensus.cc:515] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:34.014223 17194 ts_tablet_manager.cc:1916] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.014292 15642 leader_election.cc:290] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:34.014365 17620 tablet.cc:1722] T 1019d033e1f24ab596309462cbeb9c73 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.014906 17566 tablet.cc:1722] T 1019d033e1f24ab596309462cbeb9c73 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.016367 17194 ts_tablet_manager.cc:1929] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.016426 17194 log.cc:1199] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/658a20d894c5444a820ce6bd33e4fdf0
I20251025 08:02:34.016607 17194 ts_tablet_manager.cc:1950] T 658a20d894c5444a820ce6bd33e4fdf0 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.016930 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2be36d176bf34fb6bd3c70b42af15cc9" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:34.017379 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "947b2d44ffa04370a04d5b4c24e11083" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.017735 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29b4798bac204280b9c56ebb0f44302d" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.017946 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 43da3f4fc9604562a95dff59da3c574b (table default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031]) successfully deleted
I20251025 08:02:34.019315 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a4b060efd054726b07702b691876147" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.019835 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5027b80220e34f5f8e1e8e8479ec41f3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.021059 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 658a20d894c5444a820ce6bd33e4fdf0 (table default.Table_25e0298aad614dba82f598191e458567 [id=7edb1b5b68864e54b6366186a8915fcf]) successfully deleted
W20251025 08:02:34.021641 15049 leader_election.cc:343] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: 6c582efa6d334a06a48e2f2b94167776
I20251025 08:02:34.024003 16281 catalog_manager.cc:5649] T 95030a851b5d4155b235a4e896250c80 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:34.024222 16281 catalog_manager.cc:5649] T dafad70d3f69440c9d42e8ee73123d2d P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:34.025087 16281 catalog_manager.cc:5649] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:34.025223 16281 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet ed2036a8ebd74ab18c0bbd6d9aa67ef0 (table default.Table_e7e4f555b1d140ef907741daae26ce2b [id=a8e0504bc08744b4915157fa63d2226e]). Expected version 1 got 0
I20251025 08:02:34.025306 16281 catalog_manager.cc:5649] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:34.025647 16279 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_45dccafd9b8f494c9fb2c59042be73f9" } modify_external_catalogs: true
I20251025 08:02:34.025683 17369 consensus_queue.cc:1048] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.025738 16279 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_45dccafd9b8f494c9fb2c59042be73f9" } modify_external_catalogs: true
I20251025 08:02:34.026011 16281 catalog_manager.cc:5649] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:34.026899 16281 catalog_manager.cc:5649] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:34.027218 16281 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 88a76d187fae4f09ac879b72e9c05a86 (table default.Table_8d621c2f449e477ab01d1b67dc869408 [id=d318bca8bf144870aa5529426cfa9995]). Expected version 1 got 0
I20251025 08:02:34.027519 16281 catalog_manager.cc:5649] T fc485ee4814142cda9be0d937aaa5dc1 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:34.028033 17274 tablet_bootstrap.cc:492] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.028097 17274 ts_tablet_manager.cc:1403] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.060s user 0.000s sys 0.002s
I20251025 08:02:34.028491 17274 raft_consensus.cc:359] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.028565 17274 raft_consensus.cc:385] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.028590 17274 raft_consensus.cc:740] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.028677 17274 consensus_queue.cc:260] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.028892 17274 ts_tablet_manager.cc:1434] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:34.032358 17274 tablet_bootstrap.cc:492] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.033221 17274 tablet_bootstrap.cc:654] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.033564 15215 tablet_service.cc:1505] Processing CreateTablet for tablet e0f08e0726a447848747ea33588867eb (DEFAULT_TABLE table=default.Table_82dd4283c4d44377ad2a4834aa04ebfe [id=912da5ef8bbf4af29528c084ea7fa633]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.034211 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 7a810514b25b47d58c12d7f22f897e4c (DEFAULT_TABLE table=default.Table_7650f4b1f03949c5a77899e2ad5e1fe9 [id=d9686ee7426a40d6a044ecaef9df2714]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.034409 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a810514b25b47d58c12d7f22f897e4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.034848 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 7a810514b25b47d58c12d7f22f897e4c (DEFAULT_TABLE table=default.Table_7650f4b1f03949c5a77899e2ad5e1fe9 [id=d9686ee7426a40d6a044ecaef9df2714]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.035861 17258 tablet_replica.cc:333] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.035974 17258 raft_consensus.cc:2243] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.036131 17258 raft_consensus.cc:2272] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.036387 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f08e0726a447848747ea33588867eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.038250 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a810514b25b47d58c12d7f22f897e4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.040266 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 685d09c4a80b4d48b477cd4c0fc9db40 (table default.Table_27c6a21fc727493fba3613698ba9e108 [id=8e0aa39fb7de4352b22bd41fb1313236]) successfully deleted
W20251025 08:02:34.040372 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet e762c440cb0947deb7e6a4186deebdc1 because the tablet was not found. No further retry: Not found: Tablet not found: e762c440cb0947deb7e6a4186deebdc1
W20251025 08:02:34.040445 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 14b47bf733754b72b34bd74aa033afa3 because the tablet was not found. No further retry: Not found: Tablet not found: 14b47bf733754b72b34bd74aa033afa3
W20251025 08:02:34.040513 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet ed5ed91e953d42afa9ebf9ab8b89d0e6 because the tablet was not found. No further retry: Not found: Tablet not found: ed5ed91e953d42afa9ebf9ab8b89d0e6
W20251025 08:02:34.040581 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet cfe9add2f8bf450bb6f49ad57be2caae because the tablet was not found. No further retry: Not found: Tablet not found: cfe9add2f8bf450bb6f49ad57be2caae
W20251025 08:02:34.040645 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet f5f72ca8cfb94178a21619ddc9fc0352 because the tablet was not found. No further retry: Not found: Tablet not found: f5f72ca8cfb94178a21619ddc9fc0352
W20251025 08:02:34.040709 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 31c9e3906dac487e8585daa13d3fe4b1 because the tablet was not found. No further retry: Not found: Tablet not found: 31c9e3906dac487e8585daa13d3fe4b1
W20251025 08:02:34.040793 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 16f1ab00a20345a1bb51e685b3fc6c70 because the tablet was not found. No further retry: Not found: Tablet not found: 16f1ab00a20345a1bb51e685b3fc6c70
W20251025 08:02:34.040881 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 8b6ae6527fd64c3bb5999dec97db861d because the tablet was not found. No further retry: Not found: Tablet not found: 8b6ae6527fd64c3bb5999dec97db861d
I20251025 08:02:34.041424 17258 ts_tablet_manager.cc:1916] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.043331 17258 ts_tablet_manager.cc:1929] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.043390 17258 log.cc:1199] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/736f75f26af142e59e7996c2ebb80868
I20251025 08:02:34.043614 17258 ts_tablet_manager.cc:1950] T 736f75f26af142e59e7996c2ebb80868 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.044168 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 736f75f26af142e59e7996c2ebb80868 (table default.Table_d77beb2fdfdd42e5b1a16072888cfcac [id=6a04bdbf8b9046c59dc87dd393367134]) successfully deleted
I20251025 08:02:34.044299 14973 raft_consensus.cc:3060] T 07b76abb029e4555851dfdc73ab31a38 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.044374 17258 tablet_replica.cc:333] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.044485 17258 raft_consensus.cc:2243] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.044623 17258 raft_consensus.cc:2272] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.045053 17258 ts_tablet_manager.cc:1916] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.046087 17372 consensus_queue.cc:1048] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.046811 17258 ts_tablet_manager.cc:1929] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.046901 17258 log.cc:1199] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/47b0f93bac664a44989534097be9fd73
W20251025 08:02:34.047032 16288 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6ae883acfacf451495ae73e1e813ec71 has no consensus state
I20251025 08:02:34.047155 17258 ts_tablet_manager.cc:1950] T 47b0f93bac664a44989534097be9fd73 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.047912 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 47b0f93bac664a44989534097be9fd73 (table default.Table_2c042f0ac6454365ae570c2cd26b31ca [id=d656394d725244dbbe22b0cfb8e4c89f]) successfully deleted
W20251025 08:02:34.048292 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 34c330b5dd544ae686f741cdd85d023d because the tablet was not found. No further retry: Not found: Tablet not found: 34c330b5dd544ae686f741cdd85d023d
W20251025 08:02:34.048640 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet bea55cdfbf454d76920806886c3d2c4e because the tablet was not found. No further retry: Not found: Tablet not found: bea55cdfbf454d76920806886c3d2c4e
I20251025 08:02:34.048799 15642 raft_consensus.cc:493] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.048887 15642 raft_consensus.cc:515] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:34.048995 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 54de7e83e8ea42ef93218b0204c61ec6 because the tablet was not found. No further retry: Not found: Tablet not found: 54de7e83e8ea42ef93218b0204c61ec6
I20251025 08:02:34.049211 15642 leader_election.cc:290] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:34.048810 15049 consensus_peers.cc:597] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8576553f17b49f8bd11436ecac471ed. This is attempt 1: this message will repeat every 5th retry.
W20251025 08:02:34.049368 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet f8576553f17b49f8bd11436ecac471ed because the tablet was not found. No further retry: Not found: Tablet not found: f8576553f17b49f8bd11436ecac471ed
I20251025 08:02:34.049523 15642 raft_consensus.cc:493] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.049590 15642 raft_consensus.cc:515] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.049621 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98baf6e8d8e84b42a83054495ae19e01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:34.049710 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 8362e26d86d44e9780d3c78c6a468556 because the tablet was not found. No further retry: Not found: Tablet not found: 8362e26d86d44e9780d3c78c6a468556
I20251025 08:02:34.049718 15248 raft_consensus.cc:2468] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:34.049873 15642 leader_election.cc:290] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:34.050083 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet fc5f892ca7a246a28a556fe0eb3f5442 because the tablet was not found. No further retry: Not found: Tablet not found: fc5f892ca7a246a28a556fe0eb3f5442
I20251025 08:02:34.050096 15049 leader_election.cc:304] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.050386 15642 raft_consensus.cc:2804] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.050395 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ddb3795876b486e992b58cea711afb3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.050438 15642 raft_consensus.cc:493] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20251025 08:02:34.050426 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet d5cd481a98514f16bed3fb0bf5003526 because the tablet was not found. No further retry: Not found: Tablet not found: d5cd481a98514f16bed3fb0bf5003526
I20251025 08:02:34.050475 15642 raft_consensus.cc:3060] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.050504 15248 raft_consensus.cc:2393] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 1: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
W20251025 08:02:34.050760 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 64996b8137f647b993923cb1bb093211 because the tablet was not found. No further retry: Not found: Tablet not found: 64996b8137f647b993923cb1bb093211
I20251025 08:02:34.050905 17258 tablet_replica.cc:333] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.051023 17258 raft_consensus.cc:2243] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.051126 17258 pending_rounds.cc:70] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 1 pending ops.
I20251025 08:02:34.051152 17258 pending_rounds.cc:77] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609833109995520 op_type: NO_OP noop_request { }
I20251025 08:02:34.051193 17258 raft_consensus.cc:2889] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:34.051254 17258 raft_consensus.cc:2272] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.051394 15642 raft_consensus.cc:515] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.051717 15642 leader_election.cc:290] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.051767 17258 ts_tablet_manager.cc:1916] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.052094 15248 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98baf6e8d8e84b42a83054495ae19e01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:34.052206 15248 raft_consensus.cc:3060] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:34.053030 15049 consensus_peers.cc:597] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff20cd7d33a440bab24bd4a61fff1f30. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:34.053054 15248 raft_consensus.cc:2468] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:34.053471 15049 leader_election.cc:304] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
W20251025 08:02:34.053620 15049 consensus_peers.cc:597] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5f72ca8cfb94178a21619ddc9fc0352. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:34.053834 17537 raft_consensus.cc:2804] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.053892 17537 raft_consensus.cc:697] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:34.053993 17537 consensus_queue.cc:237] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:34.054466 15223 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42704: Illegal state: replica f0f2f8ce3e9f4d9ba3f3f02813397c31 is not leader of this config: current role FOLLOWER
I20251025 08:02:34.056003 17258 ts_tablet_manager.cc:1929] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.056071 17258 log.cc:1199] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/a40c5721a4304345b471960ed1691930
I20251025 08:02:34.056645 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29476b0bf2f34dcb913a665e3a008519" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.056761 15110 raft_consensus.cc:2393] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:34.056787 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ddb3795876b486e992b58cea711afb3" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.056883 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29476b0bf2f34dcb913a665e3a008519" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:34.056977 15109 raft_consensus.cc:2393] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:34.057251 17258 ts_tablet_manager.cc:1950] T a40c5721a4304345b471960ed1691930 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.056891 15103 raft_consensus.cc:2468] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:34.057566 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ddb3795876b486e992b58cea711afb3" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:34.057647 15110 raft_consensus.cc:3060] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.058410 15110 raft_consensus.cc:2468] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:34.058636 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet a40c5721a4304345b471960ed1691930 (table default.Table_0d996ce6118b41598999853934f369f1 [id=82a8474566dd4ee99395f3220c214476]) successfully deleted
W20251025 08:02:34.058990 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet ff20cd7d33a440bab24bd4a61fff1f30 because the tablet was not found. No further retry: Not found: Tablet not found: ff20cd7d33a440bab24bd4a61fff1f30
W20251025 08:02:34.059350 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 5bf286568e8343b7921ac256a9313e63 because the tablet was not found. No further retry: Not found: Tablet not found: 5bf286568e8343b7921ac256a9313e63
W20251025 08:02:34.059700 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 4edf680e8d4a4b898fd6e64f8ec6f75d because the tablet was not found. No further retry: Not found: Tablet not found: 4edf680e8d4a4b898fd6e64f8ec6f75d
I20251025 08:02:34.059829 15048 leader_election.cc:304] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.059957 15642 raft_consensus.cc:2749] T e5e907ec8e7c420d8d6d68a954cc8beb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.060127 15048 leader_election.cc:304] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.060249 15642 raft_consensus.cc:2749] T c84d6bed24444dcfab1920efad849932 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:34.060252 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 6a3ec64b273d4e8c92b1e24061ac7336 because the tablet was not found. No further retry: Not found: Tablet not found: 6a3ec64b273d4e8c92b1e24061ac7336
W20251025 08:02:34.060444 15048 consensus_peers.cc:597] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e2b014e0f49c4f7da8e65b7d4c98ea63. This is attempt 1: this message will repeat every 5th retry.
W20251025 08:02:34.060537 15048 consensus_peers.cc:597] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f64072c416f4a77b1c81855d7db8f01. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:34.060631 15048 leader_election.cc:304] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.060740 15642 raft_consensus.cc:2749] T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:34.060954 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 23eedc2695db43afbd6f5dbebb0ea2be because the tablet was not found. No further retry: Not found: Tablet not found: 23eedc2695db43afbd6f5dbebb0ea2be
I20251025 08:02:34.061859 17198 rpcz_store.cc:276] 1025 08:02:32.359382 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.359424 (+ 42us) service_pool.cc:225] Handling call
1025 08:02:33.833963 (+1474539us) ts_tablet_manager.cc:1151] Deleting tablet d993e2350f37492bb712d145d03e8afb
1025 08:02:33.833968 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:33.835682 (+ 1714us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:33.983490 (+147808us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:33.984763 (+ 1273us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1474266}
I20251025 08:02:34.062050 17198 tablet_replica.cc:333] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.062230 17198 raft_consensus.cc:2243] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
W20251025 08:02:34.062294 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 17339d7c0a4b40a78b3252d17481c192 because the tablet was not found. No further retry: Not found: Tablet not found: 17339d7c0a4b40a78b3252d17481c192
I20251025 08:02:34.062335 17198 raft_consensus.cc:2272] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.062641 17198 ts_tablet_manager.cc:1916] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:34.062642 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 27d1e084fbdf43e2a1cc60fb6dfd194b because the tablet was not found. No further retry: Not found: Tablet not found: 27d1e084fbdf43e2a1cc60fb6dfd194b
W20251025 08:02:34.062985 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet ae3c8e134d164edd8781f27e7bdc3b92 because the tablet was not found. No further retry: Not found: Tablet not found: ae3c8e134d164edd8781f27e7bdc3b92
W20251025 08:02:34.063313 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 93d383e3e2f4493d9cc8a71a4284e107 because the tablet was not found. No further retry: Not found: Tablet not found: 93d383e3e2f4493d9cc8a71a4284e107
W20251025 08:02:34.063660 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 658a20d894c5444a820ce6bd33e4fdf0 because the tablet was not found. No further retry: Not found: Tablet not found: 658a20d894c5444a820ce6bd33e4fdf0
W20251025 08:02:34.064029 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 6cedb44483cf4f62acf52b90b6708dfb because the tablet was not found. No further retry: Not found: Tablet not found: 6cedb44483cf4f62acf52b90b6708dfb
I20251025 08:02:34.064239 17258 tablet_replica.cc:333] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.064568 17258 raft_consensus.cc:2243] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.064693 17198 ts_tablet_manager.cc:1929] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.064767 17198 log.cc:1199] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/73cdd9616b9c460f8fcd4a40e4a3ccc8
I20251025 08:02:34.064996 17198 ts_tablet_manager.cc:1950] T 73cdd9616b9c460f8fcd4a40e4a3ccc8 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.065096 17258 raft_consensus.cc:2272] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.065366 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 67) took 1688 ms. Trace:
I20251025 08:02:34.065421 17198 rpcz_store.cc:276] 1025 08:02:32.376736 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.381356 (+ 4620us) service_pool.cc:225] Handling call
1025 08:02:34.062027 (+1680671us) ts_tablet_manager.cc:1151] Deleting tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8
1025 08:02:34.062033 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.063702 (+ 1669us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.064651 (+ 949us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.065353 (+ 702us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1680564}
I20251025 08:02:34.065580 17198 tablet_replica.cc:333] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.065682 17198 raft_consensus.cc:2243] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.065753 17258 ts_tablet_manager.cc:1916] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.065763 17198 raft_consensus.cc:2272] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.067472 17258 ts_tablet_manager.cc:1929] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.070542 16288 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_06d9fbe4ef5e4a59b12abb65af8ce2a0" } modify_external_catalogs: true
I20251025 08:02:34.070636 16288 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_06d9fbe4ef5e4a59b12abb65af8ce2a0" } modify_external_catalogs: true
I20251025 08:02:34.070680 17274 tablet_bootstrap.cc:492] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.070755 17274 ts_tablet_manager.cc:1403] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.001s
I20251025 08:02:34.071149 17274 raft_consensus.cc:359] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.071229 17274 raft_consensus.cc:385] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.071259 17274 raft_consensus.cc:740] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.071357 17274 consensus_queue.cc:260] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.071602 17274 ts_tablet_manager.cc:1434] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20251025 08:02:34.071753 17274 tablet_bootstrap.cc:492] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.072649 17274 tablet_bootstrap.cc:654] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.072623 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_55080d399c634dd5a1e0c536a7d09394"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.073539 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_55080d399c634dd5a1e0c536a7d09394 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:34.073832 16280 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c86ceda5c2c4583b9ff388e82b5369f consensus state has no leader
I20251025 08:02:34.074002 16280 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_c13a8bad402148f19fcdc19766286842" } modify_external_catalogs: true
I20251025 08:02:34.074086 17258 log.cc:1199] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/98baf6e8d8e84b42a83054495ae19e01
I20251025 08:02:34.074080 16280 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_c13a8bad402148f19fcdc19766286842" } modify_external_catalogs: true
I20251025 08:02:34.074400 17258 ts_tablet_manager.cc:1950] T 98baf6e8d8e84b42a83054495ae19e01 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.074954 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 98baf6e8d8e84b42a83054495ae19e01 (table default.Table_e7ff1f77ca4f48b2afa289c6672bcafd [id=a63322e79f4d47599afcfe64edd3a86c]) successfully deleted
W20251025 08:02:34.075366 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet f814b8ab1c9747e4b7da69f0ef4f2eb4 because the tablet was not found. No further retry: Not found: Tablet not found: f814b8ab1c9747e4b7da69f0ef4f2eb4
W20251025 08:02:34.075793 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 7e90c358ef454760b8317d78724ee377 because the tablet was not found. No further retry: Not found: Tablet not found: 7e90c358ef454760b8317d78724ee377
W20251025 08:02:34.076112 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 because the tablet was not found. No further retry: Not found: Tablet not found: a2b8efa8ed634583b7bf7cc91bfc61a3
W20251025 08:02:34.076462 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 6dd0f695a2904df5b750b45782a21ce2 because the tablet was not found. No further retry: Not found: Tablet not found: 6dd0f695a2904df5b750b45782a21ce2
W20251025 08:02:34.076752 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet e106f20977444dd4a49b6e4ae0f45380 because the tablet was not found. No further retry: Not found: Tablet not found: e106f20977444dd4a49b6e4ae0f45380
W20251025 08:02:34.077215 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet a3379087113041beba7ddbc6596c3b0a because the tablet was not found. No further retry: Not found: Tablet not found: a3379087113041beba7ddbc6596c3b0a
I20251025 08:02:34.077597 17198 ts_tablet_manager.cc:1916] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.079584 17198 ts_tablet_manager.cc:1929] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.079680 17198 log.cc:1199] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/a40c5721a4304345b471960ed1691930
I20251025 08:02:34.079895 17198 ts_tablet_manager.cc:1950] T a40c5721a4304345b471960ed1691930 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.080351 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 68) took 1688 ms. Trace:
I20251025 08:02:34.083253 17198 rpcz_store.cc:276] 1025 08:02:32.392152 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.392190 (+ 38us) service_pool.cc:225] Handling call
1025 08:02:34.065561 (+1673371us) ts_tablet_manager.cc:1151] Deleting tablet a40c5721a4304345b471960ed1691930
1025 08:02:34.065566 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.078499 (+ 12933us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.079527 (+ 1028us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.080340 (+ 813us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1673237}
I20251025 08:02:34.083459 17198 tablet_replica.cc:333] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.083603 17198 raft_consensus.cc:2243] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.083773 17198 raft_consensus.cc:2272] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.084293 17198 ts_tablet_manager.cc:1916] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.085901 17198 ts_tablet_manager.cc:1929] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.085983 17198 log.cc:1199] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/c043ab70d7364e05b0b352ac5c416db1
I20251025 08:02:34.086256 17198 ts_tablet_manager.cc:1950] T c043ab70d7364e05b0b352ac5c416db1 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.088112 16390 tablet_bootstrap.cc:492] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.088182 16390 ts_tablet_manager.cc:1403] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.121s user 0.002s sys 0.000s
I20251025 08:02:34.088527 16390 raft_consensus.cc:359] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.088603 16390 raft_consensus.cc:385] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.088629 16390 raft_consensus.cc:740] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.088725 16390 consensus_queue.cc:260] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.088950 16390 ts_tablet_manager.cc:1434] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.089905 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 69) took 1655 ms. Trace:
I20251025 08:02:34.090055 17198 rpcz_store.cc:276] 1025 08:02:32.434637 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.434686 (+ 49us) service_pool.cc:225] Handling call
1025 08:02:34.083439 (+1648753us) ts_tablet_manager.cc:1151] Deleting tablet c043ab70d7364e05b0b352ac5c416db1
1025 08:02:34.083444 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.085128 (+ 1684us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.085861 (+ 733us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.089894 (+ 4033us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1648643}
I20251025 08:02:34.090310 17198 tablet_replica.cc:333] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.090454 17198 raft_consensus.cc:2243] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.090582 17198 raft_consensus.cc:2272] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.090885 17198 ts_tablet_manager.cc:1916] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.092578 17198 ts_tablet_manager.cc:1929] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.092664 17198 log.cc:1199] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/6d1979a4f43a4659976b0cd6d1b888ef
I20251025 08:02:34.092916 17198 ts_tablet_manager.cc:1950] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.093142 16279 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet f102eb1c22004790839b6563bd830786
I20251025 08:02:34.093446 16279 master_service.cc:954] ReplaceTablet: received request to replace tablet be8d6685c70c4219947df30f023a59b8 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.093513 16288 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 5022f9beb59449828f59dca9d14caa50
I20251025 08:02:34.093731 16279 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_3678577821c441b1bac4f3d9617e4d43" } new_table_name: "default.Table_2e193299ce924a3cabcf0d49731b632c" modify_external_catalogs: true
I20251025 08:02:34.093796 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_221f5dc73cd04df6bab5ce24f8f01509"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.094095 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_221f5dc73cd04df6bab5ce24f8f01509 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.094570 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet f102eb1c22004790839b6563bd830786 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.094846 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet f102eb1c22004790839b6563bd830786 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.094870 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 5022f9beb59449828f59dca9d14caa50 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.094980 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet 5022f9beb59449828f59dca9d14caa50 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.095160 17194 tablet_replica.cc:333] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.095290 17194 raft_consensus.cc:2243] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.093442 16284 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_691eab0585894686af636d8eebd4842a" } modify_external_catalogs: true
I20251025 08:02:34.095345 16284 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_691eab0585894686af636d8eebd4842a" } modify_external_catalogs: true
I20251025 08:02:34.095387 17194 raft_consensus.cc:2272] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.095742 17194 ts_tablet_manager.cc:1916] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.097780 17194 ts_tablet_manager.cc:1929] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:34.097848 17194 log.cc:1199] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/5022f9beb59449828f59dca9d14caa50
I20251025 08:02:34.098111 17194 ts_tablet_manager.cc:1950] T 5022f9beb59449828f59dca9d14caa50 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
W20251025 08:02:34.098824 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet f102eb1c22004790839b6563bd830786 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f102eb1c22004790839b6563bd830786 already in progress: creating tablet
I20251025 08:02:34.098965 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 5022f9beb59449828f59dca9d14caa50 (table default.Table_06d9fbe4ef5e4a59b12abb65af8ce2a0 [id=ce6a220ddfc540dbb17e28bc74b66449]) successfully deleted
I20251025 08:02:34.099370 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 70) took 1664 ms. Trace:
I20251025 08:02:34.099448 17198 rpcz_store.cc:276] 1025 08:02:32.434700 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.434816 (+ 116us) service_pool.cc:225] Handling call
1025 08:02:34.090282 (+1655466us) ts_tablet_manager.cc:1151] Deleting tablet 6d1979a4f43a4659976b0cd6d1b888ef
1025 08:02:34.090289 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.091769 (+ 1480us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.092537 (+ 768us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.099359 (+ 6822us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1655392}
I20251025 08:02:34.099668 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 71) took 1619 ms. Trace:
I20251025 08:02:34.099752 17198 rpcz_store.cc:276] 1025 08:02:32.479969 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.480062 (+ 93us) service_pool.cc:225] Handling call
1025 08:02:34.099605 (+1619543us) ts_tablet_manager.cc:1151] Deleting tablet a40c5721a4304345b471960ed1691930
1025 08:02:34.099611 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.099660 (+ 49us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1619430}
I20251025 08:02:34.099934 17198 tablet_replica.cc:333] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.100056 17198 raft_consensus.cc:2243] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.100162 17198 raft_consensus.cc:2272] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.100473 17198 ts_tablet_manager.cc:1916] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.102756 16284 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet 8e5310ad10fd4415878113647cebafcc
I20251025 08:02:34.102880 16284 master_service.cc:954] ReplaceTablet: received request to replace tablet 2be36d176bf34fb6bd3c70b42af15cc9 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.102892 16280 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 7f5c6a17507d4a5a8057a725d3299ab9
I20251025 08:02:34.103189 16280 master_service.cc:954] ReplaceTablet: received request to replace tablet fc5f892ca7a246a28a556fe0eb3f5442 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.103453 16280 master_service.cc:954] ReplaceTablet: received request to replace tablet b826067888164df0af7da797d42c0862 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.103938 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_1dba1493ac4b4bafbda82f9414100598"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:34.104004 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 7f5c6a17507d4a5a8057a725d3299ab9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.104147 17194 tablet_replica.cc:333] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
W20251025 08:02:34.104234 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1dba1493ac4b4bafbda82f9414100598 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.104276 17194 raft_consensus.cc:2243] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.104375 17194 raft_consensus.cc:2272] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.104652 17194 ts_tablet_manager.cc:1916] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.105343 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_004fcaf501c44ba08c169547dd5bb0ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.105629 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_004fcaf501c44ba08c169547dd5bb0ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.106410 17194 ts_tablet_manager.cc:1929] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.106470 17194 log.cc:1199] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/7f5c6a17507d4a5a8057a725d3299ab9
I20251025 08:02:34.106722 17194 ts_tablet_manager.cc:1950] T 7f5c6a17507d4a5a8057a725d3299ab9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.107298 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet 7f5c6a17507d4a5a8057a725d3299ab9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.107486 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 7f5c6a17507d4a5a8057a725d3299ab9 (table default.Table_c13a8bad402148f19fcdc19766286842 [id=b5be4f412cc04aa59c819d0e1cc403bf]) successfully deleted
I20251025 08:02:34.107615 17415 raft_consensus.cc:493] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.107697 17415 raft_consensus.cc:515] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.108027 17415 leader_election.cc:290] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.108289 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88a76d187fae4f09ac879b72e9c05a86" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.108444 15249 raft_consensus.cc:2393] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate e51a2be794f04642b89386067ecbc77e in this term.
I20251025 08:02:34.108506 17198 ts_tablet_manager.cc:1929] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:34.108589 17198 log.cc:1199] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/997c8c5921ad4ec18914fd50c97fc33e
I20251025 08:02:34.108842 17198 ts_tablet_manager.cc:1950] T 997c8c5921ad4ec18914fd50c97fc33e P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.110667 16391 tablet_bootstrap.cc:492] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.110731 16391 ts_tablet_manager.cc:1403] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.115s user 0.001s sys 0.000s
I20251025 08:02:34.111070 16391 raft_consensus.cc:359] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.111151 16391 raft_consensus.cc:385] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.111173 16391 raft_consensus.cc:740] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.111258 16391 consensus_queue.cc:260] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.111450 16391 ts_tablet_manager.cc:1434] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:34.111572 16391 tablet_bootstrap.cc:492] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.112254 16391 tablet_bootstrap.cc:654] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.114372 16280 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet b826067888164df0af7da797d42c0862
I20251025 08:02:34.114459 16282 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet d05bf0056dfc43eeb4105af559497bdc
I20251025 08:02:34.114580 16280 catalog_manager.cc:6719] ReplaceTablet: tablet b826067888164df0af7da797d42c0862 deleted and replaced by tablet bb517f3c7dc545f089eff1fcb4acbce9
I20251025 08:02:34.114647 16282 catalog_manager.cc:6719] ReplaceTablet: tablet d05bf0056dfc43eeb4105af559497bdc deleted and replaced by tablet 6e08efb3c79041ae97ae37e289ccc8f4
I20251025 08:02:34.114715 16280 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_c106c0d4d9c74a81924952f3e165d6e5" } new_table_name: "default.Table_77181e171c394669b503a8906896b196" modify_external_catalogs: true
I20251025 08:02:34.115401 16285 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 2be36d176bf34fb6bd3c70b42af15cc9 (table default.Table_65442dc666594e129611ee817db7b2c0 [id=de277558d55a46519b3c1e18c51f18fb]). Expected version 1 got 0
I20251025 08:02:34.115504 16285 catalog_manager.cc:5649] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:34.115658 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet b826067888164df0af7da797d42c0862 with delete_type TABLET_DATA_DELETED (replaced by tablet bb517f3c7dc545f089eff1fcb4acbce9) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.115876 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet b826067888164df0af7da797d42c0862 with delete_type TABLET_DATA_DELETED (replaced by tablet bb517f3c7dc545f089eff1fcb4acbce9) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.115828 16285 catalog_manager.cc:5649] T 07b76abb029e4555851dfdc73ab31a38 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:34.115938 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet d05bf0056dfc43eeb4105af559497bdc with delete_type TABLET_DATA_DELETED (replaced by tablet 6e08efb3c79041ae97ae37e289ccc8f4) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.115979 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet d05bf0056dfc43eeb4105af559497bdc with delete_type TABLET_DATA_DELETED (replaced by tablet 6e08efb3c79041ae97ae37e289ccc8f4) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.116079 16285 catalog_manager.cc:5649] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
W20251025 08:02:34.116191 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet b826067888164df0af7da797d42c0862 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b826067888164df0af7da797d42c0862 already in progress: creating tablet
I20251025 08:02:34.116264 16285 catalog_manager.cc:5649] T f3f42babc0b2421fa80b265997effe36 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:34.116358 17194 tablet_replica.cc:333] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.116459 17194 raft_consensus.cc:2243] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.116541 17194 raft_consensus.cc:2272] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.116632 16285 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet ed2036a8ebd74ab18c0bbd6d9aa67ef0 (table default.Table_e7e4f555b1d140ef907741daae26ce2b [id=a8e0504bc08744b4915157fa63d2226e]). Expected version 1 got 0
I20251025 08:02:34.116770 16285 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 88a76d187fae4f09ac879b72e9c05a86 (table default.Table_8d621c2f449e477ab01d1b67dc869408 [id=d318bca8bf144870aa5529426cfa9995]). Expected version 1 got 0
I20251025 08:02:34.116954 17194 ts_tablet_manager.cc:1916] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.117130 16285 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet d049bf946c744664aba74d7a12fa4ff1 (table default.Table_36b5cc8d55f84063a624820d55f1aac8 [id=33bbe4605d924011b9002a939a73203d]). Expected version 1 got 0
I20251025 08:02:34.117208 16285 catalog_manager.cc:5649] T 82b93b7537c047aea430658ae2c2654b P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } }
I20251025 08:02:34.118876 17194 ts_tablet_manager.cc:1929] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.118966 17194 log.cc:1199] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/d05bf0056dfc43eeb4105af559497bdc
I20251025 08:02:34.119231 17194 ts_tablet_manager.cc:1950] T d05bf0056dfc43eeb4105af559497bdc P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.119661 17415 consensus_queue.cc:1048] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.120075 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet d05bf0056dfc43eeb4105af559497bdc (table default.Table_3678577821c441b1bac4f3d9617e4d43 [id=72243e33e90940c09953a9ec2fcfd435]) successfully deleted
I20251025 08:02:34.120440 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 73) took 1639 ms. Trace:
I20251025 08:02:34.120517 17198 rpcz_store.cc:276] 1025 08:02:32.480520 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.481821 (+ 1301us) service_pool.cc:225] Handling call
1025 08:02:34.099913 (+1618092us) ts_tablet_manager.cc:1151] Deleting tablet 997c8c5921ad4ec18914fd50c97fc33e
1025 08:02:34.099919 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.101308 (+ 1389us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.108435 (+ 7127us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.120427 (+ 11992us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1618005}
I20251025 08:02:34.120699 17198 tablet_replica.cc:333] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.120826 17198 raft_consensus.cc:2243] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.120918 17198 raft_consensus.cc:2272] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.121317 17198 ts_tablet_manager.cc:1916] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.122483 16391 tablet_bootstrap.cc:492] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.122555 16391 ts_tablet_manager.cc:1403] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.000s
I20251025 08:02:34.122920 16391 raft_consensus.cc:359] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.123031 16391 raft_consensus.cc:385] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.123062 16391 raft_consensus.cc:740] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.123091 17198 ts_tablet_manager.cc:1929] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.123140 17198 log.cc:1199] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/6c582efa6d334a06a48e2f2b94167776
I20251025 08:02:34.123152 16391 consensus_queue.cc:260] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.123383 17198 ts_tablet_manager.cc:1950] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.123643 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 77) took 1568 ms. Trace:
I20251025 08:02:34.123718 17198 rpcz_store.cc:276] 1025 08:02:32.555655 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.555845 (+ 190us) service_pool.cc:225] Handling call
1025 08:02:34.120676 (+1564831us) ts_tablet_manager.cc:1151] Deleting tablet 6c582efa6d334a06a48e2f2b94167776
1025 08:02:34.120682 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.122267 (+ 1585us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.123045 (+ 778us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.123634 (+ 589us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1564718}
I20251025 08:02:34.123908 17198 tablet_replica.cc:333] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.124037 16391 ts_tablet_manager.cc:1434] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.124037 17198 raft_consensus.cc:2243] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.124174 17198 raft_consensus.cc:2272] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.124213 16391 tablet_bootstrap.cc:492] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.124519 17198 ts_tablet_manager.cc:1916] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:34.125120 16280 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8809e6f0e56c4424a03ecb391885ca87 has no consensus state
I20251025 08:02:34.125624 16391 tablet_bootstrap.cc:654] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.126282 17198 ts_tablet_manager.cc:1929] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.126380 17198 log.cc:1199] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/fc5f892ca7a246a28a556fe0eb3f5442
I20251025 08:02:34.126632 17198 ts_tablet_manager.cc:1950] T fc5f892ca7a246a28a556fe0eb3f5442 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.127027 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 94) took 1395 ms. Trace:
I20251025 08:02:34.129175 17198 rpcz_store.cc:276] 1025 08:02:32.731617 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.731841 (+ 224us) service_pool.cc:225] Handling call
1025 08:02:34.123886 (+1392045us) ts_tablet_manager.cc:1151] Deleting tablet fc5f892ca7a246a28a556fe0eb3f5442
1025 08:02:34.123892 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.125392 (+ 1500us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.126242 (+ 850us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.127017 (+ 775us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1391942}
I20251025 08:02:34.129400 17198 tablet_replica.cc:333] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.129515 17198 raft_consensus.cc:2243] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.129635 17198 pending_rounds.cc:70] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:34.129686 17198 pending_rounds.cc:77] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609834206961664 op_type: NO_OP noop_request { }
I20251025 08:02:34.129761 17198 raft_consensus.cc:2889] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:34.129820 17198 raft_consensus.cc:2272] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.132578 17198 ts_tablet_manager.cc:1916] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.134068 17198 ts_tablet_manager.cc:1929] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.134151 17198 log.cc:1199] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/98baf6e8d8e84b42a83054495ae19e01
I20251025 08:02:34.134472 17198 ts_tablet_manager.cc:1950] T 98baf6e8d8e84b42a83054495ae19e01 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
W20251025 08:02:34.134727 15048 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.70.1:35401, user_credentials={real_user=slave}} blocked reactor thread for 74097.2us
W20251025 08:02:34.135130 15048 consensus_peers.cc:597] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8362e26d86d44e9780d3c78c6a468556. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:34.135525 15642 consensus_queue.cc:1048] T f3f42babc0b2421fa80b265997effe36 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.135772 15642 consensus_queue.cc:1048] T 82b93b7537c047aea430658ae2c2654b P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.134773 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 96) took 1403 ms. Trace:
I20251025 08:02:34.136289 17198 rpcz_store.cc:276] 1025 08:02:32.731732 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.732165 (+ 433us) service_pool.cc:225] Handling call
1025 08:02:34.129379 (+1397214us) ts_tablet_manager.cc:1151] Deleting tablet 98baf6e8d8e84b42a83054495ae19e01
1025 08:02:34.129384 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.133335 (+ 3951us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.134029 (+ 694us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.134764 (+ 735us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1397114}
I20251025 08:02:34.136487 17198 tablet_replica.cc:333] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.136618 17198 raft_consensus.cc:2243] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.136727 17198 raft_consensus.cc:2272] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.137002 17198 ts_tablet_manager.cc:1916] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:34.137511 15048 consensus_peers.cc:597] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8576553f17b49f8bd11436ecac471ed. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:34.137724 15048 leader_election.cc:304] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.137866 17534 raft_consensus.cc:2749] T 29476b0bf2f34dcb913a665e3a008519 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20251025 08:02:34.138121 15048 leader_election.cc:343] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.144583 16390 tablet_bootstrap.cc:492] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.144635 17258 tablet_replica.cc:333] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.144745 17258 raft_consensus.cc:2243] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.144876 17258 raft_consensus.cc:2272] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.145223 17258 ts_tablet_manager.cc:1916] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.145396 16280 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_a360cd87c12742a694649f84110e33bf"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:34.145579 16390 tablet_bootstrap.cc:654] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:34.145674 16280 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a360cd87c12742a694649f84110e33bf in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.147332 17258 ts_tablet_manager.cc:1929] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:34.147388 17258 log.cc:1199] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/5022f9beb59449828f59dca9d14caa50
I20251025 08:02:34.147425 17591 tablet.cc:1722] T e66c7b43490a4391a59e09f1832a53b3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.147624 17258 ts_tablet_manager.cc:1950] T 5022f9beb59449828f59dca9d14caa50 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.148092 17258 tablet_replica.cc:333] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.148234 17258 raft_consensus.cc:2243] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.148402 17258 raft_consensus.cc:2272] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.148707 17258 ts_tablet_manager.cc:1916] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:34.150537 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet f102eb1c22004790839b6563bd830786 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f102eb1c22004790839b6563bd830786 already in progress: creating tablet
I20251025 08:02:34.150665 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 5022f9beb59449828f59dca9d14caa50 (table default.Table_06d9fbe4ef5e4a59b12abb65af8ce2a0 [id=ce6a220ddfc540dbb17e28bc74b66449]) successfully deleted
I20251025 08:02:34.151232 17258 ts_tablet_manager.cc:1929] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.151314 17258 log.cc:1199] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/7f5c6a17507d4a5a8057a725d3299ab9
I20251025 08:02:34.151489 15027 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:34.151612 17258 ts_tablet_manager.cc:1950] T 7f5c6a17507d4a5a8057a725d3299ab9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:34.151798 15048 leader_election.cc:343] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.152159 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 7f5c6a17507d4a5a8057a725d3299ab9 (table default.Table_c13a8bad402148f19fcdc19766286842 [id=b5be4f412cc04aa59c819d0e1cc403bf]) successfully deleted
W20251025 08:02:34.152634 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet b826067888164df0af7da797d42c0862 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b826067888164df0af7da797d42c0862 already in progress: creating tablet
I20251025 08:02:34.152832 17258 tablet_replica.cc:333] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.152961 17258 raft_consensus.cc:2243] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.153061 17258 raft_consensus.cc:2272] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.153558 17258 ts_tablet_manager.cc:1916] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.143838 17274 tablet_bootstrap.cc:492] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.154917 17274 ts_tablet_manager.cc:1403] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.083s user 0.001s sys 0.000s
I20251025 08:02:34.143992 17534 consensus_queue.cc:1048] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.144510 17566 tablet.cc:1722] T e66c7b43490a4391a59e09f1832a53b3 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.138792 17198 ts_tablet_manager.cc:1929] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.155198 17198 log.cc:1199] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/658a20d894c5444a820ce6bd33e4fdf0
I20251025 08:02:34.155428 17198 ts_tablet_manager.cc:1950] T 658a20d894c5444a820ce6bd33e4fdf0 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.155608 17274 raft_consensus.cc:359] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.155692 17274 raft_consensus.cc:385] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.155721 17274 raft_consensus.cc:740] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.155817 17274 consensus_queue.cc:260] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.155865 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 91) took 1424 ms. Trace:
I20251025 08:02:34.155939 17198 rpcz_store.cc:276] 1025 08:02:32.731450 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.733389 (+ 1939us) service_pool.cc:225] Handling call
1025 08:02:34.136466 (+1403077us) ts_tablet_manager.cc:1151] Deleting tablet 658a20d894c5444a820ce6bd33e4fdf0
1025 08:02:34.136472 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.137941 (+ 1469us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.138750 (+ 809us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.155855 (+ 17105us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22,"tablet-delete.queue_time_us":1402975}
I20251025 08:02:34.156087 17274 ts_tablet_manager.cc:1434] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.156124 17198 tablet_replica.cc:333] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.156229 17274 tablet_bootstrap.cc:492] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.157076 17274 tablet_bootstrap.cc:654] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:34.157758 15048 leader_election.cc:343] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 6d1979a4f43a4659976b0cd6d1b888ef
I20251025 08:02:34.157982 17258 ts_tablet_manager.cc:1929] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.158082 17258 log.cc:1199] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/d05bf0056dfc43eeb4105af559497bdc
I20251025 08:02:34.158259 16391 tablet_bootstrap.cc:492] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.158340 16391 ts_tablet_manager.cc:1403] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
I20251025 08:02:34.158370 17258 ts_tablet_manager.cc:1950] T d05bf0056dfc43eeb4105af559497bdc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.159025 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet d05bf0056dfc43eeb4105af559497bdc (table default.Table_3678577821c441b1bac4f3d9617e4d43 [id=72243e33e90940c09953a9ec2fcfd435]) successfully deleted
I20251025 08:02:34.159484 16391 raft_consensus.cc:359] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.160385 16391 raft_consensus.cc:385] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.160452 16391 raft_consensus.cc:740] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.160570 16391 consensus_queue.cc:260] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.162022 16391 ts_tablet_manager.cc:1434] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20251025 08:02:34.162199 16391 tablet_bootstrap.cc:492] T cfe93efc1a0c4dda95b5c2e58cdcec82 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.163169 16391 tablet_bootstrap.cc:654] T cfe93efc1a0c4dda95b5c2e58cdcec82 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.163188 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_00a996a12a5947f0968c86f66bcebc23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.164022 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_00a996a12a5947f0968c86f66bcebc23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:34.159541 15049 consensus_peers.cc:597] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e2b014e0f49c4f7da8e65b7d4c98ea63. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:34.161876 17537 raft_consensus.cc:493] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.163807 17198 raft_consensus.cc:2243] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.169077 17537 raft_consensus.cc:515] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.169163 17198 raft_consensus.cc:2272] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.169390 17537 leader_election.cc:290] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.169456 17198 ts_tablet_manager.cc:1916] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.170054 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dc32b27b3f743bf8719e39ea8c20e34" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:34.170361 15049 leader_election.cc:343] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.171448 17198 ts_tablet_manager.cc:1929] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.171510 17198 log.cc:1199] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/bfdc6022cc5747439edcb8aa865b9437
I20251025 08:02:34.171733 17198 ts_tablet_manager.cc:1950] T bfdc6022cc5747439edcb8aa865b9437 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.172091 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 95) took 1440 ms. Trace:
I20251025 08:02:34.172133 17198 rpcz_store.cc:276] 1025 08:02:32.731665 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.733677 (+ 2012us) service_pool.cc:225] Handling call
1025 08:02:34.156100 (+1422423us) ts_tablet_manager.cc:1151] Deleting tablet bfdc6022cc5747439edcb8aa865b9437
1025 08:02:34.156108 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.170545 (+ 14437us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.171407 (+ 862us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.172080 (+ 673us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7571,"tablet-delete.queue_time_us":1422343}
I20251025 08:02:34.172289 17198 tablet_replica.cc:333] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.172379 17198 raft_consensus.cc:2243] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.172456 17198 raft_consensus.cc:2272] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.172554 15048 leader_election.cc:304] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.172605 16390 tablet_bootstrap.cc:492] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
W20251025 08:02:34.172628 15048 raft_consensus.cc:2686] T 6d1979a4f43a4659976b0cd6d1b888ef P e51a2be794f04642b89386067ecbc77e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251025 08:02:34.172665 16390 ts_tablet_manager.cc:1403] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.000s
I20251025 08:02:34.172731 17198 ts_tablet_manager.cc:1916] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:34.172948 15048 consensus_peers.cc:597] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b6ae6527fd64c3bb5999dec97db861d. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:34.173007 16390 raft_consensus.cc:359] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.173082 16390 raft_consensus.cc:385] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.173105 16390 raft_consensus.cc:740] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.173189 16390 consensus_queue.cc:260] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.173399 16390 ts_tablet_manager.cc:1434] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.173518 16390 tablet_bootstrap.cc:492] T 3cac2ac7463944549b5d235ed2e5a480 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
W20251025 08:02:34.173852 15048 leader_election.cc:343] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:34.173996 15048 leader_election.cc:343] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:34.174109 15048 leader_election.cc:343] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.174149 15048 leader_election.cc:304] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.174274 15642 raft_consensus.cc:2749] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:34.174449 15048 leader_election.cc:343] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.174551 15048 leader_election.cc:304] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.174628 17198 ts_tablet_manager.cc:1929] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.174661 15642 raft_consensus.cc:2749] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.174696 17198 log.cc:1199] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/27d1e084fbdf43e2a1cc60fb6dfd194b
W20251025 08:02:34.174846 15048 leader_election.cc:343] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 16f1ab00a20345a1bb51e685b3fc6c70
I20251025 08:02:34.174907 15048 leader_election.cc:304] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.175004 17198 ts_tablet_manager.cc:1950] T 27d1e084fbdf43e2a1cc60fb6dfd194b P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.175041 15642 raft_consensus.cc:2749] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.175407 16390 tablet_bootstrap.cc:654] T 3cac2ac7463944549b5d235ed2e5a480 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.175405 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 97) took 1443 ms. Trace:
I20251025 08:02:34.175457 17198 rpcz_store.cc:276] 1025 08:02:32.731780 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.733775 (+ 1995us) service_pool.cc:225] Handling call
1025 08:02:34.172269 (+1438494us) ts_tablet_manager.cc:1151] Deleting tablet 27d1e084fbdf43e2a1cc60fb6dfd194b
1025 08:02:34.172274 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.173538 (+ 1264us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.174570 (+ 1032us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.175395 (+ 825us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1438431}
I20251025 08:02:34.175611 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 107) took 1348 ms. Trace:
I20251025 08:02:34.175647 17198 rpcz_store.cc:276] 1025 08:02:32.827582 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.827620 (+ 38us) service_pool.cc:225] Handling call
1025 08:02:34.175572 (+1347952us) ts_tablet_manager.cc:1151] Deleting tablet 212ccfb58f964d7bae31e5af110b4079
1025 08:02:34.175577 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.175606 (+ 29us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1347814}
I20251025 08:02:34.175768 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 108) took 1348 ms. Trace:
I20251025 08:02:34.175805 17198 rpcz_store.cc:276] 1025 08:02:32.827621 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.827654 (+ 33us) service_pool.cc:225] Handling call
1025 08:02:34.175732 (+1348078us) ts_tablet_manager.cc:1151] Deleting tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c
1025 08:02:34.175736 (+ 4us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.175761 (+ 25us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1347858}
I20251025 08:02:34.175911 17198 tablet_replica.cc:333] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.175995 17198 raft_consensus.cc:2243] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.176065 17198 raft_consensus.cc:2272] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.176363 17198 ts_tablet_manager.cc:1916] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.178655 17198 ts_tablet_manager.cc:1929] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.178758 17198 log.cc:1199] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/23eedc2695db43afbd6f5dbebb0ea2be
I20251025 08:02:34.179034 17198 ts_tablet_manager.cc:1950] T 23eedc2695db43afbd6f5dbebb0ea2be P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.179936 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 101) took 1352 ms. Trace:
I20251025 08:02:34.180308 17198 rpcz_store.cc:276] 1025 08:02:32.827351 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.827923 (+ 572us) service_pool.cc:225] Handling call
1025 08:02:34.175894 (+1347971us) ts_tablet_manager.cc:1151] Deleting tablet 23eedc2695db43afbd6f5dbebb0ea2be
1025 08:02:34.175899 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.177760 (+ 1861us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.178611 (+ 851us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.179925 (+ 1314us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1347876}
I20251025 08:02:34.182309 17198 tablet_replica.cc:333] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.182458 17198 raft_consensus.cc:2243] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.182618 17198 raft_consensus.cc:2272] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.182677 17415 consensus_queue.cc:1048] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.183002 17198 ts_tablet_manager.cc:1916] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.188771 16284 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 2be36d176bf34fb6bd3c70b42af15cc9
I20251025 08:02:34.189002 16284 catalog_manager.cc:6719] ReplaceTablet: tablet 2be36d176bf34fb6bd3c70b42af15cc9 deleted and replaced by tablet 140cc7a1ea2149adaacb2d254f84deea
I20251025 08:02:34.189656 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 2be36d176bf34fb6bd3c70b42af15cc9 with delete_type TABLET_DATA_DELETED (replaced by tablet 140cc7a1ea2149adaacb2d254f84deea) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.189673 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 2be36d176bf34fb6bd3c70b42af15cc9 with delete_type TABLET_DATA_DELETED (replaced by tablet 140cc7a1ea2149adaacb2d254f84deea) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.189889 17194 tablet_replica.cc:333] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.190070 17194 raft_consensus.cc:2243] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.190284 17258 tablet_replica.cc:333] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.190443 17258 raft_consensus.cc:2243] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.190541 17258 raft_consensus.cc:2272] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.190804 17372 raft_consensus.cc:493] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.190874 17372 raft_consensus.cc:515] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.190925 17258 ts_tablet_manager.cc:1916] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.191203 17372 leader_election.cc:290] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.191429 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a6f2b64c994f3abefef9724911a5fc" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.191780 16283 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 88a76d187fae4f09ac879b72e9c05a86 (table default.Table_8d621c2f449e477ab01d1b67dc869408 [id=d318bca8bf144870aa5529426cfa9995]). Expected version 1 got 0
I20251025 08:02:34.192080 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a6f2b64c994f3abefef9724911a5fc" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.192183 15105 raft_consensus.cc:2468] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:34.192297 16283 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet d049bf946c744664aba74d7a12fa4ff1 (table default.Table_36b5cc8d55f84063a624820d55f1aac8 [id=33bbe4605d924011b9002a939a73203d]). Expected version 1 got 0
I20251025 08:02:34.192392 16283 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet fc62afd62257471e8590d28e49a50cb2 (table default.Table_8527e07298754b1ab5eefd758ff1fe70 [id=f317f6ac536c45beb5e90ab9bd55ebe7]). Expected version 2 got 0
I20251025 08:02:34.192574 15185 leader_election.cc:304] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.192580 16283 catalog_manager.cc:5649] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:34.192696 17372 raft_consensus.cc:2804] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.192737 17372 raft_consensus.cc:493] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.192781 17372 raft_consensus.cc:3060] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:34.192849 15183 leader_election.cc:343] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.192966 17258 ts_tablet_manager.cc:1929] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.192967 16283 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet ed2036a8ebd74ab18c0bbd6d9aa67ef0 (table default.Table_e7e4f555b1d140ef907741daae26ce2b [id=a8e0504bc08744b4915157fa63d2226e]). Expected version 1 got 0
I20251025 08:02:34.193025 17258 log.cc:1199] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/2be36d176bf34fb6bd3c70b42af15cc9
I20251025 08:02:34.193161 16283 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 2a4b060efd054726b07702b691876147 (table default.Table_5f2746d8cc7341d9a30870387f129fa2 [id=846c344408284b8e8a0e5da1d328255d]). Expected version 1 got 0
I20251025 08:02:34.193248 17258 ts_tablet_manager.cc:1950] T 2be36d176bf34fb6bd3c70b42af15cc9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.193713 17372 raft_consensus.cc:515] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.194046 17372 leader_election.cc:290] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.194365 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 2be36d176bf34fb6bd3c70b42af15cc9 (table default.Table_65442dc666594e129611ee817db7b2c0 [id=de277558d55a46519b3c1e18c51f18fb]) successfully deleted
I20251025 08:02:34.194465 17194 raft_consensus.cc:2272] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.194787 17198 ts_tablet_manager.cc:1929] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.194818 16287 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet b4a6f2b64c994f3abefef9724911a5fc
I20251025 08:02:34.194903 17198 log.cc:1199] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/ff20cd7d33a440bab24bd4a61fff1f30
I20251025 08:02:34.195151 17198 ts_tablet_manager.cc:1950] T ff20cd7d33a440bab24bd4a61fff1f30 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.195433 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet b4a6f2b64c994f3abefef9724911a5fc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.195569 17258 tablet_replica.cc:333] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.195676 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet b4a6f2b64c994f3abefef9724911a5fc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.195688 17258 raft_consensus.cc:2243] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.195775 17258 raft_consensus.cc:2272] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.196022 16285 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_f435579c26e14e2cbb8da758499bfa19 [id=6b4ebc3c554648b48d6ea2f5916e1bad] alter complete (version 2)
I20251025 08:02:34.196396 17258 ts_tablet_manager.cc:1916] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.196586 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a6f2b64c994f3abefef9724911a5fc" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:34.197153 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a6f2b64c994f3abefef9724911a5fc" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:34.197249 15105 raft_consensus.cc:3060] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:34.197319 15183 leader_election.cc:343] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.198077 15105 raft_consensus.cc:2468] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:34.198113 17258 ts_tablet_manager.cc:1929] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.198160 17258 log.cc:1199] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/b4a6f2b64c994f3abefef9724911a5fc
I20251025 08:02:34.198362 15185 leader_election.cc:304] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
W20251025 08:02:34.198439 15185 raft_consensus.cc:2686] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31: unable to run election callback: Service unavailable: Thread pool token was shut down
W20251025 08:02:34.198591 16279 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6e08efb3c79041ae97ae37e289ccc8f4 has no consensus state
I20251025 08:02:34.199041 17194 ts_tablet_manager.cc:1916] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.199120 17258 ts_tablet_manager.cc:1950] T b4a6f2b64c994f3abefef9724911a5fc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.199597 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet b4a6f2b64c994f3abefef9724911a5fc (table default.Table_15d9c5aa50e643adb2dae30a80b6fcd4 [id=045593a2a7cf4197836b256661103ba5]) successfully deleted
I20251025 08:02:34.201030 17194 ts_tablet_manager.cc:1929] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.201093 17194 log.cc:1199] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/2be36d176bf34fb6bd3c70b42af15cc9
I20251025 08:02:34.201272 17194 ts_tablet_manager.cc:1950] T 2be36d176bf34fb6bd3c70b42af15cc9 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.201339 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 102) took 1373 ms. Trace:
I20251025 08:02:34.201326 17591 tablet.cc:1722] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.201390 17198 rpcz_store.cc:276] 1025 08:02:32.827399 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.828042 (+ 643us) service_pool.cc:225] Handling call
1025 08:02:34.182285 (+1354243us) ts_tablet_manager.cc:1151] Deleting tablet ff20cd7d33a440bab24bd4a61fff1f30
1025 08:02:34.182292 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.184162 (+ 1870us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.194733 (+ 10571us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.201327 (+ 6594us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1354171}
I20251025 08:02:34.201550 17198 tablet_replica.cc:333] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.201647 17198 raft_consensus.cc:2243] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.201726 17198 raft_consensus.cc:2272] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.201714 17620 tablet.cc:1722] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.202024 17198 ts_tablet_manager.cc:1916] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.202261 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 2be36d176bf34fb6bd3c70b42af15cc9 (table default.Table_65442dc666594e129611ee817db7b2c0 [id=de277558d55a46519b3c1e18c51f18fb]) successfully deleted
W20251025 08:02:34.202412 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet b4a6f2b64c994f3abefef9724911a5fc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b4a6f2b64c994f3abefef9724911a5fc already in progress: creating tablet
I20251025 08:02:34.203745 17198 ts_tablet_manager.cc:1929] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.203807 17198 log.cc:1199] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/64996b8137f647b993923cb1bb093211
I20251025 08:02:34.204044 17198 ts_tablet_manager.cc:1950] T 64996b8137f647b993923cb1bb093211 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.204397 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 103) took 1376 ms. Trace:
I20251025 08:02:34.204452 17198 rpcz_store.cc:276] 1025 08:02:32.827437 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.828132 (+ 695us) service_pool.cc:225] Handling call
1025 08:02:34.201528 (+1373396us) ts_tablet_manager.cc:1151] Deleting tablet 64996b8137f647b993923cb1bb093211
1025 08:02:34.201534 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.202910 (+ 1376us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.203703 (+ 793us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.204387 (+ 684us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1373332}
I20251025 08:02:34.204613 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 105) took 1377 ms. Trace:
I20251025 08:02:34.204659 17198 rpcz_store.cc:276] 1025 08:02:32.827510 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.828417 (+ 907us) service_pool.cc:225] Handling call
1025 08:02:34.204566 (+1376149us) ts_tablet_manager.cc:1151] Deleting tablet 6dd0f695a2904df5b750b45782a21ce2
1025 08:02:34.204573 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.204606 (+ 33us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1376064}
W20251025 08:02:34.175415 15048 consensus_peers.cc:597] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5f72ca8cfb94178a21619ddc9fc0352. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:34.204799 17198 tablet_replica.cc:333] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
W20251025 08:02:34.204841 15048 leader_election.cc:343] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.204887 15048 leader_election.cc:304] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.204901 17198 raft_consensus.cc:2243] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.205422 17274 tablet_bootstrap.cc:492] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.205508 17274 ts_tablet_manager.cc:1403] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.049s user 0.001s sys 0.000s
I20251025 08:02:34.205876 17566 tablet.cc:1722] T ed2036a8ebd74ab18c0bbd6d9aa67ef0 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.207513 16279 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_0e6c61f9e83f4f7db9789897a5016f7c" } new_table_name: "default.Table_3b470b735ca242c9a8df091fc03ea60d" modify_external_catalogs: true
I20251025 08:02:34.208583 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_70fcac50b79d43949a6a412c67f22cf9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.208884 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_70fcac50b79d43949a6a412c67f22cf9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.209975 16391 tablet_bootstrap.cc:492] T cfe93efc1a0c4dda95b5c2e58cdcec82 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.210045 16391 ts_tablet_manager.cc:1403] T cfe93efc1a0c4dda95b5c2e58cdcec82 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.048s user 0.002s sys 0.000s
I20251025 08:02:34.210415 16391 raft_consensus.cc:359] T cfe93efc1a0c4dda95b5c2e58cdcec82 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.210490 16391 raft_consensus.cc:385] T cfe93efc1a0c4dda95b5c2e58cdcec82 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.210515 16391 raft_consensus.cc:740] T cfe93efc1a0c4dda95b5c2e58cdcec82 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.210631 16391 consensus_queue.cc:260] T cfe93efc1a0c4dda95b5c2e58cdcec82 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.211040 16391 ts_tablet_manager.cc:1434] T cfe93efc1a0c4dda95b5c2e58cdcec82 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.211210 16391 tablet_bootstrap.cc:492] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.211336 16285 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_f5a86fbd3f5440aca8ae7f7f495a983a [id=ec9b64d93dfc44a29aae35e6b02e2fe8] alter complete (version 1)
I20251025 08:02:34.212018 16391 tablet_bootstrap.cc:654] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.212879 17198 raft_consensus.cc:2272] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.213354 17198 ts_tablet_manager.cc:1916] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.213981 17274 raft_consensus.cc:359] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.214071 17274 raft_consensus.cc:385] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.214097 17274 raft_consensus.cc:740] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.214195 17274 consensus_queue.cc:260] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.214426 17274 ts_tablet_manager.cc:1434] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:34.214569 17274 tablet_bootstrap.cc:492] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.215402 17274 tablet_bootstrap.cc:654] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.216099 15642 raft_consensus.cc:2749] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.216488 17198 ts_tablet_manager.cc:1929] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.216596 17198 log.cc:1199] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/47b0f93bac664a44989534097be9fd73
I20251025 08:02:34.216912 17198 ts_tablet_manager.cc:1950] T 47b0f93bac664a44989534097be9fd73 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.217319 16391 tablet_bootstrap.cc:492] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.217439 16391 ts_tablet_manager.cc:1403] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251025 08:02:34.217875 16391 raft_consensus.cc:359] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.218009 16391 raft_consensus.cc:385] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.218082 16391 raft_consensus.cc:740] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.218303 16391 consensus_queue.cc:260] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.218621 16391 ts_tablet_manager.cc:1434] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:34.218806 16391 tablet_bootstrap.cc:492] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.219743 16391 tablet_bootstrap.cc:654] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.222172 16281 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_e45046c48bb54111b38f009cc14efd2d [id=768625af4c474964ad2b502cf0b03fa7] alter complete (version 1)
I20251025 08:02:34.222815 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 106) took 1395 ms. Trace:
I20251025 08:02:34.222932 17198 rpcz_store.cc:276] 1025 08:02:32.827546 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.828526 (+ 980us) service_pool.cc:225] Handling call
1025 08:02:34.204778 (+1376252us) ts_tablet_manager.cc:1151] Deleting tablet 47b0f93bac664a44989534097be9fd73
1025 08:02:34.204783 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.215626 (+ 10843us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.216444 (+ 818us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.222801 (+ 6357us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1376174}
I20251025 08:02:34.223237 17198 tablet_replica.cc:333] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.223416 17198 raft_consensus.cc:2243] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.223553 17198 raft_consensus.cc:2272] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.223903 17198 ts_tablet_manager.cc:1916] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.225556 17198 ts_tablet_manager.cc:1929] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.226308 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_11241d17fa3e4702b76986f6ce9d04d5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.226675 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_11241d17fa3e4702b76986f6ce9d04d5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:34.226900 16279 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3cac2ac7463944549b5d235ed2e5a480 consensus state has no leader
I20251025 08:02:34.229490 17198 log.cc:1199] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/34c330b5dd544ae686f741cdd85d023d
I20251025 08:02:34.229789 17198 ts_tablet_manager.cc:1950] T 34c330b5dd544ae686f741cdd85d023d P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.230294 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 109) took 1402 ms. Trace:
I20251025 08:02:34.230787 16391 tablet_bootstrap.cc:492] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.230870 16391 ts_tablet_manager.cc:1403] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s
I20251025 08:02:34.231266 16391 raft_consensus.cc:359] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.231346 16391 raft_consensus.cc:385] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.231376 16391 raft_consensus.cc:740] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.231572 16391 consensus_queue.cc:260] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.232009 16391 ts_tablet_manager.cc:1434] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:34.232182 16391 tablet_bootstrap.cc:492] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.232755 16279 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_537aa6710d7f492199d5a5848140311b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:34.232992 16391 tablet_bootstrap.cc:654] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:34.233016 16279 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_537aa6710d7f492199d5a5848140311b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:34.218606 15048 leader_election.cc:343] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:34.233582 15047 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20251025 08:02:34.234558 17198 rpcz_store.cc:276] 1025 08:02:32.827725 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:32.830268 (+ 2543us) service_pool.cc:225] Handling call
1025 08:02:34.223195 (+1392927us) ts_tablet_manager.cc:1151] Deleting tablet 34c330b5dd544ae686f741cdd85d023d
1025 08:02:34.223213 (+ 18us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.224760 (+ 1547us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.225517 (+ 757us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.230284 (+ 4767us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1392819}
I20251025 08:02:34.234629 15048 leader_election.cc:304] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.234732 17198 tablet_replica.cc:333] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.234746 15642 raft_consensus.cc:2749] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.234836 17198 raft_consensus.cc:2243] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.234917 17198 raft_consensus.cc:2272] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.235581 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "879ae11ae94b4d2eab76c1dc74e160ca" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.235769 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76c31d4c83c740dab40bebd6c8d3f161" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.236045 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88a76d187fae4f09ac879b72e9c05a86" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.236122 14979 raft_consensus.cc:2468] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:34.236325 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be8d6685c70c4219947df30f023a59b8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.236397 14973 raft_consensus.cc:2468] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:34.236563 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88a76d187fae4f09ac879b72e9c05a86" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:34.236624 17198 ts_tablet_manager.cc:1916] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.236644 14979 raft_consensus.cc:3060] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.236979 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1ddb3795876b486e992b58cea711afb3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.237448 14979 raft_consensus.cc:2468] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:34.237540 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98baf6e8d8e84b42a83054495ae19e01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:34.237632 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "98baf6e8d8e84b42a83054495ae19e01" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.237622 14974 raft_consensus.cc:3060] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.238489 17198 ts_tablet_manager.cc:1929] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.238544 17198 log.cc:1199] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/1927cf6a9013402a92c9e6e89e2e1715
I20251025 08:02:34.238687 14974 raft_consensus.cc:2468] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:34.238761 17198 ts_tablet_manager.cc:1950] T 1927cf6a9013402a92c9e6e89e2e1715 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.239452 17595 consensus_queue.cc:1048] T c84d6bed24444dcfab1920efad849932 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.240043 16572 raft_consensus.cc:493] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.240053 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 116) took 1113 ms. Trace:
I20251025 08:02:34.240100 17198 rpcz_store.cc:276] 1025 08:02:33.126900 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.127019 (+ 119us) service_pool.cc:225] Handling call
1025 08:02:34.234706 (+1107687us) ts_tablet_manager.cc:1151] Deleting tablet 1927cf6a9013402a92c9e6e89e2e1715
1025 08:02:34.234713 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.237526 (+ 2813us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.238446 (+ 920us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.240041 (+ 1595us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1107585}
I20251025 08:02:34.240116 16572 raft_consensus.cc:515] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.240247 17198 tablet_replica.cc:333] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.240350 17198 raft_consensus.cc:2243] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.240424 16572 leader_election.cc:290] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.240517 17198 raft_consensus.cc:2272] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.240818 17198 ts_tablet_manager.cc:1916] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.240854 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc62afd62257471e8590d28e49a50cb2" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.240943 15105 raft_consensus.cc:2468] T fc62afd62257471e8590d28e49a50cb2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:34.240959 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc62afd62257471e8590d28e49a50cb2" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:34.241973 15183 leader_election.cc:343] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.242120 15185 leader_election.cc:304] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:34.242276 16572 raft_consensus.cc:2804] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.242336 16572 raft_consensus.cc:493] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.242372 16572 raft_consensus.cc:3060] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.243212 16572 raft_consensus.cc:515] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.243532 16572 leader_election.cc:290] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.243804 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc62afd62257471e8590d28e49a50cb2" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:34.244109 15183 leader_election.cc:343] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.244463 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc62afd62257471e8590d28e49a50cb2" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:34.244577 15105 raft_consensus.cc:3060] T fc62afd62257471e8590d28e49a50cb2 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.244608 17415 raft_consensus.cc:493] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.244683 17415 raft_consensus.cc:515] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.244863 17198 ts_tablet_manager.cc:1929] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.244910 17198 log.cc:1199] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/5bf286568e8343b7921ac256a9313e63
I20251025 08:02:34.244932 17415 leader_election.cc:290] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.245121 17198 ts_tablet_manager.cc:1950] T 5bf286568e8343b7921ac256a9313e63 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
W20251025 08:02:34.245955 14914 leader_election.cc:343] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: b4a6f2b64c994f3abefef9724911a5fc
I20251025 08:02:34.247473 17415 consensus_queue.cc:1048] T ff15c6e28a794271ac61ca111d66a06e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.248059 16287 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_1c42bf37d0434552a8f4ffe93d29d77a" } new_table_name: "default.Table_c6f81392e62f401fa4a3ebe3de2eacbb" modify_external_catalogs: true
I20251025 08:02:34.248196 17415 consensus_queue.cc:1048] T 45a22457031a4eff8e82fa232b6f05bb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.245476 15105 raft_consensus.cc:2468] T fc62afd62257471e8590d28e49a50cb2 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:34.248494 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 120) took 1121 ms. Trace:
I20251025 08:02:34.248540 17198 rpcz_store.cc:276] 1025 08:02:33.127383 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.127902 (+ 519us) service_pool.cc:225] Handling call
1025 08:02:34.240227 (+1112325us) ts_tablet_manager.cc:1151] Deleting tablet 5bf286568e8343b7921ac256a9313e63
1025 08:02:34.240231 (+ 4us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.241671 (+ 1440us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.244825 (+ 3154us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.248484 (+ 3659us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1112218}
I20251025 08:02:34.248688 17198 tablet_replica.cc:333] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.248734 15185 leader_election.cc:304] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:34.248814 17198 raft_consensus.cc:2243] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.248853 16572 raft_consensus.cc:2804] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.248905 17198 raft_consensus.cc:2272] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.248919 16572 raft_consensus.cc:697] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:34.249035 16572 consensus_queue.cc:237] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.249214 17198 ts_tablet_manager.cc:1916] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.249289 17415 consensus_queue.cc:1048] T e5e907ec8e7c420d8d6d68a954cc8beb P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.249666 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet d993e2350f37492bb712d145d03e8afb (table default.Table_1ccbe630ac5a41ecb7b00087172bec38 [id=1e716be545914b22887b2f7e069c41c4]) successfully deleted
I20251025 08:02:34.250897 17198 ts_tablet_manager.cc:1929] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.252339 17198 log.cc:1199] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/6a3ec64b273d4e8c92b1e24061ac7336
I20251025 08:02:34.252702 17198 ts_tablet_manager.cc:1950] T 6a3ec64b273d4e8c92b1e24061ac7336 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.252730 14969 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dc32b27b3f743bf8719e39ea8c20e34" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.253149 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 121) took 1125 ms. Trace:
I20251025 08:02:34.254128 14969 raft_consensus.cc:3060] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.255640 17620 tablet.cc:1722] T 24e0f02dd56644a3930c1cc0a972132e P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:34.254401 15642 raft_consensus.cc:493] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.256114 15642 raft_consensus.cc:515] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.256381 15642 leader_election.cc:290] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.256505 17198 rpcz_store.cc:276] 1025 08:02:33.127501 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.131180 (+ 3679us) service_pool.cc:225] Handling call
1025 08:02:34.248662 (+1117482us) ts_tablet_manager.cc:1151] Deleting tablet 6a3ec64b273d4e8c92b1e24061ac7336
1025 08:02:34.248669 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.250096 (+ 1427us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.250857 (+ 761us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.253139 (+ 2282us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1117388}
I20251025 08:02:34.256698 17198 tablet_replica.cc:333] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.256824 17198 raft_consensus.cc:2243] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.257035 17198 raft_consensus.cc:2272] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.255884 17537 raft_consensus.cc:493] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.257658 17537 raft_consensus.cc:515] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.257719 17198 ts_tablet_manager.cc:1916] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.257941 17537 leader_election.cc:290] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.258002 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3cac2ac7463944549b5d235ed2e5a480" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.258368 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 73cdd9616b9c460f8fcd4a40e4a3ccc8 (table default.Table_05bac665c2114dacac7804da6adfc06e [id=9aee333b5b9f4e1daba6449f643ea43a]) successfully deleted
W20251025 08:02:34.258406 15049 consensus_peers.cc:597] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f64072c416f4a77b1c81855d7db8f01. This is attempt 1: this message will repeat every 5th retry.
W20251025 08:02:34.258505 15049 leader_election.cc:343] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.258525 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet a40c5721a4304345b471960ed1691930 (table default.Table_0d996ce6118b41598999853934f369f1 [id=82a8474566dd4ee99395f3220c214476]) successfully deleted
I20251025 08:02:34.258656 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet c043ab70d7364e05b0b352ac5c416db1 (table default.Table_21b4f92893424716afe86f9c67b6a691 [id=db6654cc26a348709c7f0577b91f18af]) successfully deleted
I20251025 08:02:34.258746 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 6d1979a4f43a4659976b0cd6d1b888ef (table default.Table_67015d2b75d043d3bd2d7f8facd07524 [id=1a9876389ab64909a2405359ed420a95]) successfully deleted
W20251025 08:02:34.258852 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet a40c5721a4304345b471960ed1691930 because the tablet was not found. No further retry: Not found: Tablet not found: a40c5721a4304345b471960ed1691930
I20251025 08:02:34.258934 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 997c8c5921ad4ec18914fd50c97fc33e (table default.Table_56b69a1e3b4d4e7dbaa6a4697a940880 [id=cb9294ed7c474aae989ac13159ec3166]) successfully deleted
I20251025 08:02:34.259023 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 6c582efa6d334a06a48e2f2b94167776 (table default.Table_b1d8db45b7d745a0b4dd9ff09300da89 [id=be37bd4a45da444e83846233c335d445]) successfully deleted
I20251025 08:02:34.259143 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 98baf6e8d8e84b42a83054495ae19e01 (table default.Table_e7ff1f77ca4f48b2afa289c6672bcafd [id=a63322e79f4d47599afcfe64edd3a86c]) successfully deleted
I20251025 08:02:34.259296 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet bfdc6022cc5747439edcb8aa865b9437 (table default.Table_5bc70f62257c438bb0c52926674f2bdf [id=e62c2aba4e5546e2bd881c5f2ae3abd4]) successfully deleted
I20251025 08:02:34.259361 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 27d1e084fbdf43e2a1cc60fb6dfd194b (table default.Table_1acaea81b51b4fe48d3777375cde2fff [id=b9853b2d88cf4a96b9fc5e1099f87064]) successfully deleted
W20251025 08:02:34.259436 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 212ccfb58f964d7bae31e5af110b4079 because the tablet was not found. No further retry: Not found: Tablet not found: 212ccfb58f964d7bae31e5af110b4079
W20251025 08:02:34.259506 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 0d6cca70bc3c48bf9c2396fdfdb8e42c because the tablet was not found. No further retry: Not found: Tablet not found: 0d6cca70bc3c48bf9c2396fdfdb8e42c
I20251025 08:02:34.259569 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 23eedc2695db43afbd6f5dbebb0ea2be (table default.Table_d9fe75661236465ca4c58953ed0023c4 [id=c0f5ecd0d89d409785fbd905d22e3fc2]) successfully deleted
I20251025 08:02:34.259632 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet ff20cd7d33a440bab24bd4a61fff1f30 (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]) successfully deleted
I20251025 08:02:34.259720 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 64996b8137f647b993923cb1bb093211 (table default.Table_c8ac7973eef94a68bf4ebe1459c2e6e6 [id=3c371b3791fd45be983458cd55d67827]) successfully deleted
W20251025 08:02:34.259795 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 6dd0f695a2904df5b750b45782a21ce2 because the tablet was not found. No further retry: Not found: Tablet not found: 6dd0f695a2904df5b750b45782a21ce2
I20251025 08:02:34.259863 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 47b0f93bac664a44989534097be9fd73 (table default.Table_2c042f0ac6454365ae570c2cd26b31ca [id=d656394d725244dbbe22b0cfb8e4c89f]) successfully deleted
I20251025 08:02:34.259955 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 34c330b5dd544ae686f741cdd85d023d (table default.Table_aa5c70a86540451b8a07688d25edc3b7 [id=bd246e92f35b47a2864b5da042da3232]) successfully deleted
I20251025 08:02:34.260972 16285 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_0a7689d2e9da469a99bf4e6238b2bdf5 [id=4e3924f6f712459db0d167bb72825701] alter complete (version 2)
I20251025 08:02:34.262728 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1e248b8303b1498e96178d4e46ad691e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:34.263118 15049 leader_election.cc:343] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.263796 15078 tablet_service.cc:1505] Processing CreateTablet for tablet a67d80dba81049279f536d8c6481f3f2 (DEFAULT_TABLE table=default.Table_bda70e09b01847069a68d129053e6b26 [id=ec62cd99f7d049c6bdd8b0de71ed6367]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.264036 15078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a67d80dba81049279f536d8c6481f3f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.264081 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet 5022f9beb59449828f59dca9d14caa50 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.264449 15088 tablet_service.cc:1552] Processing DeleteTablet for tablet d05bf0056dfc43eeb4105af559497bdc with delete_type TABLET_DATA_DELETED (replaced by tablet 6e08efb3c79041ae97ae37e289ccc8f4) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.264796 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "88a76d187fae4f09ac879b72e9c05a86" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.265280 17198 ts_tablet_manager.cc:1929] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.265380 17198 log.cc:1199] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/8362e26d86d44e9780d3c78c6a468556
I20251025 08:02:34.265650 17198 ts_tablet_manager.cc:1950] T 8362e26d86d44e9780d3c78c6a468556 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.265894 15076 tablet_service.cc:1505] Processing CreateTablet for tablet 35bddef8fd2d4971a636e0689ac37d3a (DEFAULT_TABLE table=default.Table_c93b71eeb33d4dcc9501dd2efdde7556 [id=6b693e12dd45483b8099ad827dd57865]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.266134 15076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35bddef8fd2d4971a636e0689ac37d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.266147 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 122) took 1138 ms. Trace:
I20251025 08:02:34.266446 17198 rpcz_store.cc:276] 1025 08:02:33.127593 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.131292 (+ 3699us) service_pool.cc:225] Handling call
1025 08:02:34.256680 (+1125388us) ts_tablet_manager.cc:1151] Deleting tablet 8362e26d86d44e9780d3c78c6a468556
1025 08:02:34.256684 (+ 4us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.258821 (+ 2137us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.265237 (+ 6416us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.266136 (+ 899us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1125323}
I20251025 08:02:34.266805 17198 tablet_replica.cc:333] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.266963 17198 raft_consensus.cc:2243] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.266989 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b4a6f2b64c994f3abefef9724911a5fc" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.267130 15110 raft_consensus.cc:2393] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:34.267175 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 1927cf6a9013402a92c9e6e89e2e1715 (table default.Table_d03eda3087a54490a502678eeeeeabc8 [id=1297b3a21b8a458d80575525d6df9783]) successfully deleted
I20251025 08:02:34.267409 17198 raft_consensus.cc:2272] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.268090 15079 tablet_service.cc:1505] Processing CreateTablet for tablet 62db0ba07ab64d3691bac134d10db771 (DEFAULT_TABLE table=default.Table_8f13647040414977b520af60cd428302 [id=8dc21ea1bf46490388397ecd6895a031]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.268326 15079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62db0ba07ab64d3691bac134d10db771. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.268572 17198 ts_tablet_manager.cc:1916] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.268985 17274 tablet_bootstrap.cc:492] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.269083 17274 ts_tablet_manager.cc:1403] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.055s user 0.001s sys 0.000s
I20251025 08:02:34.269515 17274 raft_consensus.cc:359] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.269639 17274 raft_consensus.cc:385] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.269675 17274 raft_consensus.cc:740] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.269788 17274 consensus_queue.cc:260] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.270083 17274 ts_tablet_manager.cc:1434] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.270150 15093 tablet_service.cc:1505] Processing CreateTablet for tablet e0f08e0726a447848747ea33588867eb (DEFAULT_TABLE table=default.Table_82dd4283c4d44377ad2a4834aa04ebfe [id=912da5ef8bbf4af29528c084ea7fa633]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.270367 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0f08e0726a447848747ea33588867eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.270473 17274 tablet_bootstrap.cc:492] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.270763 17198 ts_tablet_manager.cc:1929] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.270816 17198 log.cc:1199] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/16f1ab00a20345a1bb51e685b3fc6c70
I20251025 08:02:34.271013 17198 ts_tablet_manager.cc:1950] T 16f1ab00a20345a1bb51e685b3fc6c70 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.271085 17537 raft_consensus.cc:493] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.271162 17537 raft_consensus.cc:515] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.271394 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 123) took 1143 ms. Trace:
I20251025 08:02:34.271433 17274 tablet_bootstrap.cc:654] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.271473 17537 leader_election.cc:290] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.272195 16390 tablet_bootstrap.cc:492] T 3cac2ac7463944549b5d235ed2e5a480 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.272279 16390 ts_tablet_manager.cc:1403] T 3cac2ac7463944549b5d235ed2e5a480 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.099s user 0.001s sys 0.000s
I20251025 08:02:34.272353 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 7a810514b25b47d58c12d7f22f897e4c (DEFAULT_TABLE table=default.Table_7650f4b1f03949c5a77899e2ad5e1fe9 [id=d9686ee7426a40d6a044ecaef9df2714]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.272481 15081 tablet_service.cc:1552] Processing DeleteTablet for tablet f102eb1c22004790839b6563bd830786 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.272575 15075 tablet_service.cc:1552] Processing DeleteTablet for tablet 7f5c6a17507d4a5a8057a725d3299ab9 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.271443 17198 rpcz_store.cc:276] 1025 08:02:33.127709 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.131396 (+ 3687us) service_pool.cc:225] Handling call
1025 08:02:34.266782 (+1135386us) ts_tablet_manager.cc:1151] Deleting tablet 16f1ab00a20345a1bb51e685b3fc6c70
1025 08:02:34.266788 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.269713 (+ 2925us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.270723 (+ 1010us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.271380 (+ 657us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":754,"tablet-delete.queue_time_us":1135319}
I20251025 08:02:34.272665 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet b826067888164df0af7da797d42c0862 with delete_type TABLET_DATA_DELETED (replaced by tablet bb517f3c7dc545f089eff1fcb4acbce9) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.272666 16390 raft_consensus.cc:359] T 3cac2ac7463944549b5d235ed2e5a480 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.272742 16390 raft_consensus.cc:385] T 3cac2ac7463944549b5d235ed2e5a480 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.272750 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 2be36d176bf34fb6bd3c70b42af15cc9 with delete_type TABLET_DATA_DELETED (replaced by tablet 140cc7a1ea2149adaacb2d254f84deea) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.272759 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aae693881f9d40c789d242c6de5d9905" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.272838 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet b4a6f2b64c994f3abefef9724911a5fc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.272775 16390 raft_consensus.cc:740] T 3cac2ac7463944549b5d235ed2e5a480 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.273005 16390 consensus_queue.cc:260] T 3cac2ac7463944549b5d235ed2e5a480 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.273142 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a810514b25b47d58c12d7f22f897e4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.273228 16390 ts_tablet_manager.cc:1434] T 3cac2ac7463944549b5d235ed2e5a480 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.273379 16390 tablet_bootstrap.cc:492] T 2a4b060efd054726b07702b691876147 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.274060 16390 tablet_bootstrap.cc:654] T 2a4b060efd054726b07702b691876147 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.274796 16391 tablet_bootstrap.cc:492] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.274868 16391 ts_tablet_manager.cc:1403] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.043s user 0.000s sys 0.002s
I20251025 08:02:34.275179 16280 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_05bac665c2114dacac7804da6adfc06e" } new_table_name: "default.Table_f7b470f4186b4021b9add91827963361" modify_external_catalogs: true
I20251025 08:02:34.275278 16391 raft_consensus.cc:359] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.275374 16391 raft_consensus.cc:385] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.275401 16391 raft_consensus.cc:740] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.275481 16391 consensus_queue.cc:260] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.275722 16391 ts_tablet_manager.cc:1434] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:34.276127 16391 tablet_bootstrap.cc:492] T 29b4798bac204280b9c56ebb0f44302d P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.276165 16283 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_1d154c130315454cad4d9f3ea6bdd9b2 [id=a1ed1a0c27ef42c69acd197420340d7d] alter complete (version 1)
I20251025 08:02:34.276954 16391 tablet_bootstrap.cc:654] T 29b4798bac204280b9c56ebb0f44302d P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:34.278221 15049 leader_election.cc:343] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.278754 17198 tablet_replica.cc:333] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.278895 17198 raft_consensus.cc:2243] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.279074 17198 raft_consensus.cc:2272] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.279655 17198 ts_tablet_manager.cc:1916] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.281332 17198 ts_tablet_manager.cc:1929] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.281939 17198 log.cc:1199] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/8b6ae6527fd64c3bb5999dec97db861d
I20251025 08:02:34.282260 17198 ts_tablet_manager.cc:1950] T 8b6ae6527fd64c3bb5999dec97db861d P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.282745 17274 tablet_bootstrap.cc:492] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.282831 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 127) took 1128 ms. Trace:
I20251025 08:02:34.282838 16285 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_434df4d622c74c6f89f7b7373096fb5f [id=0a4629613477421ba329364dbb42a8b6] alter complete (version 1)
I20251025 08:02:34.282858 17274 ts_tablet_manager.cc:1403] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s
I20251025 08:02:34.283324 17274 raft_consensus.cc:359] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.283455 17274 raft_consensus.cc:385] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.283521 17274 raft_consensus.cc:740] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.283658 17274 consensus_queue.cc:260] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.283910 17274 ts_tablet_manager.cc:1434] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.284160 17274 tablet_bootstrap.cc:492] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:34.284345 16287 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet bb517f3c7dc545f089eff1fcb4acbce9 has no consensus state
I20251025 08:02:34.284854 16391 tablet_bootstrap.cc:492] T 29b4798bac204280b9c56ebb0f44302d P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.284925 16391 ts_tablet_manager.cc:1403] T 29b4798bac204280b9c56ebb0f44302d P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:34.285405 16391 raft_consensus.cc:359] T 29b4798bac204280b9c56ebb0f44302d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.285499 16391 raft_consensus.cc:385] T 29b4798bac204280b9c56ebb0f44302d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.285529 16391 raft_consensus.cc:740] T 29b4798bac204280b9c56ebb0f44302d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.285626 16391 consensus_queue.cc:260] T 29b4798bac204280b9c56ebb0f44302d P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.285846 16391 ts_tablet_manager.cc:1434] T 29b4798bac204280b9c56ebb0f44302d P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.286000 16391 tablet_bootstrap.cc:492] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.286867 16391 tablet_bootstrap.cc:654] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:34.290313 16280 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9ecb15be5f5c48f1bd68e56b65543fad consensus state has no leader
I20251025 08:02:34.290776 16285 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_236aa29f60b94e4d9c524ebb1051c3a8 [id=1338885c63014b47bcd512a9ddfaf31d] alter complete (version 1)
I20251025 08:02:34.290989 16281 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_ad9841940177424384c1bbcbf700ea9d [id=b58927a3527c45cb946d1fcc0681d6bf] alter complete (version 2)
I20251025 08:02:34.292784 16283 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_c5c036d7c66344eba94e15be432088bc [id=ebfa83131bd946d0897b32ef3c188c19] alter complete (version 1)
I20251025 08:02:34.293237 16391 tablet_bootstrap.cc:492] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.293306 16391 ts_tablet_manager.cc:1403] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20251025 08:02:34.293680 16391 raft_consensus.cc:359] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.293761 16391 raft_consensus.cc:385] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.293788 16391 raft_consensus.cc:740] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.293877 16391 consensus_queue.cc:260] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.294104 16391 ts_tablet_manager.cc:1434] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.294270 16391 tablet_bootstrap.cc:492] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.294364 17274 tablet_bootstrap.cc:654] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.282886 17198 rpcz_store.cc:276] 1025 08:02:33.154421 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.154513 (+ 92us) service_pool.cc:225] Handling call
1025 08:02:34.272735 (+1118222us) ts_tablet_manager.cc:1151] Deleting tablet 8b6ae6527fd64c3bb5999dec97db861d
1025 08:02:34.278728 (+ 5993us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.280557 (+ 1829us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.281289 (+ 732us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.282822 (+ 1533us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":906687}
I20251025 08:02:34.292322 17537 raft_consensus.cc:493] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.295053 17198 tablet_replica.cc:333] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.295022 17537 raft_consensus.cc:515] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.295110 16391 tablet_bootstrap.cc:654] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.295171 17198 raft_consensus.cc:2243] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.295444 17537 leader_election.cc:290] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.296054 16287 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_08013ca351ee49df9acad855462d7507" } modify_external_catalogs: true
I20251025 08:02:34.296139 16287 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_08013ca351ee49df9acad855462d7507" } modify_external_catalogs: true
I20251025 08:02:34.296423 16280 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_c7244244ce0f4f91b75edf56ecb49442"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.296758 16280 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c7244244ce0f4f91b75edf56ecb49442 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.297465 16286 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_c9a43b4d33d14d7dbea3c1994be81413" } modify_external_catalogs: true
I20251025 08:02:34.297547 16286 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_c9a43b4d33d14d7dbea3c1994be81413" } modify_external_catalogs: true
I20251025 08:02:34.297575 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet a40c5721a4304345b471960ed1691930 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.297750 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet 736f75f26af142e59e7996c2ebb80868 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.298230 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 47b0f93bac664a44989534097be9fd73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.298144 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet d05bf0056dfc43eeb4105af559497bdc with delete_type TABLET_DATA_DELETED (replaced by tablet 6e08efb3c79041ae97ae37e289ccc8f4) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.298384 17198 raft_consensus.cc:2272] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.298417 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet b4a6f2b64c994f3abefef9724911a5fc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:42704
W20251025 08:02:34.298421 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet a40c5721a4304345b471960ed1691930 because the tablet was not found. No further retry: Not found: Tablet not found: a40c5721a4304345b471960ed1691930
W20251025 08:02:34.298543 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 736f75f26af142e59e7996c2ebb80868 because the tablet was not found. No further retry: Not found: Tablet not found: 736f75f26af142e59e7996c2ebb80868
I20251025 08:02:34.298566 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 98baf6e8d8e84b42a83054495ae19e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.298700 17198 ts_tablet_manager.cc:1916] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:34.299127 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 47b0f93bac664a44989534097be9fd73 because the tablet was not found. No further retry: Not found: Tablet not found: 47b0f93bac664a44989534097be9fd73
W20251025 08:02:34.299245 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet d05bf0056dfc43eeb4105af559497bdc because the tablet was not found. No further retry: Not found: Tablet not found: d05bf0056dfc43eeb4105af559497bdc
W20251025 08:02:34.299326 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet b4a6f2b64c994f3abefef9724911a5fc because the tablet was not found. No further retry: Not found: Tablet not found: b4a6f2b64c994f3abefef9724911a5fc
W20251025 08:02:34.299417 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 98baf6e8d8e84b42a83054495ae19e01 because the tablet was not found. No further retry: Not found: Tablet not found: 98baf6e8d8e84b42a83054495ae19e01
I20251025 08:02:34.299796 17415 raft_consensus.cc:493] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.299860 17415 raft_consensus.cc:515] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.299964 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 736f75f26af142e59e7996c2ebb80868 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.299881 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet a40c5721a4304345b471960ed1691930 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.300175 17415 leader_election.cc:290] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:34.300335 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 736f75f26af142e59e7996c2ebb80868 because the tablet was not found. No further retry: Not found: Tablet not found: 736f75f26af142e59e7996c2ebb80868
I20251025 08:02:34.300192 17194 tablet_replica.cc:333] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.300532 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "acb84bad2f75474faecd00432d187ccf" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.300607 17194 raft_consensus.cc:2243] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.300683 17194 raft_consensus.cc:2272] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.300804 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0de3ec67dcc4e41a447338869076314" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.301007 17194 ts_tablet_manager.cc:1916] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.301046 17198 ts_tablet_manager.cc:1929] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.301095 17198 log.cc:1199] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/ed5ed91e953d42afa9ebf9ab8b89d0e6
I20251025 08:02:34.301309 17198 ts_tablet_manager.cc:1950] T ed5ed91e953d42afa9ebf9ab8b89d0e6 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.301476 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 128) took 1147 ms. Trace:
I20251025 08:02:34.301525 17198 rpcz_store.cc:276] 1025 08:02:33.154476 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.154601 (+ 125us) service_pool.cc:225] Handling call
1025 08:02:34.295022 (+1140421us) ts_tablet_manager.cc:1151] Deleting tablet ed5ed91e953d42afa9ebf9ab8b89d0e6
1025 08:02:34.295031 (+ 9us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.299761 (+ 4730us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.301001 (+ 1240us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.301469 (+ 468us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":928852}
W20251025 08:02:34.301615 15049 leader_election.cc:343] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.301659 17198 tablet_replica.cc:333] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.301751 17198 raft_consensus.cc:2243] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.301819 17198 raft_consensus.cc:2272] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.303773 16281 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_1d154c130315454cad4d9f3ea6bdd9b2" } modify_external_catalogs: true
I20251025 08:02:34.303849 16281 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_1d154c130315454cad4d9f3ea6bdd9b2" } modify_external_catalogs: true
I20251025 08:02:34.305876 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_107cb00854d146059a300318b6a5482a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.306212 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_107cb00854d146059a300318b6a5482a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.306252 17194 ts_tablet_manager.cc:1929] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.306303 17194 log.cc:1199] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/a40c5721a4304345b471960ed1691930
I20251025 08:02:34.306500 17194 ts_tablet_manager.cc:1950] T a40c5721a4304345b471960ed1691930 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.306905 17198 ts_tablet_manager.cc:1916] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.306946 16283 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_093d20ac970543978ab5c4900b681def" } modify_external_catalogs: true
I20251025 08:02:34.307094 16283 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_093d20ac970543978ab5c4900b681def" } modify_external_catalogs: true
I20251025 08:02:34.307981 16279 master_service.cc:954] ReplaceTablet: received request to replace tablet 42e8a5ee7d6a42aaaf95c33617abff3f from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.308449 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_2df0c9f4b493424f84f729bc94fc9470"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.308786 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2df0c9f4b493424f84f729bc94fc9470 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.309813 17198 ts_tablet_manager.cc:1929] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.309926 17198 log.cc:1199] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/1e248b8303b1498e96178d4e46ad691e
I20251025 08:02:34.310330 17198 ts_tablet_manager.cc:1950] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.310678 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 125) took 1156 ms. Trace:
I20251025 08:02:34.310771 17198 rpcz_store.cc:276] 1025 08:02:33.154303 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.154513 (+ 210us) service_pool.cc:225] Handling call
1025 08:02:34.301641 (+1147128us) ts_tablet_manager.cc:1151] Deleting tablet 1e248b8303b1498e96178d4e46ad691e
1025 08:02:34.301646 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.308350 (+ 6704us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.309749 (+ 1399us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.310649 (+ 900us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":935188}
I20251025 08:02:34.311094 17198 tablet_replica.cc:333] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.311268 17198 raft_consensus.cc:2243] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.311498 17198 pending_rounds.cc:70] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:34.311575 17198 pending_rounds.cc:77] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609831414226944 op_type: NO_OP noop_request { }
I20251025 08:02:34.311697 17198 raft_consensus.cc:2889] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:34.311797 17198 raft_consensus.cc:2272] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.313946 16286 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet cc676245d2984363b4af1e817b444c3d
I20251025 08:02:34.314559 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet cc676245d2984363b4af1e817b444c3d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.315213 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet cc676245d2984363b4af1e817b444c3d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.315357 17258 tablet_replica.cc:333] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.315465 17258 raft_consensus.cc:2243] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.315613 17258 raft_consensus.cc:2272] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.315979 17258 ts_tablet_manager.cc:1916] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.316174 16390 tablet_bootstrap.cc:492] T 2a4b060efd054726b07702b691876147 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.316243 16390 ts_tablet_manager.cc:1403] T 2a4b060efd054726b07702b691876147 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.043s user 0.001s sys 0.000s
I20251025 08:02:34.316605 16390 raft_consensus.cc:359] T 2a4b060efd054726b07702b691876147 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.316701 16390 raft_consensus.cc:385] T 2a4b060efd054726b07702b691876147 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.316737 16390 raft_consensus.cc:740] T 2a4b060efd054726b07702b691876147 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.316845 16390 consensus_queue.cc:260] T 2a4b060efd054726b07702b691876147 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.317147 16390 ts_tablet_manager.cc:1434] T 2a4b060efd054726b07702b691876147 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.317294 16390 tablet_bootstrap.cc:492] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.318068 16390 tablet_bootstrap.cc:654] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.319154 17258 ts_tablet_manager.cc:1929] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.319228 17258 log.cc:1199] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/cc676245d2984363b4af1e817b444c3d
I20251025 08:02:34.319453 17258 ts_tablet_manager.cc:1950] T cc676245d2984363b4af1e817b444c3d P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.319633 16280 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_79b8c7e1c9d84aa3ab5af10d4734f6ef"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:34.319888 17194 tablet_replica.cc:333] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
W20251025 08:02:34.319919 16280 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_79b8c7e1c9d84aa3ab5af10d4734f6ef in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.320030 17194 raft_consensus.cc:2243] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.320082 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet cc676245d2984363b4af1e817b444c3d (table default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8]) successfully deleted
I20251025 08:02:34.320132 17194 raft_consensus.cc:2272] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.320439 17194 ts_tablet_manager.cc:1916] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.322535 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3cac2ac7463944549b5d235ed2e5a480" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.322656 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet a40c5721a4304345b471960ed1691930 (table default.Table_0d996ce6118b41598999853934f369f1 [id=82a8474566dd4ee99395f3220c214476]) successfully deleted
I20251025 08:02:34.322822 16286 master_service.cc:954] ReplaceTablet: received request to replace tablet 2f64072c416f4a77b1c81855d7db8f01 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.323272 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1e248b8303b1498e96178d4e46ad691e" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.323452 17198 ts_tablet_manager.cc:1916] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.323849 14915 leader_election.cc:304] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.324455 17594 consensus_queue.cc:1048] T 29476b0bf2f34dcb913a665e3a008519 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.324570 15497 raft_consensus.cc:493] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251025 08:02:34.324595 15048 leader_election.cc:343] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.324652 15048 leader_election.cc:304] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.324631 15497 raft_consensus.cc:515] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.324663 17594 raft_consensus.cc:2749] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.324750 15642 raft_consensus.cc:493] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.324801 15642 raft_consensus.cc:515] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.324807 17594 consensus_queue.cc:1048] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.324911 15497 leader_election.cc:290] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.324981 15497 raft_consensus.cc:2749] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.325076 15642 leader_election.cc:290] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.325235 17198 ts_tablet_manager.cc:1929] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.325300 17198 log.cc:1199] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/f5f72ca8cfb94178a21619ddc9fc0352
I20251025 08:02:34.325529 17198 ts_tablet_manager.cc:1950] T f5f72ca8cfb94178a21619ddc9fc0352 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.325706 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 126) took 1171 ms. Trace:
I20251025 08:02:34.325748 17198 rpcz_store.cc:276] 1025 08:02:33.154356 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.154391 (+ 35us) service_pool.cc:225] Handling call
1025 08:02:34.311050 (+1156659us) ts_tablet_manager.cc:1151] Deleting tablet f5f72ca8cfb94178a21619ddc9fc0352
1025 08:02:34.311056 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.324384 (+ 13328us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.325185 (+ 801us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.325699 (+ 514us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":944539}
I20251025 08:02:34.325896 17198 tablet_replica.cc:333] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.326006 17198 raft_consensus.cc:2243] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.326433 16391 tablet_bootstrap.cc:492] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.326507 16391 ts_tablet_manager.cc:1403] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20251025 08:02:34.326925 16391 raft_consensus.cc:359] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.327008 16391 raft_consensus.cc:385] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.327054 16391 raft_consensus.cc:740] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.327159 16391 consensus_queue.cc:260] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.327414 16391 ts_tablet_manager.cc:1434] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.327559 16391 tablet_bootstrap.cc:492] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.328456 16391 tablet_bootstrap.cc:654] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.328465 17594 raft_consensus.cc:493] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.329432 17594 raft_consensus.cc:515] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.329730 17594 leader_election.cc:290] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.330449 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f141107d4674690acd51e499bc4e208" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.330518 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "334015a0a5aa42c8b127d64e794c2705" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.331079 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3cac2ac7463944549b5d235ed2e5a480" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.331177 15237 raft_consensus.cc:2468] T 3cac2ac7463944549b5d235ed2e5a480 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:34.332772 16279 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 42e8a5ee7d6a42aaaf95c33617abff3f
I20251025 08:02:34.332994 16279 catalog_manager.cc:6719] ReplaceTablet: tablet 42e8a5ee7d6a42aaaf95c33617abff3f deleted and replaced by tablet f334665c1bc3418fb68d23e28c5de309
I20251025 08:02:34.333149 16279 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_2e193299ce924a3cabcf0d49731b632c" } new_table_name: "default.Table_96c726b8fcd341f2895079b79f53cf7c" modify_external_catalogs: true
I20251025 08:02:34.333184 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 42e8a5ee7d6a42aaaf95c33617abff3f with delete_type TABLET_DATA_DELETED (replaced by tablet f334665c1bc3418fb68d23e28c5de309) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.333315 17258 tablet_replica.cc:333] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.333431 17258 raft_consensus.cc:2243] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.333575 17258 raft_consensus.cc:2272] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.333796 16281 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet f426e93af38e4e17b30cd01eea12dcac
I20251025 08:02:34.333860 17258 ts_tablet_manager.cc:1916] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.334517 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet f426e93af38e4e17b30cd01eea12dcac with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.334641 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 42e8a5ee7d6a42aaaf95c33617abff3f with delete_type TABLET_DATA_DELETED (replaced by tablet f334665c1bc3418fb68d23e28c5de309) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.334785 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet f426e93af38e4e17b30cd01eea12dcac with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.335027 17198 raft_consensus.cc:2272] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.335397 17198 ts_tablet_manager.cc:1916] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.335773 14914 leader_election.cc:304] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.335760 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_089d1f21fd52485da83680d50e16774a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:34.335951 17594 raft_consensus.cc:2804] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.336010 17594 raft_consensus.cc:493] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.336045 17594 raft_consensus.cc:3060] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.336057 17258 ts_tablet_manager.cc:1929] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.336109 17258 log.cc:1199] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/42e8a5ee7d6a42aaaf95c33617abff3f
W20251025 08:02:34.336148 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_089d1f21fd52485da83680d50e16774a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.336321 17258 ts_tablet_manager.cc:1950] T 42e8a5ee7d6a42aaaf95c33617abff3f P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.336457 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 5bf286568e8343b7921ac256a9313e63 (table default.Table_a9afe52cc64243a295d043eb385ef7d9 [id=46383e9b028a4d2bb7b39e04f147491e]) successfully deleted
I20251025 08:02:34.336553 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 6a3ec64b273d4e8c92b1e24061ac7336 (table default.Table_22425928df99434c8c133707c8a809ef [id=79c76995e71143438cb6e30a9df85c31]) successfully deleted
I20251025 08:02:34.336696 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 8362e26d86d44e9780d3c78c6a468556 (table default.Table_5a29e7dba4ba43dfbd0c27981080a1ac [id=8611464429b848fbb277f6a03557cd0d]) successfully deleted
I20251025 08:02:34.336903 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 42e8a5ee7d6a42aaaf95c33617abff3f (table default.Table_5d847a37cb0c456294cb5137046f80bb [id=1f6784494d0b4b98b46077a0af6c2ea8]) successfully deleted
I20251025 08:02:34.336966 17594 raft_consensus.cc:515] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.337095 17258 tablet_replica.cc:333] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.337203 17258 raft_consensus.cc:2243] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.337275 17194 ts_tablet_manager.cc:1929] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.337340 17194 log.cc:1199] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/cc676245d2984363b4af1e817b444c3d
I20251025 08:02:34.337370 17258 raft_consensus.cc:2272] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.337576 17194 ts_tablet_manager.cc:1950] T cc676245d2984363b4af1e817b444c3d P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.337687 17258 ts_tablet_manager.cc:1916] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.337282 17594 leader_election.cc:290] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.337914 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet cc676245d2984363b4af1e817b444c3d (table default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8]) successfully deleted
I20251025 08:02:34.338017 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3cac2ac7463944549b5d235ed2e5a480" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:34.338107 15237 raft_consensus.cc:3060] T 3cac2ac7463944549b5d235ed2e5a480 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.338137 17194 tablet_replica.cc:333] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.338352 17194 raft_consensus.cc:2243] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.338519 17194 raft_consensus.cc:2272] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.338882 15237 raft_consensus.cc:2468] T 3cac2ac7463944549b5d235ed2e5a480 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:34.339426 14914 leader_election.cc:304] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.339629 17594 raft_consensus.cc:2804] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.339747 17594 raft_consensus.cc:697] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:34.339879 17258 ts_tablet_manager.cc:1929] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.339871 17594 consensus_queue.cc:237] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.340013 17258 log.cc:1199] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/f426e93af38e4e17b30cd01eea12dcac
I20251025 08:02:34.340282 17258 ts_tablet_manager.cc:1950] T f426e93af38e4e17b30cd01eea12dcac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:34.330760 15049 leader_election.cc:343] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.339591 17194 ts_tablet_manager.cc:1916] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:34.340453 17719 log.cc:927] Time spent T 45a22457031a4eff8e82fa232b6f05bb P e51a2be794f04642b89386067ecbc77e: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
W20251025 08:02:34.340579 15049 leader_election.cc:343] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.340721 17537 raft_consensus.cc:493] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251025 08:02:34.339794 17718 log.cc:927] Time spent T ff15c6e28a794271ac61ca111d66a06e P e51a2be794f04642b89386067ecbc77e: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
I20251025 08:02:34.340787 17537 raft_consensus.cc:515] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.340830 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet f426e93af38e4e17b30cd01eea12dcac (table default.Table_1d154c130315454cad4d9f3ea6bdd9b2 [id=a1ed1a0c27ef42c69acd197420340d7d]) successfully deleted
W20251025 08:02:34.325246 15048 leader_election.cc:343] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.340992 15048 leader_election.cc:304] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.341074 17537 leader_election.cc:290] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.341133 17537 raft_consensus.cc:2749] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.341238 15048 leader_election.cc:304] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.341483 15642 raft_consensus.cc:2804] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.341534 15642 raft_consensus.cc:493] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.341569 15642 raft_consensus.cc:3060] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.341775 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8bc7a0419e84a19a0349d0b7d63f174" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.342474 15642 raft_consensus.cc:515] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:34.342545 15049 leader_election.cc:343] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.342772 15642 leader_election.cc:290] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:34.343346 15049 leader_election.cc:343] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: be8d6685c70c4219947df30f023a59b8
I20251025 08:02:34.343477 17194 ts_tablet_manager.cc:1929] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.343350 15048 leader_election.cc:304] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.343657 17194 log.cc:1199] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/f426e93af38e4e17b30cd01eea12dcac
I20251025 08:02:34.344188 17194 ts_tablet_manager.cc:1950] T f426e93af38e4e17b30cd01eea12dcac P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.344574 15642 raft_consensus.cc:2749] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.344713 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet f426e93af38e4e17b30cd01eea12dcac (table default.Table_1d154c130315454cad4d9f3ea6bdd9b2 [id=a1ed1a0c27ef42c69acd197420340d7d]) successfully deleted
I20251025 08:02:34.345028 17194 tablet_replica.cc:333] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.345295 17194 raft_consensus.cc:2243] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.345875 17194 raft_consensus.cc:2272] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:34.346522 15048 leader_election.cc:343] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 6c582efa6d334a06a48e2f2b94167776
I20251025 08:02:34.346588 15048 leader_election.cc:304] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:34.346662 15048 raft_consensus.cc:2686] T 6c582efa6d334a06a48e2f2b94167776 P e51a2be794f04642b89386067ecbc77e: unable to run election callback: Service unavailable: Thread pool token was shut down
W20251025 08:02:34.346932 15048 leader_election.cc:343] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.346997 15048 leader_election.cc:304] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.347887 17198 ts_tablet_manager.cc:1929] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20251025 08:02:34.350471 16390 tablet_bootstrap.cc:492] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.350561 16390 ts_tablet_manager.cc:1403] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.000s
I20251025 08:02:34.351003 16390 raft_consensus.cc:359] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.351086 16390 raft_consensus.cc:385] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.351116 16390 raft_consensus.cc:740] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.351219 16390 consensus_queue.cc:260] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.351466 16390 ts_tablet_manager.cc:1434] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:34.351608 16390 tablet_bootstrap.cc:492] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.352357 16390 tablet_bootstrap.cc:654] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.350787 15642 raft_consensus.cc:2749] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.351303 17537 consensus_queue.cc:1048] T adb2c77ec9b84fe8846084cddc23888a P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:34.352386 15048 consensus_peers.cc:597] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d05bf0056dfc43eeb4105af559497bdc. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:34.352619 17198 log.cc:1199] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/f8576553f17b49f8bd11436ecac471ed
I20251025 08:02:34.354103 16280 master_service.cc:954] ReplaceTablet: received request to replace tablet cb2a4db00068482fb8d3b5313017e035 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.354084 17198 ts_tablet_manager.cc:1950] T f8576553f17b49f8bd11436ecac471ed P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.355113 17198 tablet_replica.cc:333] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.355276 17198 raft_consensus.cc:2243] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.355382 17198 raft_consensus.cc:2272] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.355674 17198 ts_tablet_manager.cc:1916] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:34.355677 16279 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 6e08efb3c79041ae97ae37e289ccc8f4 has no consensus state
I20251025 08:02:34.355691 17274 tablet_bootstrap.cc:492] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.355794 17274 ts_tablet_manager.cc:1403] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.072s user 0.002s sys 0.000s
I20251025 08:02:34.356161 17274 raft_consensus.cc:359] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.356247 17274 raft_consensus.cc:385] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.356276 17274 raft_consensus.cc:740] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.356388 17274 consensus_queue.cc:260] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.356264 17194 ts_tablet_manager.cc:1916] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.356658 17274 ts_tablet_manager.cc:1434] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.356823 17274 tablet_bootstrap.cc:492] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.357597 17274 tablet_bootstrap.cc:654] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:34.354758 15048 leader_election.cc:343] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.358426 15048 leader_election.cc:304] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.358548 17537 raft_consensus.cc:2749] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.358948 16391 tablet_bootstrap.cc:492] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.359035 16391 ts_tablet_manager.cc:1403] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
W20251025 08:02:34.359269 15048 leader_election.cc:343] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.359319 15048 leader_election.cc:304] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:34.359381 15048 raft_consensus.cc:2686] T 1e248b8303b1498e96178d4e46ad691e P e51a2be794f04642b89386067ecbc77e: unable to run election callback: Service unavailable: Thread pool token was shut down
I20251025 08:02:34.359578 16391 raft_consensus.cc:359] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.359664 16391 raft_consensus.cc:385] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.359695 16391 raft_consensus.cc:740] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.359807 16391 consensus_queue.cc:260] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.360129 16391 ts_tablet_manager.cc:1434] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.360212 14915 leader_election.cc:304] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.360275 16391 tablet_bootstrap.cc:492] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.360563 17415 raft_consensus.cc:3060] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.361493 17415 raft_consensus.cc:2749] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.362828 17595 raft_consensus.cc:493] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.362895 17595 raft_consensus.cc:515] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.363163 17595 leader_election.cc:290] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.363785 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adb2c77ec9b84fe8846084cddc23888a" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.364430 15642 raft_consensus.cc:493] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.364506 15642 raft_consensus.cc:515] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.364759 15642 leader_election.cc:290] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.365175 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12a6b5f9ed8041e9929c9f1673ac212a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:34.365545 15049 leader_election.cc:343] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.365947 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aae693881f9d40c789d242c6de5d9905" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.366271 17595 raft_consensus.cc:493] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.366346 17595 raft_consensus.cc:515] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.366664 17595 leader_election.cc:290] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.367251 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc62afd62257471e8590d28e49a50cb2" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.367466 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 16f1ab00a20345a1bb51e685b3fc6c70 (table default.Table_9419360c7ef742d196d6ac96f41241f1 [id=31777251b0174ff684a84b14f630d643]) successfully deleted
I20251025 08:02:34.369505 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0de3ec67dcc4e41a447338869076314" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.369655 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 1820be622ead4fd88437c79d95b34caf
I20251025 08:02:34.370134 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 1820be622ead4fd88437c79d95b34caf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
W20251025 08:02:34.370473 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 1820be622ead4fd88437c79d95b34caf because the tablet was not found. No further retry: Not found: Tablet not found: 1820be622ead4fd88437c79d95b34caf
I20251025 08:02:34.370491 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 1820be622ead4fd88437c79d95b34caf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.370579 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f141107d4674690acd51e499bc4e208" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.371023 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "334015a0a5aa42c8b127d64e794c2705" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.372200 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 8b6ae6527fd64c3bb5999dec97db861d (table default.Table_599c0d46a95d45b4aa9bab3b54b52470 [id=b8e6ffed1a2e442db3c9ee5ac1a6ff3d]) successfully deleted
I20251025 08:02:34.372061 17194 ts_tablet_manager.cc:1929] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.372383 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet ed5ed91e953d42afa9ebf9ab8b89d0e6 (table default.Table_a901c364849c4301910d7c32f0ec25fc [id=cadc2427db7c404cbbf9d3542145cccc]) successfully deleted
I20251025 08:02:34.372442 17194 log.cc:1199] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/42e8a5ee7d6a42aaaf95c33617abff3f
I20251025 08:02:34.372579 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 1e248b8303b1498e96178d4e46ad691e (table default.Table_64c962f064d64350a1fb6d539603c572 [id=766dd62ef84b4e56a871fbb018560a9f]) successfully deleted
I20251025 08:02:34.373847 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet f5f72ca8cfb94178a21619ddc9fc0352 (table default.Table_75b0519af19a461d8dd5bdfd0c7a50c5 [id=b73d5c5cd3824129b9efc54f3aa7c304]) successfully deleted
I20251025 08:02:34.373845 17194 ts_tablet_manager.cc:1950] T 42e8a5ee7d6a42aaaf95c33617abff3f P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.374454 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8bc7a0419e84a19a0349d0b7d63f174" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.374504 16390 tablet_bootstrap.cc:492] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.374562 16390 ts_tablet_manager.cc:1403] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.023s user 0.000s sys 0.001s
I20251025 08:02:34.374970 16390 raft_consensus.cc:359] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.375061 16390 raft_consensus.cc:385] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.375090 16390 raft_consensus.cc:740] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.375186 16390 consensus_queue.cc:260] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.375450 16390 ts_tablet_manager.cc:1434] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.375514 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 42e8a5ee7d6a42aaaf95c33617abff3f (table default.Table_5d847a37cb0c456294cb5137046f80bb [id=1f6784494d0b4b98b46077a0af6c2ea8]) successfully deleted
I20251025 08:02:34.375548 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "be8d6685c70c4219947df30f023a59b8" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:34.375605 16390 tablet_bootstrap.cc:492] T c8bc7a0419e84a19a0349d0b7d63f174 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.375625 14973 raft_consensus.cc:3060] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:34.376334 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 1820be622ead4fd88437c79d95b34caf because the tablet was not found. No further retry: Not found: Tablet not found: 1820be622ead4fd88437c79d95b34caf
I20251025 08:02:34.376420 14973 raft_consensus.cc:2468] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:34.376513 16390 tablet_bootstrap.cc:654] T c8bc7a0419e84a19a0349d0b7d63f174 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.376590 16385 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 1820be622ead4fd88437c79d95b34caf
I20251025 08:02:34.377259 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 1820be622ead4fd88437c79d95b34caf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.377907 17620 tablet.cc:1722] T e66c7b43490a4391a59e09f1832a53b3 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:34.378726 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 1820be622ead4fd88437c79d95b34caf because the tablet was not found. No further retry: Not found: Tablet not found: 1820be622ead4fd88437c79d95b34caf
I20251025 08:02:34.379788 16288 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet fc62afd62257471e8590d28e49a50cb2 (table default.Table_8527e07298754b1ab5eefd758ff1fe70 [id=f317f6ac536c45beb5e90ab9bd55ebe7]). Expected version 2 got 0
I20251025 08:02:34.381381 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3cac2ac7463944549b5d235ed2e5a480" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.381470 15110 raft_consensus.cc:2468] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:34.381804 17198 ts_tablet_manager.cc:1929] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.381860 17198 log.cc:1199] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/54de7e83e8ea42ef93218b0204c61ec6
I20251025 08:02:34.382071 17198 ts_tablet_manager.cc:1950] T 54de7e83e8ea42ef93218b0204c61ec6 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.382120 16282 catalog_manager.cc:5649] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:34.382284 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3cac2ac7463944549b5d235ed2e5a480" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:34.382364 15110 raft_consensus.cc:3060] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.382449 16282 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 3cac2ac7463944549b5d235ed2e5a480 (table default.Table_3b470b735ca242c9a8df091fc03ea60d [id=4e2fede2a3ad4c80b68f74b9ef40b72b]). Expected version 1 got 0
I20251025 08:02:34.382833 16282 catalog_manager.cc:5649] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:34.382963 16282 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet fc62afd62257471e8590d28e49a50cb2 (table default.Table_8527e07298754b1ab5eefd758ff1fe70 [id=f317f6ac536c45beb5e90ab9bd55ebe7]). Expected version 2 got 0
I20251025 08:02:34.383129 15110 raft_consensus.cc:2468] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:34.383837 16287 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 1ddb3795876b486e992b58cea711afb3
I20251025 08:02:34.383873 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "adb2c77ec9b84fe8846084cddc23888a" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.384368 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 1ddb3795876b486e992b58cea711afb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.384370 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "fc62afd62257471e8590d28e49a50cb2" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.384466 15110 raft_consensus.cc:2393] T fc62afd62257471e8590d28e49a50cb2 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:34.384543 17194 tablet_replica.cc:333] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.384706 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet a40c5721a4304345b471960ed1691930 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.384711 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 1ddb3795876b486e992b58cea711afb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.384835 17258 tablet_replica.cc:333] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.384881 17194 raft_consensus.cc:2243] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.384940 17258 raft_consensus.cc:2243] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.385039 17258 raft_consensus.cc:2272] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.385064 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "acb84bad2f75474faecd00432d187ccf" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.385161 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet bfdc6022cc5747439edcb8aa865b9437 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.385437 17198 tablet_replica.cc:333] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.385671 17194 raft_consensus.cc:2272] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.385478 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet fc5f892ca7a246a28a556fe0eb3f5442 with delete_type TABLET_DATA_DELETED (replaced by tablet e03e2e21e3f64bedb04c7e79aea6d49d) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.385443 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet c043ab70d7364e05b0b352ac5c416db1 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.385805 17258 ts_tablet_manager.cc:1916] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.385891 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 34c330b5dd544ae686f741cdd85d023d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.385171 15103 raft_consensus.cc:2393] T acb84bad2f75474faecd00432d187ccf P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:34.386848 17194 ts_tablet_manager.cc:1916] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.388072 17258 ts_tablet_manager.cc:1929] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.388420 17258 log.cc:1199] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/1ddb3795876b486e992b58cea711afb3
I20251025 08:02:34.388691 17258 ts_tablet_manager.cc:1950] T 1ddb3795876b486e992b58cea711afb3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.389523 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 1ddb3795876b486e992b58cea711afb3 (table default.Table_08013ca351ee49df9acad855462d7507 [id=8c00f3d93fc548109fc6a1893937d55b]) successfully deleted
I20251025 08:02:34.390398 16283 master_service.cc:954] ReplaceTablet: received request to replace tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.391737 16391 tablet_bootstrap.cc:654] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.385928 17198 raft_consensus.cc:2243] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.386157 15085 tablet_service.cc:1552] Processing DeleteTablet for tablet ff20cd7d33a440bab24bd4a61fff1f30 with delete_type TABLET_DATA_DELETED (replaced by tablet d20a130fc8ea40ddba509d2825ac028d) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.386330 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet cc676245d2984363b4af1e817b444c3d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.386356 15075 tablet_service.cc:1552] Processing DeleteTablet for tablet 42e8a5ee7d6a42aaaf95c33617abff3f with delete_type TABLET_DATA_DELETED (replaced by tablet f334665c1bc3418fb68d23e28c5de309) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.392458 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_42835d781d0b4b6fa5d1bc0662ffa85d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:34.392521 17198 raft_consensus.cc:2272] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.386379 15081 tablet_service.cc:1552] Processing DeleteTablet for tablet f426e93af38e4e17b30cd01eea12dcac with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.386401 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 1820be622ead4fd88437c79d95b34caf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.386445 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 47b0f93bac664a44989534097be9fd73 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:31 UTC) from {username='slave'} at 127.0.0.1:47284
W20251025 08:02:34.392796 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_42835d781d0b4b6fa5d1bc0662ffa85d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.386135 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 98baf6e8d8e84b42a83054495ae19e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.392828 17198 ts_tablet_manager.cc:1916] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.389930 17274 tablet_bootstrap.cc:492] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.393447 17274 ts_tablet_manager.cc:1403] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.000s
I20251025 08:02:34.393868 17274 raft_consensus.cc:359] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.393941 17274 raft_consensus.cc:385] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.393977 17274 raft_consensus.cc:740] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.394073 17274 consensus_queue.cc:260] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.394189 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_91cef80713834b28acb457e1592574da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:34.394320 17274 ts_tablet_manager.cc:1434] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.394482 17274 tablet_bootstrap.cc:492] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:34.394479 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_91cef80713834b28acb457e1592574da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.394547 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12a6b5f9ed8041e9929c9f1673ac212a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.395309 17274 tablet_bootstrap.cc:654] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.395314 17194 ts_tablet_manager.cc:1929] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.396983 16279 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_f5a86fbd3f5440aca8ae7f7f495a983a" } modify_external_catalogs: true
I20251025 08:02:34.397082 16279 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_f5a86fbd3f5440aca8ae7f7f495a983a" } modify_external_catalogs: true
I20251025 08:02:34.397658 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet f8576553f17b49f8bd11436ecac471ed (table default.Table_d80d24fe6db14f0da8149898449ae86e [id=2283253a9522485d93d6c484c5eef6e4]) successfully deleted
W20251025 08:02:34.398728 15048 leader_election.cc:343] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.398871 15048 leader_election.cc:304] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.398978 17537 raft_consensus.cc:2749] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:34.399200 15048 leader_election.cc:343] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.399260 15048 leader_election.cc:304] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.400193 17537 raft_consensus.cc:2749] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.397197 14915 leader_election.cc:304] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.400323 17537 raft_consensus.cc:493] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.400375 17537 raft_consensus.cc:515] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.400655 17537 leader_election.cc:290] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.400784 14915 leader_election.cc:304] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.400942 14915 leader_election.cc:304] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.401232 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9ecb15be5f5c48f1bd68e56b65543fad" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.401288 17415 raft_consensus.cc:2749] T adb2c77ec9b84fe8846084cddc23888a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251025 08:02:34.401451 17415 raft_consensus.cc:3060] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:34.401609 15049 leader_election.cc:343] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:34.401822 15048 leader_election.cc:343] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.402220 15048 leader_election.cc:304] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.402230 17415 raft_consensus.cc:2749] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.402318 17415 raft_consensus.cc:3060] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.402424 17537 raft_consensus.cc:2749] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:34.402637 15048 leader_election.cc:343] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.403005 15048 leader_election.cc:304] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.403025 17415 raft_consensus.cc:2749] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.403149 17537 raft_consensus.cc:2749] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.402953 17198 ts_tablet_manager.cc:1929] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.404110 17198 log.cc:1199] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/e2b014e0f49c4f7da8e65b7d4c98ea63
I20251025 08:02:34.404536 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 54de7e83e8ea42ef93218b0204c61ec6 (table default.Table_197dba326ac544d29c90a004200413bc [id=26a6f00041d04924b3e8eb2b279b55de]) successfully deleted
I20251025 08:02:34.404567 17198 ts_tablet_manager.cc:1950] T e2b014e0f49c4f7da8e65b7d4c98ea63 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.404807 17198 tablet_replica.cc:333] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.405133 17198 raft_consensus.cc:2243] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.405786 17198 raft_consensus.cc:2272] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.406287 16391 tablet_bootstrap.cc:492] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.406366 16391 ts_tablet_manager.cc:1403] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.000s
I20251025 08:02:34.406787 16391 raft_consensus.cc:359] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.406874 16391 raft_consensus.cc:385] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.406903 16391 raft_consensus.cc:740] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.406996 16391 consensus_queue.cc:260] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.407256 16391 ts_tablet_manager.cc:1434] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.407397 16391 tablet_bootstrap.cc:492] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.408102 16391 tablet_bootstrap.cc:654] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.405675 17274 tablet_bootstrap.cc:492] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.409066 17274 ts_tablet_manager.cc:1403] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20251025 08:02:34.409448 17274 raft_consensus.cc:359] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.409530 17274 raft_consensus.cc:385] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.409554 17274 raft_consensus.cc:740] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.409658 17274 consensus_queue.cc:260] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.409863 17274 ts_tablet_manager.cc:1434] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.410018 17274 tablet_bootstrap.cc:492] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.411264 16285 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_7fdb9c6661e241b6a185030c3593d5e2" } new_table_name: "default.Table_633e3770c2064baeabedfed4d971e698" modify_external_catalogs: true
I20251025 08:02:34.411468 17537 raft_consensus.cc:493] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f2f8ce3e9f4d9ba3f3f02813397c31)
I20251025 08:02:34.411543 17537 raft_consensus.cc:515] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.411811 17537 leader_election.cc:290] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.412595 16280 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet cb2a4db00068482fb8d3b5313017e035
I20251025 08:02:34.413053 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet cb2a4db00068482fb8d3b5313017e035 with delete_type TABLET_DATA_DELETED (replaced by tablet 81efa2a0e62e4e50b6f2a86d000c194d) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.413345 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d049bf946c744664aba74d7a12fa4ff1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.413443 15237 raft_consensus.cc:2468] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 2.
I20251025 08:02:34.413652 15049 leader_election.cc:304] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.413776 17537 raft_consensus.cc:2804] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20251025 08:02:34.413815 17537 raft_consensus.cc:493] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election (detected failure of leader f0f2f8ce3e9f4d9ba3f3f02813397c31)
I20251025 08:02:34.413849 17537 raft_consensus.cc:3060] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Advancing to term 2
I20251025 08:02:34.414427 16280 catalog_manager.cc:6719] ReplaceTablet: tablet cb2a4db00068482fb8d3b5313017e035 deleted and replaced by tablet 81efa2a0e62e4e50b6f2a86d000c194d
I20251025 08:02:34.414876 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet cb2a4db00068482fb8d3b5313017e035 with delete_type TABLET_DATA_DELETED (replaced by tablet 81efa2a0e62e4e50b6f2a86d000c194d) from {username='slave'} at 127.0.0.1:42704
W20251025 08:02:34.415292 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet cb2a4db00068482fb8d3b5313017e035 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb2a4db00068482fb8d3b5313017e035 already in progress: creating tablet
I20251025 08:02:34.415844 17537 raft_consensus.cc:515] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.416159 17537 leader_election.cc:290] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.396517 17194 log.cc:1199] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/1ddb3795876b486e992b58cea711afb3
I20251025 08:02:34.416594 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d049bf946c744664aba74d7a12fa4ff1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:34.417055 17194 ts_tablet_manager.cc:1950] T 1ddb3795876b486e992b58cea711afb3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.417515 15237 raft_consensus.cc:2468] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 2.
I20251025 08:02:34.417836 15049 leader_election.cc:304] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.418215 15642 raft_consensus.cc:2804] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 2 FOLLOWER]: Leader election won for term 2
I20251025 08:02:34.418300 15642 raft_consensus.cc:697] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [term 2 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:34.418412 15642 consensus_queue.cc:237] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.419152 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 1ddb3795876b486e992b58cea711afb3 (table default.Table_08013ca351ee49df9acad855462d7507 [id=8c00f3d93fc548109fc6a1893937d55b]) successfully deleted
W20251025 08:02:34.419528 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet cb2a4db00068482fb8d3b5313017e035 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb2a4db00068482fb8d3b5313017e035 already in progress: creating tablet
I20251025 08:02:34.420199 17274 tablet_bootstrap.cc:654] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:34.404279 15048 leader_election.cc:343] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.424949 15048 leader_election.cc:304] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.425334 17537 raft_consensus.cc:2749] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.425827 16572 consensus_queue.cc:1048] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.426729 15048 leader_election.cc:304] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.426925 17537 raft_consensus.cc:2804] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.427064 17537 raft_consensus.cc:697] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:34.427165 17537 consensus_queue.cc:237] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.427799 16287 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_215d6056104143a2a5c44b771c493865" } new_table_name: "default.Table_032e28c0e4594f2ea18bdab45b1ed067" modify_external_catalogs: true
I20251025 08:02:34.427961 16284 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 3cac2ac7463944549b5d235ed2e5a480 (table default.Table_3b470b735ca242c9a8df091fc03ea60d [id=4e2fede2a3ad4c80b68f74b9ef40b72b]). Expected version 1 got 0
W20251025 08:02:34.428119 15048 leader_election.cc:343] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.428082 16284 catalog_manager.cc:5649] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:34.428177 15048 leader_election.cc:304] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.428256 16284 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 88a76d187fae4f09ac879b72e9c05a86 (table default.Table_8d621c2f449e477ab01d1b67dc869408 [id=d318bca8bf144870aa5529426cfa9995]). Expected version 1 got 0
I20251025 08:02:34.428287 15642 raft_consensus.cc:2749] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.428656 17198 ts_tablet_manager.cc:1916] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.428778 16288 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_5e5050bacd5543229399a2924609ae9c [id=4644ba57f12f4ad4bf7e89f80c4cd161] alter complete (version 1)
W20251025 08:02:34.429141 15048 consensus_peers.cc:597] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2be36d176bf34fb6bd3c70b42af15cc9. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:34.430317 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "9ecb15be5f5c48f1bd68e56b65543fad" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.430831 15642 raft_consensus.cc:493] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.430853 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d049bf946c744664aba74d7a12fa4ff1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.430913 15642 raft_consensus.cc:515] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.430971 14973 raft_consensus.cc:2393] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 2: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:34.431192 15642 leader_election.cc:290] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.431654 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c614480578945839a6662bafc62726c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:34.431984 15049 leader_election.cc:343] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.432739 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d049bf946c744664aba74d7a12fa4ff1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:34.432854 14973 raft_consensus.cc:2393] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e51a2be794f04642b89386067ecbc77e in current term 2: Already voted for candidate ab02c9d78a9d42f193755d436c8d44b2 in this term.
I20251025 08:02:34.433318 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet e2b014e0f49c4f7da8e65b7d4c98ea63 (table default.Table_5228048f3783458dbb44280a7a6e4816 [id=7fe739c2f676459d8c73632266babedb]) successfully deleted
W20251025 08:02:34.434062 15049 consensus_peers.cc:597] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2be36d176bf34fb6bd3c70b42af15cc9. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:34.433591 16280 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_1029c610ee7e4b2a93f661c8a47f4e97"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.434731 16280 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1029c610ee7e4b2a93f661c8a47f4e97 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.435570 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff
I20251025 08:02:34.435953 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff with delete_type TABLET_DATA_DELETED (replaced by tablet 497152224ddc48c8aa0be0e83f417794) from {username='slave'} at 127.0.0.1:41762
W20251025 08:02:34.436292 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff already in progress: creating tablet
I20251025 08:02:34.436508 16283 catalog_manager.cc:6719] ReplaceTablet: tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff deleted and replaced by tablet 497152224ddc48c8aa0be0e83f417794
I20251025 08:02:34.436759 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff with delete_type TABLET_DATA_DELETED (replaced by tablet 497152224ddc48c8aa0be0e83f417794) from {username='slave'} at 127.0.0.1:42704
W20251025 08:02:34.437203 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff already in progress: creating tablet
I20251025 08:02:34.438275 15162 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:34.438879 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 1ddb3795876b486e992b58cea711afb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.439009 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet cb2a4db00068482fb8d3b5313017e035 with delete_type TABLET_DATA_DELETED (replaced by tablet 81efa2a0e62e4e50b6f2a86d000c194d) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.439106 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff with delete_type TABLET_DATA_DELETED (replaced by tablet 497152224ddc48c8aa0be0e83f417794) from {username='slave'} at 127.0.0.1:47284
W20251025 08:02:34.440951 16285 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d6cbe1616ced4f47999a6a1365af0092 consensus state has no leader
I20251025 08:02:34.440997 16286 master_service.cc:954] ReplaceTablet: received request to replace tablet 4bb463fc8b104a87b5503bfc2467a23e from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.442008 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 1820be622ead4fd88437c79d95b34caf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
W20251025 08:02:34.442292 15048 leader_election.cc:343] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.442358 15048 leader_election.cc:304] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
W20251025 08:02:34.442363 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 1820be622ead4fd88437c79d95b34caf because the tablet was not found. No further retry: Not found: Tablet not found: 1820be622ead4fd88437c79d95b34caf
I20251025 08:02:34.442457 15642 raft_consensus.cc:2749] T 9ecb15be5f5c48f1bd68e56b65543fad P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.442606 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 20be8395f3e14834b9a73c8f356bfcf8 (DEFAULT_TABLE table=default.Table_70d3bae6c09d4f1991a55be992847626 [id=1b4ea9929cb8413c9ab07c458d9f3b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.442831 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20be8395f3e14834b9a73c8f356bfcf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.443082 17198 ts_tablet_manager.cc:1929] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.443166 17198 log.cc:1199] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/17339d7c0a4b40a78b3252d17481c192
I20251025 08:02:34.443404 17198 ts_tablet_manager.cc:1950] T 17339d7c0a4b40a78b3252d17481c192 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.443656 16279 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 5564705a3771425da1f33830e7b51e03
I20251025 08:02:34.444268 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c614480578945839a6662bafc62726c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.444466 17198 tablet_replica.cc:333] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.444732 17198 raft_consensus.cc:2243] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.444931 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 5564705a3771425da1f33830e7b51e03 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.445529 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 5564705a3771425da1f33830e7b51e03 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.445765 17194 tablet_replica.cc:333] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.445886 17194 raft_consensus.cc:2243] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.445999 17258 tablet_replica.cc:333] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.446007 17194 raft_consensus.cc:2272] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.446115 17258 raft_consensus.cc:2243] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.446221 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 20be8395f3e14834b9a73c8f356bfcf8 (DEFAULT_TABLE table=default.Table_70d3bae6c09d4f1991a55be992847626 [id=1b4ea9929cb8413c9ab07c458d9f3b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.446316 17258 raft_consensus.cc:2272] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.446455 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20be8395f3e14834b9a73c8f356bfcf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.446795 17258 ts_tablet_manager.cc:1916] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.446839 17194 ts_tablet_manager.cc:1916] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.448828 17194 ts_tablet_manager.cc:1929] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.448895 17194 log.cc:1199] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/5564705a3771425da1f33830e7b51e03
I20251025 08:02:34.449160 17194 ts_tablet_manager.cc:1950] T 5564705a3771425da1f33830e7b51e03 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.449442 17258 ts_tablet_manager.cc:1929] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.449537 17258 log.cc:1199] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/5564705a3771425da1f33830e7b51e03
I20251025 08:02:34.449630 14957 tablet_service.cc:1505] Processing CreateTablet for tablet c9ff8f2f71764bc6bb141916370d0905 (DEFAULT_TABLE table=default.Table_f84c2db0d0cf48058a70b69d1213c90b [id=9d2a5ddfa0094b4186554bed46f6712f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.449771 17258 ts_tablet_manager.cc:1950] T 5564705a3771425da1f33830e7b51e03 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.449843 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ff8f2f71764bc6bb141916370d0905. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.450090 17198 raft_consensus.cc:2272] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.450371 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 5564705a3771425da1f33830e7b51e03 (table default.Table_f5a86fbd3f5440aca8ae7f7f495a983a [id=ec9b64d93dfc44a29aae35e6b02e2fe8]) successfully deleted
W20251025 08:02:34.450662 15048 leader_election.cc:343] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.450736 15048 leader_election.cc:304] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.450855 17537 raft_consensus.cc:2749] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.451031 17198 ts_tablet_manager.cc:1916] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.451557 17731 raft_consensus.cc:493] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.451627 17731 raft_consensus.cc:515] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.451817 16572 raft_consensus.cc:493] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.451879 16572 raft_consensus.cc:515] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.451959 17731 leader_election.cc:290] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.452208 16572 leader_election.cc:290] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.452438 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5027b80220e34f5f8e1e8e8479ec41f3" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.452544 14973 raft_consensus.cc:2468] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:34.452612 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 5564705a3771425da1f33830e7b51e03 (table default.Table_f5a86fbd3f5440aca8ae7f7f495a983a [id=ec9b64d93dfc44a29aae35e6b02e2fe8]) successfully deleted
I20251025 08:02:34.452716 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a4b060efd054726b07702b691876147" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.452831 15237 raft_consensus.cc:2468] T 2a4b060efd054726b07702b691876147 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:34.453017 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5027b80220e34f5f8e1e8e8479ec41f3" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.453112 15110 raft_consensus.cc:2468] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:34.453125 14914 leader_election.cc:304] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.453384 15185 leader_election.cc:304] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.453423 17730 raft_consensus.cc:2804] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.453485 17730 raft_consensus.cc:493] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.453531 17730 raft_consensus.cc:3060] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.454463 17730 raft_consensus.cc:515] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.454777 17730 leader_election.cc:290] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.454900 16572 raft_consensus.cc:2804] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.454945 16572 raft_consensus.cc:493] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.454995 16572 raft_consensus.cc:3060] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.455775 16572 raft_consensus.cc:515] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.456012 17316 raft_consensus.cc:493] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.456087 16572 leader_election.cc:290] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.456074 17316 raft_consensus.cc:515] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.456324 17316 leader_election.cc:290] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.456684 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29b4798bac204280b9c56ebb0f44302d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.456786 14979 raft_consensus.cc:2468] T 29b4798bac204280b9c56ebb0f44302d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:34.456885 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 1820be622ead4fd88437c79d95b34caf with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.456951 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5027b80220e34f5f8e1e8e8479ec41f3" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:34.456949 15110 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5027b80220e34f5f8e1e8e8479ec41f3" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:34.457019 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 5564705a3771425da1f33830e7b51e03 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.457038 14974 raft_consensus.cc:3060] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.457053 15110 raft_consensus.cc:3060] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.457253 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 20be8395f3e14834b9a73c8f356bfcf8 (DEFAULT_TABLE table=default.Table_70d3bae6c09d4f1991a55be992847626 [id=1b4ea9929cb8413c9ab07c458d9f3b5c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.457448 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20be8395f3e14834b9a73c8f356bfcf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.457875 14974 raft_consensus.cc:2468] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:34.457885 15110 raft_consensus.cc:2468] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:34.458041 15114 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a4b060efd054726b07702b691876147" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:34.458114 15114 raft_consensus.cc:3060] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.458747 16391 tablet_bootstrap.cc:492] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.458820 16391 ts_tablet_manager.cc:1403] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.051s user 0.001s sys 0.000s
I20251025 08:02:34.458940 15114 raft_consensus.cc:2468] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:34.459218 15185 leader_election.cc:304] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.459204 16391 raft_consensus.cc:359] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.459300 16391 raft_consensus.cc:385] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.459329 16391 raft_consensus.cc:740] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.459336 15112 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a4b060efd054726b07702b691876147" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.459441 15112 raft_consensus.cc:2376] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1. Re-sending same reply.
I20251025 08:02:34.459437 16391 consensus_queue.cc:260] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.459704 16391 ts_tablet_manager.cc:1434] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.459873 16391 tablet_bootstrap.cc:492] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.459955 17372 raft_consensus.cc:2804] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.460074 17372 raft_consensus.cc:697] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:34.460176 17372 consensus_queue.cc:237] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.460829 16391 tablet_bootstrap.cc:654] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.462625 15183 leader_election.cc:304] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.462708 14915 leader_election.cc:304] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:34.463150 17369 raft_consensus.cc:2804] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.463167 17415 raft_consensus.cc:2804] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.463199 17369 raft_consensus.cc:493] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.463234 17369 raft_consensus.cc:3060] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.463241 17415 raft_consensus.cc:697] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:34.463347 17415 consensus_queue.cc:237] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.464071 17369 raft_consensus.cc:515] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.464382 17369 leader_election.cc:290] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.464813 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29b4798bac204280b9c56ebb0f44302d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:34.456889 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29b4798bac204280b9c56ebb0f44302d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.464913 14974 raft_consensus.cc:3060] T 29b4798bac204280b9c56ebb0f44302d P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.464936 14979 raft_consensus.cc:3060] T cfe93efc1a0c4dda95b5c2e58cdcec82 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.464988 15109 raft_consensus.cc:2468] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:34.465751 14974 raft_consensus.cc:2468] T 29b4798bac204280b9c56ebb0f44302d P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:34.466082 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2a4b060efd054726b07702b691876147" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:34.466179 15237 raft_consensus.cc:3060] T 2a4b060efd054726b07702b691876147 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.466270 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "29b4798bac204280b9c56ebb0f44302d" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:34.466357 15107 raft_consensus.cc:3060] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.467036 15237 raft_consensus.cc:2468] T 2a4b060efd054726b07702b691876147 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:34.467249 15107 raft_consensus.cc:2468] T 29b4798bac204280b9c56ebb0f44302d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:34.467326 17316 consensus_queue.cc:1048] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.467504 15185 leader_election.cc:304] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.467767 17316 raft_consensus.cc:2804] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.467839 17316 raft_consensus.cc:697] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:34.467927 17316 consensus_queue.cc:237] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.455042 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 17339d7c0a4b40a78b3252d17481c192 (table default.Table_c72833b153cc441eaeff12a70a584954 [id=9d0d9b47103a483391be7124c1064a33]) successfully deleted
I20251025 08:02:34.469739 14957 tablet_service.cc:1505] Processing CreateTablet for tablet f7a9291597694d99abb0aa868aa288b5 (DEFAULT_TABLE table=default.Table_6cb8acd51e814a82a5604f5c3b0aa5f2 [id=5fb5a822ed9b40a3b49576d27be3e91c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.470577 15223 tablet_service.cc:1505] Processing CreateTablet for tablet c9ff8f2f71764bc6bb141916370d0905 (DEFAULT_TABLE table=default.Table_f84c2db0d0cf48058a70b69d1213c90b [id=9d2a5ddfa0094b4186554bed46f6712f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.470732 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a9291597694d99abb0aa868aa288b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.470786 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ff8f2f71764bc6bb141916370d0905. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.472723 15215 tablet_service.cc:1505] Processing CreateTablet for tablet f7a9291597694d99abb0aa868aa288b5 (DEFAULT_TABLE table=default.Table_6cb8acd51e814a82a5604f5c3b0aa5f2 [id=5fb5a822ed9b40a3b49576d27be3e91c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.472918 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a9291597694d99abb0aa868aa288b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.473222 15089 tablet_service.cc:1505] Processing CreateTablet for tablet c9ff8f2f71764bc6bb141916370d0905 (DEFAULT_TABLE table=default.Table_f84c2db0d0cf48058a70b69d1213c90b [id=9d2a5ddfa0094b4186554bed46f6712f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.473415 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ff8f2f71764bc6bb141916370d0905. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.475402 17373 consensus_queue.cc:1048] T cfe93efc1a0c4dda95b5c2e58cdcec82 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.477012 17198 ts_tablet_manager.cc:1929] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.477120 17198 log.cc:1199] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/2f64072c416f4a77b1c81855d7db8f01
I20251025 08:02:34.477463 17198 ts_tablet_manager.cc:1950] T 2f64072c416f4a77b1c81855d7db8f01 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.478816 17198 tablet_replica.cc:333] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.479643 17198 raft_consensus.cc:2243] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.480301 17198 raft_consensus.cc:2272] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.480901 17198 ts_tablet_manager.cc:1916] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.481729 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 2f64072c416f4a77b1c81855d7db8f01 (table default.Table_b9669fd414104dcca80167117a5b0ed7 [id=431195fe6a3847caa5b39d62cb399ffb]) successfully deleted
I20251025 08:02:34.483367 17369 consensus_queue.cc:1048] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.485464 15642 raft_consensus.cc:493] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.485484 16279 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_99a55c635acb4fcb8bc04dda7e713648"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:34.485534 15642 raft_consensus.cc:515] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:34.485783 16279 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_99a55c635acb4fcb8bc04dda7e713648 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.485834 15642 leader_election.cc:290] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.486414 16286 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 4bb463fc8b104a87b5503bfc2467a23e
I20251025 08:02:34.486689 16286 catalog_manager.cc:6719] ReplaceTablet: tablet 4bb463fc8b104a87b5503bfc2467a23e deleted and replaced by tablet 65f28f3dc42d46688c646e8573dc6ee4
I20251025 08:02:34.487610 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet 4bb463fc8b104a87b5503bfc2467a23e with delete_type TABLET_DATA_DELETED (replaced by tablet 65f28f3dc42d46688c646e8573dc6ee4) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.487767 17194 tablet_replica.cc:333] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.487859 16287 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_434df4d622c74c6f89f7b7373096fb5f" } new_table_name: "default.Table_a1711629a1364ff6b063997c7237c385" modify_external_catalogs: true
I20251025 08:02:34.487895 17194 raft_consensus.cc:2243] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.487998 17194 raft_consensus.cc:2272] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.488298 17194 ts_tablet_manager.cc:1916] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.488709 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4bf7ad8c26a42c5a2704bc005062ea3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.488766 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_397376f0721d44dda0d0affaf2f33ecc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.489025 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_397376f0721d44dda0d0affaf2f33ecc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:34.489049 15049 leader_election.cc:343] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.489830 16288 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_e7e4f555b1d140ef907741daae26ce2b [id=a8e0504bc08744b4915157fa63d2226e] alter complete (version 1)
I20251025 08:02:34.490443 15297 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:34.490459 17194 ts_tablet_manager.cc:1929] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.490517 17194 log.cc:1199] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/4bb463fc8b104a87b5503bfc2467a23e
I20251025 08:02:34.490746 17194 ts_tablet_manager.cc:1950] T 4bb463fc8b104a87b5503bfc2467a23e P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.491372 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 4bb463fc8b104a87b5503bfc2467a23e (table default.Table_5fe5289f69bd4a458aced0607d8247fa [id=cfa501bfaffb4d95893a0cd10caedcb4]) successfully deleted
I20251025 08:02:34.491518 14956 tablet_service.cc:1552] Processing DeleteTablet for tablet 98baf6e8d8e84b42a83054495ae19e01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.491629 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet be8d6685c70c4219947df30f023a59b8 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.491755 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet b4a6f2b64c994f3abefef9724911a5fc with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.491874 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 1ddb3795876b486e992b58cea711afb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.492120 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet 4bb463fc8b104a87b5503bfc2467a23e with delete_type TABLET_DATA_DELETED (replaced by tablet 65f28f3dc42d46688c646e8573dc6ee4) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.492292 17258 tablet_replica.cc:333] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.492401 17258 raft_consensus.cc:2243] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.492568 17258 raft_consensus.cc:2272] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.492887 17258 ts_tablet_manager.cc:1916] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.493070 16288 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_c5c036d7c66344eba94e15be432088bc" } new_table_name: "default.Table_f552b897a1464486b3a9e4673bb641d4" modify_external_catalogs: true
I20251025 08:02:34.493783 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d4bf7ad8c26a42c5a2704bc005062ea3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.495672 17258 ts_tablet_manager.cc:1929] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.495740 17258 log.cc:1199] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/4bb463fc8b104a87b5503bfc2467a23e
I20251025 08:02:34.495967 17258 ts_tablet_manager.cc:1950] T 4bb463fc8b104a87b5503bfc2467a23e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.496587 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 4bb463fc8b104a87b5503bfc2467a23e (table default.Table_5fe5289f69bd4a458aced0607d8247fa [id=cfa501bfaffb4d95893a0cd10caedcb4]) successfully deleted
I20251025 08:02:34.497149 16280 catalog_manager.cc:5649] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:34.497350 16280 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 3cac2ac7463944549b5d235ed2e5a480 (table default.Table_3b470b735ca242c9a8df091fc03ea60d [id=4e2fede2a3ad4c80b68f74b9ef40b72b]). Expected version 1 got 0
I20251025 08:02:34.497550 16280 catalog_manager.cc:5649] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:34.497704 16280 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet 2a4b060efd054726b07702b691876147 (table default.Table_5f2746d8cc7341d9a30870387f129fa2 [id=846c344408284b8e8a0e5da1d328255d]). Expected version 1 got 0
W20251025 08:02:34.498975 15048 leader_election.cc:343] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.499046 15048 leader_election.cc:304] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.499245 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 4bb463fc8b104a87b5503bfc2467a23e with delete_type TABLET_DATA_DELETED (replaced by tablet 65f28f3dc42d46688c646e8573dc6ee4) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.499859 17537 raft_consensus.cc:2749] T d4bf7ad8c26a42c5a2704bc005062ea3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.500394 17194 tablet_replica.cc:333] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.500591 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 6c5637e066954a2ba4f3749b4e0f559a (DEFAULT_TABLE table=default.Table_e23149a55e354b558401b5949cd4ce2b [id=7eb8386795ca45f782b408948403eb29]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.500663 17194 raft_consensus.cc:2243] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.500952 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5637e066954a2ba4f3749b4e0f559a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.501070 17194 raft_consensus.cc:2272] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.501713 17194 ts_tablet_manager.cc:1916] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.503448 15089 tablet_service.cc:1505] Processing CreateTablet for tablet f7a9291597694d99abb0aa868aa288b5 (DEFAULT_TABLE table=default.Table_6cb8acd51e814a82a5604f5c3b0aa5f2 [id=5fb5a822ed9b40a3b49576d27be3e91c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.503588 16391 tablet_bootstrap.cc:492] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.503666 16391 ts_tablet_manager.cc:1403] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.044s user 0.001s sys 0.000s
I20251025 08:02:34.503667 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a9291597694d99abb0aa868aa288b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.503991 16391 raft_consensus.cc:359] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.504086 16391 raft_consensus.cc:385] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.504112 16391 raft_consensus.cc:740] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.504196 16391 consensus_queue.cc:260] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.504408 16391 ts_tablet_manager.cc:1434] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.504532 16391 tablet_bootstrap.cc:492] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.505252 16391 tablet_bootstrap.cc:654] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.506114 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 6c5637e066954a2ba4f3749b4e0f559a (DEFAULT_TABLE table=default.Table_e23149a55e354b558401b5949cd4ce2b [id=7eb8386795ca45f782b408948403eb29]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.506363 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5637e066954a2ba4f3749b4e0f559a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.506964 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 100b323438314ebd91a9c4f4684ced3a (DEFAULT_TABLE table=default.Table_5afcc0049e364501bce48333c6697692 [id=a984dd0353274e49b8591f42912de25b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.507202 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100b323438314ebd91a9c4f4684ced3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.507220 17731 raft_consensus.cc:493] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.507288 17731 raft_consensus.cc:515] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.507580 17731 leader_election.cc:290] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.508345 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 1b8208c72f1c472faaa49a4561d0b3af (DEFAULT_TABLE table=default.Table_48ddda8a36684d438ecffce1ea4dc2d1 [id=56940eabc0444a4f9778e2efce1aff18]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.508594 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8208c72f1c472faaa49a4561d0b3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.509307 15224 tablet_service.cc:1505] Processing CreateTablet for tablet dfe5c16d330b4b428a00e7b8e2297c9b (DEFAULT_TABLE table=default.Table_39b16d4513794370a809c027496a8357 [id=81ce403333f84efa95eb02b6dc5694f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.509510 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfe5c16d330b4b428a00e7b8e2297c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.510423 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 6c5637e066954a2ba4f3749b4e0f559a (DEFAULT_TABLE table=default.Table_e23149a55e354b558401b5949cd4ce2b [id=7eb8386795ca45f782b408948403eb29]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.510646 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c5637e066954a2ba4f3749b4e0f559a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.511132 15081 tablet_service.cc:1505] Processing CreateTablet for tablet dfe5c16d330b4b428a00e7b8e2297c9b (DEFAULT_TABLE table=default.Table_39b16d4513794370a809c027496a8357 [id=81ce403333f84efa95eb02b6dc5694f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.511340 15081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfe5c16d330b4b428a00e7b8e2297c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.512132 15218 tablet_service.cc:1505] Processing CreateTablet for tablet ba46d4b94db9478db3ff5ec6f097de1d (DEFAULT_TABLE table=default.Table_2eae5b9e44bc40acafb6a647bed4a4d9 [id=8e2953f9e67d440ca19f641988455cae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.512327 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba46d4b94db9478db3ff5ec6f097de1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.512593 16390 tablet_bootstrap.cc:492] T c8bc7a0419e84a19a0349d0b7d63f174 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.512670 16390 ts_tablet_manager.cc:1403] T c8bc7a0419e84a19a0349d0b7d63f174 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.137s user 0.001s sys 0.000s
I20251025 08:02:34.513078 16390 raft_consensus.cc:359] T c8bc7a0419e84a19a0349d0b7d63f174 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.513161 16390 raft_consensus.cc:385] T c8bc7a0419e84a19a0349d0b7d63f174 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.513188 16390 raft_consensus.cc:740] T c8bc7a0419e84a19a0349d0b7d63f174 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.513231 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 1b8208c72f1c472faaa49a4561d0b3af (DEFAULT_TABLE table=default.Table_48ddda8a36684d438ecffce1ea4dc2d1 [id=56940eabc0444a4f9778e2efce1aff18]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.513296 16390 consensus_queue.cc:260] T c8bc7a0419e84a19a0349d0b7d63f174 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.513408 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8208c72f1c472faaa49a4561d0b3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.513547 16390 ts_tablet_manager.cc:1434] T c8bc7a0419e84a19a0349d0b7d63f174 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.513693 16390 tablet_bootstrap.cc:492] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.513651 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 100b323438314ebd91a9c4f4684ced3a (DEFAULT_TABLE table=default.Table_5afcc0049e364501bce48333c6697692 [id=a984dd0353274e49b8591f42912de25b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.513953 14940 tablet_service.cc:1505] Processing CreateTablet for tablet dfe5c16d330b4b428a00e7b8e2297c9b (DEFAULT_TABLE table=default.Table_39b16d4513794370a809c027496a8357 [id=81ce403333f84efa95eb02b6dc5694f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.514446 15215 tablet_service.cc:1505] Processing CreateTablet for tablet b602badaa66b40ce9e4c8faddea35731 (DEFAULT_TABLE table=default.Table_799de52c9d9244b9a55f3c0a56de6136 [id=ff6dd89a563b411293a7a6e0c1154132]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.514544 16390 tablet_bootstrap.cc:654] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.514631 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b602badaa66b40ce9e4c8faddea35731. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.515122 14958 tablet_service.cc:1505] Processing CreateTablet for tablet b602badaa66b40ce9e4c8faddea35731 (DEFAULT_TABLE table=default.Table_799de52c9d9244b9a55f3c0a56de6136 [id=ff6dd89a563b411293a7a6e0c1154132]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.515390 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 100b323438314ebd91a9c4f4684ced3a (DEFAULT_TABLE table=default.Table_5afcc0049e364501bce48333c6697692 [id=a984dd0353274e49b8591f42912de25b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.515390 14956 tablet_service.cc:1505] Processing CreateTablet for tablet ba46d4b94db9478db3ff5ec6f097de1d (DEFAULT_TABLE table=default.Table_2eae5b9e44bc40acafb6a647bed4a4d9 [id=8e2953f9e67d440ca19f641988455cae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.515571 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100b323438314ebd91a9c4f4684ced3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.515795 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_4030e2a15f3544569f37151166b5f237"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:34.515841 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 1b8208c72f1c472faaa49a4561d0b3af (DEFAULT_TABLE table=default.Table_48ddda8a36684d438ecffce1ea4dc2d1 [id=56940eabc0444a4f9778e2efce1aff18]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:34.516111 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4030e2a15f3544569f37151166b5f237 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.516398 17274 tablet_bootstrap.cc:492] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.516469 17274 ts_tablet_manager.cc:1403] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.106s user 0.002s sys 0.000s
I20251025 08:02:34.516873 17274 raft_consensus.cc:359] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.516952 17274 raft_consensus.cc:385] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.516920 16283 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_0762822d85ed47bc93809bd77c712935" } modify_external_catalogs: true
I20251025 08:02:34.516978 17274 raft_consensus.cc:740] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.517004 16283 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_0762822d85ed47bc93809bd77c712935" } modify_external_catalogs: true
I20251025 08:02:34.517088 17274 consensus_queue.cc:260] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.517349 17274 ts_tablet_manager.cc:1434] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.517351 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "947b2d44ffa04370a04d5b4c24e11083" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.517501 17274 tablet_bootstrap.cc:492] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.517628 15075 tablet_service.cc:1505] Processing CreateTablet for tablet b602badaa66b40ce9e4c8faddea35731 (DEFAULT_TABLE table=default.Table_799de52c9d9244b9a55f3c0a56de6136 [id=ff6dd89a563b411293a7a6e0c1154132]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.517797 15075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b602badaa66b40ce9e4c8faddea35731. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.518334 17274 tablet_bootstrap.cc:654] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.519428 16391 tablet_bootstrap.cc:492] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.515581 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "947b2d44ffa04370a04d5b4c24e11083" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.519497 16391 ts_tablet_manager.cc:1403] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:34.519542 15111 raft_consensus.cc:2393] T 947b2d44ffa04370a04d5b4c24e11083 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:34.519783 14915 leader_election.cc:304] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.519966 17730 raft_consensus.cc:3060] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.519929 16391 raft_consensus.cc:359] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.520026 16391 raft_consensus.cc:385] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.520053 16391 raft_consensus.cc:740] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.520159 16391 consensus_queue.cc:260] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.520406 16391 ts_tablet_manager.cc:1434] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.520555 16391 tablet_bootstrap.cc:492] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.520819 17730 raft_consensus.cc:2749] T 947b2d44ffa04370a04d5b4c24e11083 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.521641 16391 tablet_bootstrap.cc:654] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.521903 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfe5c16d330b4b428a00e7b8e2297c9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.522046 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b602badaa66b40ce9e4c8faddea35731. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.522217 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100b323438314ebd91a9c4f4684ced3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.522249 17595 raft_consensus.cc:493] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.522318 17595 raft_consensus.cc:515] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.522630 17595 leader_election.cc:290] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.524048 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba46d4b94db9478db3ff5ec6f097de1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.524231 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8bc7a0419e84a19a0349d0b7d63f174" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.524333 15249 raft_consensus.cc:2468] T c8bc7a0419e84a19a0349d0b7d63f174 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:34.525265 14914 leader_election.cc:304] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.526484 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b8208c72f1c472faaa49a4561d0b3af. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.527334 17194 ts_tablet_manager.cc:1929] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.527424 17194 log.cc:1199] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/98baf6e8d8e84b42a83054495ae19e01
I20251025 08:02:34.527841 17194 ts_tablet_manager.cc:1950] T 98baf6e8d8e84b42a83054495ae19e01 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.528288 17595 raft_consensus.cc:2804] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.528352 17595 raft_consensus.cc:493] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.528386 17595 raft_consensus.cc:3060] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.529254 17595 raft_consensus.cc:515] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.529563 17595 leader_election.cc:290] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.530426 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8bc7a0419e84a19a0349d0b7d63f174" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:34.530521 15249 raft_consensus.cc:3060] T c8bc7a0419e84a19a0349d0b7d63f174 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.531389 15249 raft_consensus.cc:2468] T c8bc7a0419e84a19a0349d0b7d63f174 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:34.531421 15105 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8bc7a0419e84a19a0349d0b7d63f174" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.531512 15105 raft_consensus.cc:2468] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:34.531868 14914 leader_election.cc:304] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.532016 17730 raft_consensus.cc:2804] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.532097 17730 raft_consensus.cc:697] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:34.532132 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c8bc7a0419e84a19a0349d0b7d63f174" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:34.532234 15111 raft_consensus.cc:3060] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.532225 17730 consensus_queue.cc:237] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.533038 15111 raft_consensus.cc:2468] T c8bc7a0419e84a19a0349d0b7d63f174 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:34.534364 16390 tablet_bootstrap.cc:492] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.534446 16390 ts_tablet_manager.cc:1403] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.000s
I20251025 08:02:34.534849 16390 raft_consensus.cc:359] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.534960 16390 raft_consensus.cc:385] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.534988 16390 raft_consensus.cc:740] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.535091 16390 consensus_queue.cc:260] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.535355 16390 ts_tablet_manager.cc:1434] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.535508 16390 tablet_bootstrap.cc:492] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.536604 16390 tablet_bootstrap.cc:654] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.537515 16281 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_b074f35366374acd92bf7528094773a0" } modify_external_catalogs: true
I20251025 08:02:34.537607 16281 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_b074f35366374acd92bf7528094773a0" } modify_external_catalogs: true
I20251025 08:02:34.539919 17595 raft_consensus.cc:493] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.540007 17595 raft_consensus.cc:515] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.540035 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 2ddd139940124cf5b2b3f60858376b8c (DEFAULT_TABLE table=default.Table_51597e88f32f4306a7ede83a03bf7670 [id=65244a99bf9c4837b2fb316a7610f9a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.540251 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ddd139940124cf5b2b3f60858376b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.540304 17595 leader_election.cc:290] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.544137 15075 tablet_service.cc:1505] Processing CreateTablet for tablet ba46d4b94db9478db3ff5ec6f097de1d (DEFAULT_TABLE table=default.Table_2eae5b9e44bc40acafb6a647bed4a4d9 [id=8e2953f9e67d440ca19f641988455cae]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:34.544194 14915 leader_election.cc:343] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 1e248b8303b1498e96178d4e46ad691e
I20251025 08:02:34.544363 15075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba46d4b94db9478db3ff5ec6f097de1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.544483 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1e248b8303b1498e96178d4e46ad691e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.544574 15237 raft_consensus.cc:2468] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:34.545351 17620 tablet.cc:1722] T 55db2958c76e4886b807fdb237f9b2a9 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.546265 15384 consensus_queue.cc:1048] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.547871 17591 tablet.cc:1722] T 55db2958c76e4886b807fdb237f9b2a9 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.547991 14914 leader_election.cc:304] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:34.548182 17730 raft_consensus.cc:2804] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.548228 17730 raft_consensus.cc:493] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.548264 17730 raft_consensus.cc:3060] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.549106 17730 raft_consensus.cc:515] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.549409 17730 leader_election.cc:290] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.550642 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1e248b8303b1498e96178d4e46ad691e" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:34.550737 15237 raft_consensus.cc:3060] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.551671 15237 raft_consensus.cc:2468] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
W20251025 08:02:34.552237 14915 leader_election.cc:343] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Not found: Tablet not found: 1e248b8303b1498e96178d4e46ad691e
I20251025 08:02:34.552381 16279 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_951e3633f70643de8a63e9408b868fe9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.552699 16279 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_951e3633f70643de8a63e9408b868fe9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.552717 14914 leader_election.cc:304] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: e51a2be794f04642b89386067ecbc77e
I20251025 08:02:34.552891 17730 raft_consensus.cc:2804] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.552961 17730 raft_consensus.cc:697] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:34.553064 17730 consensus_queue.cc:237] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.553812 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_4294a48c420d4c71b071172eed9f1145"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.554105 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4294a48c420d4c71b071172eed9f1145 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.555044 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_e74e29b85e094351a03724c06d61c612"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.555313 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e74e29b85e094351a03724c06d61c612 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.555881 16282 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_ce11251d6b4243ac8902b50912f11fc3 [id=b3e6b8f18f2f40fc977b978d7d2c1b0b] alter complete (version 1)
I20251025 08:02:34.558440 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet 1ddb3795876b486e992b58cea711afb3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.559409 17595 raft_consensus.cc:493] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.559480 17595 raft_consensus.cc:515] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:34.559645 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 1ddb3795876b486e992b58cea711afb3 because the tablet was not found. No further retry: Not found: Tablet not found: 1ddb3795876b486e992b58cea711afb3
I20251025 08:02:34.559778 17595 leader_election.cc:290] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.560360 16284 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_b6d6ebb6a2ec45c5b4ff41770356102c" } new_table_name: "default.Table_a09b3cce99d7469f85ae231bf3518fd9" modify_external_catalogs: true
I20251025 08:02:34.562157 17566 tablet.cc:1722] T e967a52212164b8cb6f9c39f207024a1 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:34.563310 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 2ddd139940124cf5b2b3f60858376b8c (DEFAULT_TABLE table=default.Table_51597e88f32f4306a7ede83a03bf7670 [id=65244a99bf9c4837b2fb316a7610f9a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.563405 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 2ddd139940124cf5b2b3f60858376b8c (DEFAULT_TABLE table=default.Table_51597e88f32f4306a7ede83a03bf7670 [id=65244a99bf9c4837b2fb316a7610f9a2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.563508 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ddd139940124cf5b2b3f60858376b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.563606 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ddd139940124cf5b2b3f60858376b8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.565488 15075 tablet_service.cc:1552] Processing DeleteTablet for tablet 2f64072c416f4a77b1c81855d7db8f01 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:33 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.565675 14940 tablet_service.cc:1505] Processing CreateTablet for tablet 88bfa71d511a4383845136ac07d7c508 (DEFAULT_TABLE table=default.Table_d54d3a0c7eaa43fa9309f3ee3578c671 [id=8376d3dc7280453985ab1ada1a5450f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.565905 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88bfa71d511a4383845136ac07d7c508. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.571607 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d049bf946c744664aba74d7a12fa4ff1" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.571750 15237 raft_consensus.cc:2410] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20251025 08:02:34.571940 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 98baf6e8d8e84b42a83054495ae19e01 (table default.Table_e7ff1f77ca4f48b2afa289c6672bcafd [id=a63322e79f4d47599afcfe64edd3a86c]) successfully deleted
I20251025 08:02:34.572218 17194 tablet_replica.cc:333] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.572413 15111 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d049bf946c744664aba74d7a12fa4ff1" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.572587 17620 tablet.cc:1722] T e967a52212164b8cb6f9c39f207024a1 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:34.572789 17194 raft_consensus.cc:2243] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.572958 17194 raft_consensus.cc:2272] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.573695 17194 ts_tablet_manager.cc:1916] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.574501 14915 leader_election.cc:304] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.574828 17594 raft_consensus.cc:2749] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20251025 08:02:34.577672 17591 tablet.cc:1722] T e967a52212164b8cb6f9c39f207024a1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:34.578136 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 88bfa71d511a4383845136ac07d7c508 (DEFAULT_TABLE table=default.Table_d54d3a0c7eaa43fa9309f3ee3578c671 [id=8376d3dc7280453985ab1ada1a5450f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.580121 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 488755405fbc4ee48af8b203a6835d3a (DEFAULT_TABLE table=default.Table_8876401911a841b68376afacf6bc7e08 [id=0422f0057efa46659a20132697d1f519]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.580332 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488755405fbc4ee48af8b203a6835d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.580578 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88bfa71d511a4383845136ac07d7c508. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.582645 15075 tablet_service.cc:1505] Processing CreateTablet for tablet 88bfa71d511a4383845136ac07d7c508 (DEFAULT_TABLE table=default.Table_d54d3a0c7eaa43fa9309f3ee3578c671 [id=8376d3dc7280453985ab1ada1a5450f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.582863 15075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88bfa71d511a4383845136ac07d7c508. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.585029 17373 consensus_queue.cc:1048] T 947b2d44ffa04370a04d5b4c24e11083 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.587522 14956 tablet_service.cc:1552] Processing DeleteTablet for tablet 1e248b8303b1498e96178d4e46ad691e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.588464 16282 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 9ecb15be5f5c48f1bd68e56b65543fad (table default.Table_f7b470f4186b4021b9add91827963361 [id=9aee333b5b9f4e1daba6449f643ea43a]). Expected version 2 got 0
I20251025 08:02:34.588603 16282 catalog_manager.cc:5649] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 1 to 2, leader changed from f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3) to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 2 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:34.588775 16282 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet d049bf946c744664aba74d7a12fa4ff1 (table default.Table_36b5cc8d55f84063a624820d55f1aac8 [id=33bbe4605d924011b9002a939a73203d]). Expected version 1 got 0
W20251025 08:02:34.589057 15215 tablet_service.cc:731] failed op from {username='slave'} at 127.0.0.1:42704: Illegal state: replica f0f2f8ce3e9f4d9ba3f3f02813397c31 is not leader of this config: current role FOLLOWER
W20251025 08:02:34.589522 16271 catalog_manager.cc:5064] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): alter failed for tablet d049bf946c744664aba74d7a12fa4ff1 (table default.Table_36b5cc8d55f84063a624820d55f1aac8 [id=33bbe4605d924011b9002a939a73203d]): Illegal state: replica f0f2f8ce3e9f4d9ba3f3f02813397c31 is not leader of this config: current role FOLLOWER
I20251025 08:02:34.589751 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet 5027b80220e34f5f8e1e8e8479ec41f3 with delete_type TABLET_DATA_DELETED (replaced by tablet bce04638a32443bc853ae242c6651ac5) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.593150 17537 consensus_queue.cc:1048] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.593536 17620 tablet.cc:1722] T f6082b299bb44d31b567f70d8da7f0ac P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:34.593822 17765 tablet.cc:1722] T f6082b299bb44d31b567f70d8da7f0ac P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:34.593863 16280 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_e3cb96c3c06e438c8159a4212e4c0197"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.594166 16280 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3cb96c3c06e438c8159a4212e4c0197 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.595897 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 488755405fbc4ee48af8b203a6835d3a (DEFAULT_TABLE table=default.Table_8876401911a841b68376afacf6bc7e08 [id=0422f0057efa46659a20132697d1f519]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.596105 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488755405fbc4ee48af8b203a6835d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.598776 14940 tablet_service.cc:1505] Processing CreateTablet for tablet 0a3ceb9e97e54a3883c7dcb3b91036fa (DEFAULT_TABLE table=default.Table_c53c1ae65b3a4ca1bd5646d90cf626e9 [id=c2bb79c42d0b4971b9974a2d3872fae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.599015 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3ceb9e97e54a3883c7dcb3b91036fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.600615 17198 ts_tablet_manager.cc:1929] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.600773 17198 log.cc:1199] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/85c7748077184fdda472821a0826cd77
I20251025 08:02:34.601240 17198 ts_tablet_manager.cc:1950] T 85c7748077184fdda472821a0826cd77 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.601649 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 158) took 1082 ms. Trace:
I20251025 08:02:34.601799 17198 rpcz_store.cc:276] 1025 08:02:33.519266 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.527857 (+ 8591us) service_pool.cc:225] Handling call
1025 08:02:34.478789 (+950932us) ts_tablet_manager.cc:1151] Deleting tablet 85c7748077184fdda472821a0826cd77
1025 08:02:34.478797 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.485331 (+ 6534us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.600542 (+115211us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.601639 (+ 1097us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":950725}
I20251025 08:02:34.602312 17198 tablet_replica.cc:333] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.602603 17198 raft_consensus.cc:2243] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.602923 15075 tablet_service.cc:1505] Processing CreateTablet for tablet 488755405fbc4ee48af8b203a6835d3a (DEFAULT_TABLE table=default.Table_8876401911a841b68376afacf6bc7e08 [id=0422f0057efa46659a20132697d1f519]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.603260 15075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 488755405fbc4ee48af8b203a6835d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.606385 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 85c7748077184fdda472821a0826cd77 (table default.Table_e3dddd8db8a64833bd7de5ad2fec599a [id=9b1cfdaffd964fba879de8e58c7ac93c]) successfully deleted
I20251025 08:02:34.608081 14940 tablet_service.cc:1505] Processing CreateTablet for tablet de40231bbbc3410dbb149ebdf8aeaafb (DEFAULT_TABLE table=default.Table_047beef8f8ac418783052f81f56b8667 [id=9b3006ae8a6d43bab2f30b2132904178]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.608248 17566 tablet.cc:1722] T f6082b299bb44d31b567f70d8da7f0ac P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:34.608338 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de40231bbbc3410dbb149ebdf8aeaafb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.609391 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 0a3ceb9e97e54a3883c7dcb3b91036fa (DEFAULT_TABLE table=default.Table_c53c1ae65b3a4ca1bd5646d90cf626e9 [id=c2bb79c42d0b4971b9974a2d3872fae5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.612357 15642 consensus_queue.cc:1048] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.613888 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet bf34039d909949af9357299bf8204891
I20251025 08:02:34.614319 16283 master_service.cc:954] ReplaceTablet: received request to replace tablet 9bb5b825be9a44d489151239947d471e from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.614593 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3ceb9e97e54a3883c7dcb3b91036fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.615127 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet bf34039d909949af9357299bf8204891 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.615284 17258 tablet_replica.cc:333] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.615384 17258 raft_consensus.cc:2243] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.615458 17258 raft_consensus.cc:2272] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.615581 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet bf34039d909949af9357299bf8204891 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.615778 17258 ts_tablet_manager.cc:1916] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.616082 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet bf34039d909949af9357299bf8204891 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.617926 17258 ts_tablet_manager.cc:1929] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.618016 17258 log.cc:1199] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/bf34039d909949af9357299bf8204891
I20251025 08:02:34.618768 15075 tablet_service.cc:1505] Processing CreateTablet for tablet 0a3ceb9e97e54a3883c7dcb3b91036fa (DEFAULT_TABLE table=default.Table_c53c1ae65b3a4ca1bd5646d90cf626e9 [id=c2bb79c42d0b4971b9974a2d3872fae5]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:34.619036 15049 consensus_peers.cc:597] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d05bf0056dfc43eeb4105af559497bdc. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:34.619143 15215 tablet_service.cc:1505] Processing CreateTablet for tablet de40231bbbc3410dbb149ebdf8aeaafb (DEFAULT_TABLE table=default.Table_047beef8f8ac418783052f81f56b8667 [id=9b3006ae8a6d43bab2f30b2132904178]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.619366 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de40231bbbc3410dbb149ebdf8aeaafb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.621034 15075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3ceb9e97e54a3883c7dcb3b91036fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.621263 15089 tablet_service.cc:1505] Processing CreateTablet for tablet de40231bbbc3410dbb149ebdf8aeaafb (DEFAULT_TABLE table=default.Table_047beef8f8ac418783052f81f56b8667 [id=9b3006ae8a6d43bab2f30b2132904178]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.621416 17258 ts_tablet_manager.cc:1950] T bf34039d909949af9357299bf8204891 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.621573 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de40231bbbc3410dbb149ebdf8aeaafb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.621562 14957 tablet_service.cc:1505] Processing CreateTablet for tablet b2ffb79873a94fdb872d733aa5eaf785 (DEFAULT_TABLE table=default.Table_7a23a84cd5c446c8b427b73c956ca350 [id=51705d03cfb84c05868d8806800debe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.621726 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet bf34039d909949af9357299bf8204891 (table default.Table_0762822d85ed47bc93809bd77c712935 [id=1e0739ca3fad4a22893a3453c3b2eac8]) successfully deleted
I20251025 08:02:34.621748 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ffb79873a94fdb872d733aa5eaf785. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.626245 16281 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet f65b1ad4764a4ed3a33baccaf278f043
I20251025 08:02:34.626622 16281 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_85ecb3ae3f1a4810b5abcb29f861e881" } modify_external_catalogs: true
I20251025 08:02:34.626711 16281 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_85ecb3ae3f1a4810b5abcb29f861e881" } modify_external_catalogs: true
I20251025 08:02:34.628182 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet f65b1ad4764a4ed3a33baccaf278f043 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.628188 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet f65b1ad4764a4ed3a33baccaf278f043 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.628902 17258 tablet_replica.cc:333] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.629043 17258 raft_consensus.cc:2243] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.629122 16279 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_2723d06acdad494093ca794f37a40c63" } modify_external_catalogs: true
I20251025 08:02:34.629184 17258 raft_consensus.cc:2272] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.629207 16279 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_2723d06acdad494093ca794f37a40c63" } modify_external_catalogs: true
I20251025 08:02:34.629482 17258 ts_tablet_manager.cc:1916] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.631409 17258 ts_tablet_manager.cc:1929] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.632512 17194 ts_tablet_manager.cc:1929] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.632675 17194 log.cc:1199] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/be8d6685c70c4219947df30f023a59b8
I20251025 08:02:34.633097 17194 ts_tablet_manager.cc:1950] T be8d6685c70c4219947df30f023a59b8 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.633126 17258 log.cc:1199] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/f65b1ad4764a4ed3a33baccaf278f043
I20251025 08:02:34.633359 17258 ts_tablet_manager.cc:1950] T f65b1ad4764a4ed3a33baccaf278f043 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.633387 14940 tablet_service.cc:1505] Processing CreateTablet for tablet b6b9c1d8e0464c3d9e3ca0fa41348775 (DEFAULT_TABLE table=default.Table_e1b8cc9321994d33976994fc3b9858b6 [id=2143e48d16bc46378f858fbf690f65c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.633615 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b9c1d8e0464c3d9e3ca0fa41348775. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.634117 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet be8d6685c70c4219947df30f023a59b8 (table default.Table_165ff894c5ab455e8daf5d1cf318b785 [id=325e0a7553e840c58179c04253e874dc]) successfully deleted
I20251025 08:02:34.634199 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet f65b1ad4764a4ed3a33baccaf278f043 (table default.Table_b074f35366374acd92bf7528094773a0 [id=afe8a5e6aa824ba69530f71c2b2d4617]) successfully deleted
I20251025 08:02:34.634418 17194 tablet_replica.cc:333] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.634694 17194 raft_consensus.cc:2243] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.634919 17194 raft_consensus.cc:2272] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.635262 15075 tablet_service.cc:1552] Processing DeleteTablet for tablet f65b1ad4764a4ed3a33baccaf278f043 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.636548 16391 tablet_bootstrap.cc:492] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.636626 16391 ts_tablet_manager.cc:1403] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.116s user 0.001s sys 0.001s
I20251025 08:02:34.637135 16391 raft_consensus.cc:359] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.637235 16391 raft_consensus.cc:385] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.637269 16391 raft_consensus.cc:740] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.637364 16391 consensus_queue.cc:260] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.637636 16391 ts_tablet_manager.cc:1434] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.637775 16391 tablet_bootstrap.cc:492] T ea8a95b8fbf94520a2c219755cdc5d14 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.638736 16391 tablet_bootstrap.cc:654] T ea8a95b8fbf94520a2c219755cdc5d14 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.639539 17566 tablet.cc:1722] T 55db2958c76e4886b807fdb237f9b2a9 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.640794 15075 tablet_service.cc:1505] Processing CreateTablet for tablet b2ffb79873a94fdb872d733aa5eaf785 (DEFAULT_TABLE table=default.Table_7a23a84cd5c446c8b427b73c956ca350 [id=51705d03cfb84c05868d8806800debe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.641088 15075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ffb79873a94fdb872d733aa5eaf785. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.642803 16390 tablet_bootstrap.cc:492] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.642894 16390 ts_tablet_manager.cc:1403] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.107s user 0.002s sys 0.000s
I20251025 08:02:34.643445 16390 raft_consensus.cc:359] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.643543 16390 raft_consensus.cc:385] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.643587 16390 raft_consensus.cc:740] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.643689 16390 consensus_queue.cc:260] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.643766 17274 tablet_bootstrap.cc:492] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.643829 17274 ts_tablet_manager.cc:1403] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.126s user 0.001s sys 0.000s
I20251025 08:02:34.643963 16390 ts_tablet_manager.cc:1434] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.644115 16390 tablet_bootstrap.cc:492] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.644261 17274 raft_consensus.cc:359] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.644361 17274 raft_consensus.cc:385] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.644389 17274 raft_consensus.cc:740] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.644510 17274 consensus_queue.cc:260] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.644760 17274 ts_tablet_manager.cc:1434] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.644914 17274 tablet_bootstrap.cc:492] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.645036 16390 tablet_bootstrap.cc:654] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.645953 17274 tablet_bootstrap.cc:654] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.649411 15089 tablet_service.cc:1505] Processing CreateTablet for tablet b6b9c1d8e0464c3d9e3ca0fa41348775 (DEFAULT_TABLE table=default.Table_e1b8cc9321994d33976994fc3b9858b6 [id=2143e48d16bc46378f858fbf690f65c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.649439 14940 tablet_service.cc:1505] Processing CreateTablet for tablet 32ef1622f95f497ba839271dacf29841 (DEFAULT_TABLE table=default.Table_a901c364849c4301910d7c32f0ec25fc [id=cadc2427db7c404cbbf9d3542145cccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.649662 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b9c1d8e0464c3d9e3ca0fa41348775. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.649782 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ef1622f95f497ba839271dacf29841. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.649796 15218 tablet_service.cc:1505] Processing CreateTablet for tablet b6b9c1d8e0464c3d9e3ca0fa41348775 (DEFAULT_TABLE table=default.Table_e1b8cc9321994d33976994fc3b9858b6 [id=2143e48d16bc46378f858fbf690f65c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.650061 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6b9c1d8e0464c3d9e3ca0fa41348775. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.658299 15215 tablet_service.cc:1505] Processing CreateTablet for tablet b2ffb79873a94fdb872d733aa5eaf785 (DEFAULT_TABLE table=default.Table_7a23a84cd5c446c8b427b73c956ca350 [id=51705d03cfb84c05868d8806800debe9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.658521 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ffb79873a94fdb872d733aa5eaf785. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.661376 16287 master_service.cc:954] ReplaceTablet: received request to replace tablet d81b65e094a34703ac47897d9bfa4c7c from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.662218 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_49a963b6e7b345b4ad3594a7648e6c10"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.662554 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49a963b6e7b345b4ad3594a7648e6c10 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.664121 16390 tablet_bootstrap.cc:492] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.664201 16390 ts_tablet_manager.cc:1403] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.000s
I20251025 08:02:34.664209 17274 tablet_bootstrap.cc:492] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.664278 17274 ts_tablet_manager.cc:1403] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20251025 08:02:34.664582 16390 raft_consensus.cc:359] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.664661 16390 raft_consensus.cc:385] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.664688 16390 raft_consensus.cc:740] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.664752 17274 raft_consensus.cc:359] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.664841 17274 raft_consensus.cc:385] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.664870 17274 raft_consensus.cc:740] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.664992 17274 consensus_queue.cc:260] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.664978 16390 consensus_queue.cc:260] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.665282 16390 ts_tablet_manager.cc:1434] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:34.665555 16390 tablet_bootstrap.cc:492] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.665663 17274 ts_tablet_manager.cc:1434] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.665849 17274 tablet_bootstrap.cc:492] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.666751 17274 tablet_bootstrap.cc:654] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.667503 17198 raft_consensus.cc:2272] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.667855 17198 ts_tablet_manager.cc:1916] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.669682 17198 ts_tablet_manager.cc:1929] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.669801 17198 log.cc:1199] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/ce5ae591c86c4455a1dd3704f1c95d1c
I20251025 08:02:34.670295 17198 ts_tablet_manager.cc:1950] T ce5ae591c86c4455a1dd3704f1c95d1c P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.671175 16390 tablet_bootstrap.cc:654] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.672765 15642 raft_consensus.cc:493] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.672849 15642 raft_consensus.cc:515] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.673177 15642 leader_election.cc:290] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.673429 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b826067888164df0af7da797d42c0862" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.673785 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b826067888164df0af7da797d42c0862" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:34.674072 15049 leader_election.cc:343] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:34.674149 15048 leader_election.cc:343] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.674250 15048 leader_election.cc:304] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.674368 15642 raft_consensus.cc:2749] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.674485 14940 tablet_service.cc:1505] Processing CreateTablet for tablet f39a76fab5e843d6a2a963dd9bf627a6 (DEFAULT_TABLE table=default.Table_070334199e524a3ab6f7cf59e619d05c [id=245155963c8f443d9a413306f0f89ad2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.674700 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f39a76fab5e843d6a2a963dd9bf627a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.677953 15075 tablet_service.cc:1505] Processing CreateTablet for tablet 32ef1622f95f497ba839271dacf29841 (DEFAULT_TABLE table=default.Table_a901c364849c4301910d7c32f0ec25fc [id=cadc2427db7c404cbbf9d3542145cccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.678376 15075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ef1622f95f497ba839271dacf29841. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.681911 17194 ts_tablet_manager.cc:1916] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.685381 17194 ts_tablet_manager.cc:1929] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.685590 17194 log.cc:1199] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/b4a6f2b64c994f3abefef9724911a5fc
I20251025 08:02:34.685889 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 32ef1622f95f497ba839271dacf29841 (DEFAULT_TABLE table=default.Table_a901c364849c4301910d7c32f0ec25fc [id=cadc2427db7c404cbbf9d3542145cccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.686156 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 32ef1622f95f497ba839271dacf29841. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.686595 16284 master_service.cc:954] ReplaceTablet: received request to replace tablet 3caafcc644e34ec1acc0d3741fd34721 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.688019 16282 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_f4191d1423de42d9b489221fe1e2fb69"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.688335 16282 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4191d1423de42d9b489221fe1e2fb69 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.688699 17274 tablet_bootstrap.cc:492] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.688771 17274 ts_tablet_manager.cc:1403] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.023s user 0.001s sys 0.000s
I20251025 08:02:34.689216 17274 raft_consensus.cc:359] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.689328 17274 raft_consensus.cc:385] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.689368 17274 raft_consensus.cc:740] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.689488 17274 consensus_queue.cc:260] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.689649 16288 catalog_manager.cc:5649] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:34.689905 16288 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet 2a4b060efd054726b07702b691876147 (table default.Table_5f2746d8cc7341d9a30870387f129fa2 [id=846c344408284b8e8a0e5da1d328255d]). Expected version 1 got 0
I20251025 08:02:34.690057 17274 ts_tablet_manager.cc:1434] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.690245 17274 tablet_bootstrap.cc:492] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.691087 17274 tablet_bootstrap.cc:654] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.694260 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 159) took 1174 ms. Trace:
I20251025 08:02:34.694797 15218 tablet_service.cc:1505] Processing CreateTablet for tablet f39a76fab5e843d6a2a963dd9bf627a6 (DEFAULT_TABLE table=default.Table_070334199e524a3ab6f7cf59e619d05c [id=245155963c8f443d9a413306f0f89ad2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.695020 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f39a76fab5e843d6a2a963dd9bf627a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.694767 17198 rpcz_store.cc:276] 1025 08:02:33.519309 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.527917 (+ 8608us) service_pool.cc:225] Handling call
1025 08:02:34.602286 (+1074369us) ts_tablet_manager.cc:1151] Deleting tablet ce5ae591c86c4455a1dd3704f1c95d1c
1025 08:02:34.602293 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.668827 (+ 66534us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.669640 (+ 813us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.694249 (+ 24609us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1074267}
I20251025 08:02:34.697041 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet ce5ae591c86c4455a1dd3704f1c95d1c (table default.Table_9c7e0359120c415cba47b89251b0be94 [id=4510ebbcd6ee43babe7ee133a0ce6ae5]) successfully deleted
I20251025 08:02:34.698290 15075 tablet_service.cc:1505] Processing CreateTablet for tablet f39a76fab5e843d6a2a963dd9bf627a6 (DEFAULT_TABLE table=default.Table_070334199e524a3ab6f7cf59e619d05c [id=245155963c8f443d9a413306f0f89ad2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.700587 15075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f39a76fab5e843d6a2a963dd9bf627a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.700841 17198 tablet_replica.cc:333] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.701164 17198 raft_consensus.cc:2243] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.701426 17198 pending_rounds.cc:70] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:34.701543 17198 pending_rounds.cc:77] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609835734679552 op_type: NO_OP noop_request { }
I20251025 08:02:34.701694 17198 raft_consensus.cc:2889] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:34.701845 17198 raft_consensus.cc:2272] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.702571 17198 ts_tablet_manager.cc:1916] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.703428 17765 tablet.cc:1722] T fc485ee4814142cda9be0d937aaa5dc1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.706197 17566 tablet.cc:1722] T fc485ee4814142cda9be0d937aaa5dc1 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.708001 17373 raft_consensus.cc:493] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.708073 17373 raft_consensus.cc:515] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.708426 17373 leader_election.cc:290] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.708770 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b316ba50a48446338d49435a8e809ff4" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.708875 17620 tablet.cc:1722] T fc485ee4814142cda9be0d937aaa5dc1 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:34.709144 15183 leader_election.cc:343] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.710098 17194 ts_tablet_manager.cc:1950] T b4a6f2b64c994f3abefef9724911a5fc P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.712267 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b316ba50a48446338d49435a8e809ff4" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
W20251025 08:02:34.712565 15185 leader_election.cc:343] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.712647 15185 leader_election.cc:304] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:34.714006 17373 raft_consensus.cc:2749] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.715624 17274 tablet_bootstrap.cc:492] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.715698 17274 ts_tablet_manager.cc:1403] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.000s
I20251025 08:02:34.716090 17274 raft_consensus.cc:359] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.716168 17274 raft_consensus.cc:385] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.716195 17274 raft_consensus.cc:740] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.716315 17274 consensus_queue.cc:260] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.716563 17274 ts_tablet_manager.cc:1434] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.717074 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 774988b980d8474e9b41518410c5dc9b (DEFAULT_TABLE table=default.Table_599c0d46a95d45b4aa9bab3b54b52470 [id=b8e6ffed1a2e442db3c9ee5ac1a6ff3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.717445 17274 tablet_bootstrap.cc:492] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.717473 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 774988b980d8474e9b41518410c5dc9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.718468 17274 tablet_bootstrap.cc:654] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.719408 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 774988b980d8474e9b41518410c5dc9b (DEFAULT_TABLE table=default.Table_599c0d46a95d45b4aa9bab3b54b52470 [id=b8e6ffed1a2e442db3c9ee5ac1a6ff3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.720613 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 9bb5b825be9a44d489151239947d471e
I20251025 08:02:34.720877 16283 catalog_manager.cc:6719] ReplaceTablet: tablet 9bb5b825be9a44d489151239947d471e deleted and replaced by tablet 25ea9963acac4140ad7d878fc429c090
I20251025 08:02:34.721055 16283 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_9985b6eb72284cb583313ce952774b40" } new_table_name: "default.Table_9d4427ccec9b4a2da3bbd2aab811ca29" modify_external_catalogs: true
I20251025 08:02:34.722211 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 9bb5b825be9a44d489151239947d471e with delete_type TABLET_DATA_DELETED (replaced by tablet 25ea9963acac4140ad7d878fc429c090) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.722896 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet 9bb5b825be9a44d489151239947d471e with delete_type TABLET_DATA_DELETED (replaced by tablet 25ea9963acac4140ad7d878fc429c090) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.724539 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 9bb5b825be9a44d489151239947d471e with delete_type TABLET_DATA_DELETED (replaced by tablet 25ea9963acac4140ad7d878fc429c090) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.725167 16391 tablet_bootstrap.cc:492] T ea8a95b8fbf94520a2c219755cdc5d14 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.725257 16391 ts_tablet_manager.cc:1403] T ea8a95b8fbf94520a2c219755cdc5d14 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.088s user 0.002s sys 0.000s
I20251025 08:02:34.725665 16391 raft_consensus.cc:359] T ea8a95b8fbf94520a2c219755cdc5d14 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.725755 16391 raft_consensus.cc:385] T ea8a95b8fbf94520a2c219755cdc5d14 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.725785 16391 raft_consensus.cc:740] T ea8a95b8fbf94520a2c219755cdc5d14 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.726224 16391 consensus_queue.cc:260] T ea8a95b8fbf94520a2c219755cdc5d14 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.726502 16391 ts_tablet_manager.cc:1434] T ea8a95b8fbf94520a2c219755cdc5d14 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.726666 16391 tablet_bootstrap.cc:492] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.728135 15218 tablet_service.cc:1505] Processing CreateTablet for tablet e5b635b4eb0841b0b8966ee274a138dd (DEFAULT_TABLE table=default.Table_e7e5d606f2194dce86fec95bb0654a4b [id=07db0fdf9bf143b28255656fb7f982fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.730672 17258 tablet_replica.cc:333] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.730795 17258 raft_consensus.cc:2243] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.730988 17258 raft_consensus.cc:2272] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.726989 14940 tablet_service.cc:1505] Processing CreateTablet for tablet 774988b980d8474e9b41518410c5dc9b (DEFAULT_TABLE table=default.Table_599c0d46a95d45b4aa9bab3b54b52470 [id=b8e6ffed1a2e442db3c9ee5ac1a6ff3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.731307 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 774988b980d8474e9b41518410c5dc9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.731308 17258 ts_tablet_manager.cc:1916] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.727545 16391 tablet_bootstrap.cc:654] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.733019 17534 raft_consensus.cc:493] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.727594 14957 tablet_service.cc:1505] Processing CreateTablet for tablet e5b635b4eb0841b0b8966ee274a138dd (DEFAULT_TABLE table=default.Table_e7e5d606f2194dce86fec95bb0654a4b [id=07db0fdf9bf143b28255656fb7f982fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.733095 17534 raft_consensus.cc:515] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.733130 17258 ts_tablet_manager.cc:1929] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.733180 17258 log.cc:1199] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/9bb5b825be9a44d489151239947d471e
I20251025 08:02:34.733207 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b635b4eb0841b0b8966ee274a138dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.733402 17258 ts_tablet_manager.cc:1950] T 9bb5b825be9a44d489151239947d471e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.733464 17534 leader_election.cc:290] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.733796 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b16e4b9ef4c41db83ab3bf55149719b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.733927 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "6b16e4b9ef4c41db83ab3bf55149719b" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:34.734084 15049 leader_election.cc:343] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:34.734290 15048 leader_election.cc:343] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.734294 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet b4a6f2b64c994f3abefef9724911a5fc (table default.Table_15d9c5aa50e643adb2dae30a80b6fcd4 [id=045593a2a7cf4197836b256661103ba5]) successfully deleted
I20251025 08:02:34.734354 15048 leader_election.cc:304] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.734467 17534 raft_consensus.cc:2749] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.734508 15162 heartbeater.cc:344] Connected to a master server at 127.14.70.61:44347
I20251025 08:02:34.735821 16281 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet d116fbec0c6149938b8f6c19af9607af
I20251025 08:02:34.736021 17274 tablet_bootstrap.cc:492] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.736092 17274 ts_tablet_manager.cc:1403] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.000s
I20251025 08:02:34.736199 16281 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_004fcaf501c44ba08c169547dd5bb0ea" } modify_external_catalogs: true
I20251025 08:02:34.736292 16281 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_004fcaf501c44ba08c169547dd5bb0ea" } modify_external_catalogs: true
I20251025 08:02:34.736462 17274 raft_consensus.cc:359] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.736547 17274 raft_consensus.cc:385] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.736580 17274 raft_consensus.cc:740] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.736691 17274 consensus_queue.cc:260] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.736923 17274 ts_tablet_manager.cc:1434] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:34.737069 17274 tablet_bootstrap.cc:492] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.737761 17274 tablet_bootstrap.cc:654] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.738256 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet d116fbec0c6149938b8f6c19af9607af with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.738569 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 8a741f835afe49b3a4c8812111c9a77c (DEFAULT_TABLE table=default.Table_6afbe6fa71c541bf8cac121cae96aa81 [id=e2a2981f53934e93a20d4651579947b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.738649 17258 tablet_replica.cc:333] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.738760 17258 raft_consensus.cc:2243] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.738770 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a741f835afe49b3a4c8812111c9a77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.738909 17258 raft_consensus.cc:2272] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.739215 17258 ts_tablet_manager.cc:1916] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.740830 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 9bb5b825be9a44d489151239947d471e (table default.Table_f84103a22819458c976f0d1ca4716b47 [id=fe4920e7d4f143388063f22590eb2f64]) successfully deleted
I20251025 08:02:34.740922 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 8a741f835afe49b3a4c8812111c9a77c (DEFAULT_TABLE table=default.Table_6afbe6fa71c541bf8cac121cae96aa81 [id=e2a2981f53934e93a20d4651579947b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.741137 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a741f835afe49b3a4c8812111c9a77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.742084 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet d116fbec0c6149938b8f6c19af9607af with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.742599 17274 tablet_bootstrap.cc:492] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.742673 17274 ts_tablet_manager.cc:1403] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:34.742834 15089 tablet_service.cc:1505] Processing CreateTablet for tablet e5b635b4eb0841b0b8966ee274a138dd (DEFAULT_TABLE table=default.Table_e7e5d606f2194dce86fec95bb0654a4b [id=07db0fdf9bf143b28255656fb7f982fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.743046 17274 raft_consensus.cc:359] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.743125 17274 raft_consensus.cc:385] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.743156 17274 raft_consensus.cc:740] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.743471 17258 ts_tablet_manager.cc:1929] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.743554 17258 log.cc:1199] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/d116fbec0c6149938b8f6c19af9607af
I20251025 08:02:34.743587 17274 consensus_queue.cc:260] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.743870 17258 ts_tablet_manager.cc:1950] T d116fbec0c6149938b8f6c19af9607af P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:34.743881 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 1ddb3795876b486e992b58cea711afb3 because the tablet was not found. No further retry: Not found: Tablet not found: 1ddb3795876b486e992b58cea711afb3
I20251025 08:02:34.743979 17274 ts_tablet_manager.cc:1434] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.744065 17194 tablet_replica.cc:333] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.744154 17274 tablet_bootstrap.cc:492] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.744206 17194 raft_consensus.cc:2243] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.744488 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b635b4eb0841b0b8966ee274a138dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.744963 17274 tablet_bootstrap.cc:654] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.745843 16279 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet bce04638a32443bc853ae242c6651ac5
I20251025 08:02:34.746260 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5b635b4eb0841b0b8966ee274a138dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.746248 16279 master_service.cc:954] ReplaceTablet: received request to replace tablet de53385f417d4e5eb34ab4537a9b638b from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.746940 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet d116fbec0c6149938b8f6c19af9607af (table default.Table_85ecb3ae3f1a4810b5abcb29f861e881 [id=c1cc91015b38477f93e56504bf700ffb]) successfully deleted
I20251025 08:02:34.747464 17198 ts_tablet_manager.cc:1929] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.747563 17198 log.cc:1199] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/be8d6685c70c4219947df30f023a59b8
I20251025 08:02:34.747802 14956 tablet_service.cc:1552] Processing DeleteTablet for tablet bce04638a32443bc853ae242c6651ac5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.747920 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet bce04638a32443bc853ae242c6651ac5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.748090 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 774988b980d8474e9b41518410c5dc9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.748091 17198 ts_tablet_manager.cc:1950] T be8d6685c70c4219947df30f023a59b8 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.748414 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 160) took 1229 ms. Trace:
I20251025 08:02:34.748488 17198 rpcz_store.cc:276] 1025 08:02:33.519352 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.528003 (+ 8651us) service_pool.cc:225] Handling call
1025 08:02:34.695626 (+1167623us) ts_tablet_manager.cc:1151] Deleting tablet be8d6685c70c4219947df30f023a59b8
1025 08:02:34.700375 (+ 4749us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.746519 (+ 46144us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.747424 (+ 905us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.748404 (+ 980us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1167473}
I20251025 08:02:34.748850 17198 tablet_replica.cc:333] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.749092 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet bce04638a32443bc853ae242c6651ac5 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.749188 17198 raft_consensus.cc:2243] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.749341 17198 raft_consensus.cc:2272] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:34.749504 16271 catalog_manager.cc:4952] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet bce04638a32443bc853ae242c6651ac5 because the tablet was not found. No further retry: Not found: Tablet not found: bce04638a32443bc853ae242c6651ac5
I20251025 08:02:34.749827 17198 ts_tablet_manager.cc:1916] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.749892 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 8809e6f0e56c4424a03ecb391885ca87 (DEFAULT_TABLE table=default.Table_77181e171c394669b503a8906896b196 [id=125dd5541c5e44c7a08ebc4eb0f90b5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.750121 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8809e6f0e56c4424a03ecb391885ca87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.752169 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet be8d6685c70c4219947df30f023a59b8 (table default.Table_165ff894c5ab455e8daf5d1cf318b785 [id=325e0a7553e840c58179c04253e874dc]) successfully deleted
I20251025 08:02:34.753211 17194 pending_rounds.cc:70] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:34.753263 17194 pending_rounds.cc:77] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609836250333184 op_type: NO_OP noop_request { }
I20251025 08:02:34.753255 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 8809e6f0e56c4424a03ecb391885ca87 (DEFAULT_TABLE table=default.Table_77181e171c394669b503a8906896b196 [id=125dd5541c5e44c7a08ebc4eb0f90b5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.753320 17194 raft_consensus.cc:2889] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:34.753434 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8809e6f0e56c4424a03ecb391885ca87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.753376 17194 raft_consensus.cc:2272] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.759289 17730 consensus_queue.cc:1048] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.759040 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet d116fbec0c6149938b8f6c19af9607af with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.760200 17194 ts_tablet_manager.cc:1916] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.761618 16287 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet d81b65e094a34703ac47897d9bfa4c7c
I20251025 08:02:34.761857 16287 catalog_manager.cc:6719] ReplaceTablet: tablet d81b65e094a34703ac47897d9bfa4c7c deleted and replaced by tablet ca90e72e68324cf29dffafad4fca210c
I20251025 08:02:34.761969 17194 ts_tablet_manager.cc:1929] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.762028 17194 log.cc:1199] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/1e248b8303b1498e96178d4e46ad691e
I20251025 08:02:34.762027 16287 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_9d8c68374942454a8e7c869e8cef206f" } new_table_name: "default.Table_08827051f1554df4942ebfe68c81a8be" modify_external_catalogs: true
I20251025 08:02:34.762501 17194 ts_tablet_manager.cc:1950] T 1e248b8303b1498e96178d4e46ad691e P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.763281 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet d81b65e094a34703ac47897d9bfa4c7c with delete_type TABLET_DATA_DELETED (replaced by tablet ca90e72e68324cf29dffafad4fca210c) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.764190 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 691904b7bdac4699be47d6b554f1e4df (DEFAULT_TABLE table=default.Table_37d4aabbd78f4580864d62b6edf2ab23 [id=34c8c8c07f7c477bae19f92e478c5a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.765090 16390 tablet_bootstrap.cc:492] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.765154 16390 ts_tablet_manager.cc:1403] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.100s user 0.001s sys 0.000s
I20251025 08:02:34.765812 16390 raft_consensus.cc:359] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.765889 16390 raft_consensus.cc:385] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.765913 16390 raft_consensus.cc:740] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.766067 16390 consensus_queue.cc:260] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.766253 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet d81b65e094a34703ac47897d9bfa4c7c with delete_type TABLET_DATA_DELETED (replaced by tablet ca90e72e68324cf29dffafad4fca210c) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.766386 16390 ts_tablet_manager.cc:1434] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.766428 17258 tablet_replica.cc:333] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.766577 16390 tablet_bootstrap.cc:492] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.766592 17258 raft_consensus.cc:2243] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.766790 17258 raft_consensus.cc:2272] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.767112 17258 ts_tablet_manager.cc:1916] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.767395 16390 tablet_bootstrap.cc:654] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.768858 17258 ts_tablet_manager.cc:1929] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.768960 17258 log.cc:1199] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/d81b65e094a34703ac47897d9bfa4c7c
I20251025 08:02:34.769253 17258 ts_tablet_manager.cc:1950] T d81b65e094a34703ac47897d9bfa4c7c P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.769755 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet d81b65e094a34703ac47897d9bfa4c7c (table default.Table_e45046c48bb54111b38f009cc14efd2d [id=768625af4c474964ad2b502cf0b03fa7]) successfully deleted
I20251025 08:02:34.770448 16391 tablet_bootstrap.cc:492] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.770514 16391 ts_tablet_manager.cc:1403] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.044s user 0.002s sys 0.000s
I20251025 08:02:34.770848 16391 raft_consensus.cc:359] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.770920 16391 raft_consensus.cc:385] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.770943 16391 raft_consensus.cc:740] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.771042 16391 consensus_queue.cc:260] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.771276 16391 ts_tablet_manager.cc:1434] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.771555 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 691904b7bdac4699be47d6b554f1e4df (DEFAULT_TABLE table=default.Table_37d4aabbd78f4580864d62b6edf2ab23 [id=34c8c8c07f7c477bae19f92e478c5a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.771764 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691904b7bdac4699be47d6b554f1e4df. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:34.771862 16272 catalog_manager.cc:4767] Async tablet task AlterTable RPC for tablet 8809e6f0e56c4424a03ecb391885ca87 (table default.Table_77181e171c394669b503a8906896b196 [id=125dd5541c5e44c7a08ebc4eb0f90b5f], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 8809e6f0e56c4424a03ecb391885ca87 consensus state has no leader
I20251025 08:02:34.772910 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_b92940c2c118443988ab5c891fe2cd4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.773684 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b92940c2c118443988ab5c891fe2cd4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.776000 17415 consensus_queue.cc:1048] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.778352 17249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Bootstrap replayed 1/1 log segments. Stats: ops{read=701 overwritten=0 applied=701 ignored=0} inserts{seen=551 ignored=0} mutations{seen=845 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20251025 08:02:34.778776 17249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97: Bootstrap complete.
I20251025 08:02:34.784614 17249 raft_consensus.cc:359] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:34.785272 17249 raft_consensus.cc:740] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 33b7e3c702ec44079d8b76a0ce6bae97, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.785753 17249 consensus_queue.cc:260] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 701, Last appended: 3.701, Last appended by leader: 701, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } }
I20251025 08:02:34.786049 16284 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 3caafcc644e34ec1acc0d3741fd34721
I20251025 08:02:34.786458 16284 catalog_manager.cc:6719] ReplaceTablet: tablet 3caafcc644e34ec1acc0d3741fd34721 deleted and replaced by tablet e20dba3c7f8642f5b9ce727f44c753f5
I20251025 08:02:34.786593 16284 master_service.cc:954] ReplaceTablet: received request to replace tablet 95c9778bd0d94542bec79e9d36c6ce46 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:34.786996 17249 sys_catalog.cc:565] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: configured and running, proceeding with master startup.
I20251025 08:02:34.787590 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet 3caafcc644e34ec1acc0d3741fd34721 with delete_type TABLET_DATA_DELETED (replaced by tablet e20dba3c7f8642f5b9ce727f44c753f5) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.787627 17765 tablet.cc:1722] T 88a76d187fae4f09ac879b72e9c05a86 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:34.787952 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 3caafcc644e34ec1acc0d3741fd34721 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3caafcc644e34ec1acc0d3741fd34721 already in progress: creating tablet
I20251025 08:02:34.788071 14944 tablet_service.cc:1552] Processing DeleteTablet for tablet 3caafcc644e34ec1acc0d3741fd34721 with delete_type TABLET_DATA_DELETED (replaced by tablet e20dba3c7f8642f5b9ce727f44c753f5) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.789629 16280 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 3c86ceda5c2c4583b9ff388e82b5369f (table default.Table_a24e0514b7d94c60a5b075e650077668 [id=767682c0185b4db09bb0bc784a7a971e]). Expected version 1 got 0
I20251025 08:02:34.789798 16280 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet d6cbe1616ced4f47999a6a1365af0092 (table default.Table_633e3770c2064baeabedfed4d971e698 [id=8b4baee097c94e428a9a26f5d2a22107]). Expected version 1 got 0
I20251025 08:02:34.789903 16280 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 88a76d187fae4f09ac879b72e9c05a86 (table default.Table_8d621c2f449e477ab01d1b67dc869408 [id=d318bca8bf144870aa5529426cfa9995]). Expected version 1 got 0
I20251025 08:02:34.790872 17222 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [term 3 FOLLOWER]: Advancing to term 4
I20251025 08:02:34.791237 17620 tablet.cc:1722] T 88a76d187fae4f09ac879b72e9c05a86 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.796959 17316 consensus_queue.cc:1048] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.800252 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 0d6f8c2ab96549e6b3bc13168de2b604 (DEFAULT_TABLE table=default.Table_e30fc339f0c6497a910719bc1c5389cf [id=dca8337813714ec196680e84fa0f5d66]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.800330 17316 consensus_queue.cc:1048] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.753705 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 8a741f835afe49b3a4c8812111c9a77c (DEFAULT_TABLE table=default.Table_6afbe6fa71c541bf8cac121cae96aa81 [id=e2a2981f53934e93a20d4651579947b5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.758368 17534 raft_consensus.cc:493] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.802533 17534 raft_consensus.cc:515] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.802632 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a741f835afe49b3a4c8812111c9a77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.802896 17534 leader_election.cc:290] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.803660 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c86ceda5c2c4583b9ff388e82b5369f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:34.804042 15048 leader_election.cc:343] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.804723 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3c86ceda5c2c4583b9ff388e82b5369f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:34.805049 15049 leader_election.cc:343] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.805116 15049 leader_election.cc:304] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.805281 17534 raft_consensus.cc:2749] T 3c86ceda5c2c4583b9ff388e82b5369f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.759744 15075 tablet_service.cc:1505] Processing CreateTablet for tablet 8809e6f0e56c4424a03ecb391885ca87 (DEFAULT_TABLE table=default.Table_77181e171c394669b503a8906896b196 [id=125dd5541c5e44c7a08ebc4eb0f90b5f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.769898 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet d81b65e094a34703ac47897d9bfa4c7c with delete_type TABLET_DATA_DELETED (replaced by tablet ca90e72e68324cf29dffafad4fca210c) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.775719 17274 tablet_bootstrap.cc:492] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.786998 17566 tablet.cc:1722] T 88a76d187fae4f09ac879b72e9c05a86 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.805598 17274 ts_tablet_manager.cc:1403] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.061s user 0.002s sys 0.000s
I20251025 08:02:34.789583 15642 raft_consensus.cc:493] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.805778 15075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8809e6f0e56c4424a03ecb391885ca87. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.805800 15642 raft_consensus.cc:515] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.806123 15642 leader_election.cc:290] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.798944 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 691904b7bdac4699be47d6b554f1e4df (DEFAULT_TABLE table=default.Table_37d4aabbd78f4580864d62b6edf2ab23 [id=34c8c8c07f7c477bae19f92e478c5a63]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.806236 17274 raft_consensus.cc:359] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.806329 17274 raft_consensus.cc:385] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.806358 17274 raft_consensus.cc:740] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.806385 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691904b7bdac4699be47d6b554f1e4df. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.806452 17274 consensus_queue.cc:260] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.806701 17274 ts_tablet_manager.cc:1434] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.806810 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "edfb86283bda491993a456e365f8760f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.806844 17274 tablet_bootstrap.cc:492] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
W20251025 08:02:34.807106 15048 leader_election.cc:343] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.799057 15081 tablet_service.cc:1552] Processing DeleteTablet for tablet 3caafcc644e34ec1acc0d3741fd34721 with delete_type TABLET_DATA_DELETED (replaced by tablet e20dba3c7f8642f5b9ce727f44c753f5) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.807731 17274 tablet_bootstrap.cc:654] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.809923 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691904b7bdac4699be47d6b554f1e4df. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.810050 16391 tablet_bootstrap.cc:492] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.810923 16391 tablet_bootstrap.cc:654] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.814540 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 0d6f8c2ab96549e6b3bc13168de2b604 (DEFAULT_TABLE table=default.Table_e30fc339f0c6497a910719bc1c5389cf [id=dca8337813714ec196680e84fa0f5d66]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.814752 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6f8c2ab96549e6b3bc13168de2b604. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.815390 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 61c8a83c2146418184842b7d7dd594fa (DEFAULT_TABLE table=default.Table_d80d24fe6db14f0da8149898449ae86e [id=2283253a9522485d93d6c484c5eef6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.815567 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "edfb86283bda491993a456e365f8760f" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.815948 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61c8a83c2146418184842b7d7dd594fa. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:34.816824 15049 leader_election.cc:343] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.816887 15049 leader_election.cc:304] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.817144 17537 raft_consensus.cc:2749] T edfb86283bda491993a456e365f8760f P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.818475 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 0d6f8c2ab96549e6b3bc13168de2b604 (DEFAULT_TABLE table=default.Table_e30fc339f0c6497a910719bc1c5389cf [id=dca8337813714ec196680e84fa0f5d66]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.818666 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6f8c2ab96549e6b3bc13168de2b604. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.819761 16282 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_fc45669554034bd9acfbd2e54bbb9dad" } new_table_name: "default.Table_83c9d2e0ee66486bb2da7d98664ca406" modify_external_catalogs: true
I20251025 08:02:34.820425 15642 raft_consensus.cc:493] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.820516 15642 raft_consensus.cc:515] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.820885 15642 leader_election.cc:290] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.821173 16285 catalog_manager.cc:5649] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:34.821313 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "54ac551e1e9a4bb1970be52edd04c0d3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:34.821584 15049 leader_election.cc:343] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.822751 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "54ac551e1e9a4bb1970be52edd04c0d3" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:34.823102 15048 leader_election.cc:343] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.823159 15048 leader_election.cc:304] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.823262 15642 raft_consensus.cc:2749] T 54ac551e1e9a4bb1970be52edd04c0d3 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.827440 17316 raft_consensus.cc:493] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.827513 17316 raft_consensus.cc:515] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.827800 17316 leader_election.cc:290] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.828063 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12a6b5f9ed8041e9929c9f1673ac212a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.828161 15109 raft_consensus.cc:2468] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:34.828486 15185 leader_election.cc:304] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.828612 17316 raft_consensus.cc:2804] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.828655 17316 raft_consensus.cc:493] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.828744 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12a6b5f9ed8041e9929c9f1673ac212a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.828840 17316 raft_consensus.cc:3060] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.829731 17316 raft_consensus.cc:515] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.830093 17316 leader_election.cc:290] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:34.830582 15183 leader_election.cc:343] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.832129 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d6f8c2ab96549e6b3bc13168de2b604. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.832355 17194 tablet_replica.cc:333] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.832468 17194 raft_consensus.cc:2243] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.832532 17194 raft_consensus.cc:2272] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.832533 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 1e248b8303b1498e96178d4e46ad691e (table default.Table_64c962f064d64350a1fb6d539603c572 [id=766dd62ef84b4e56a871fbb018560a9f]) successfully deleted
I20251025 08:02:34.832901 17194 ts_tablet_manager.cc:1916] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.833213 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12a6b5f9ed8041e9929c9f1673ac212a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:34.833621 15183 leader_election.cc:343] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.834744 17194 ts_tablet_manager.cc:1929] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.834795 17194 log.cc:1199] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/5027b80220e34f5f8e1e8e8479ec41f3
I20251025 08:02:34.834962 17194 ts_tablet_manager.cc:1950] T 5027b80220e34f5f8e1e8e8479ec41f3 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.835139 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12a6b5f9ed8041e9929c9f1673ac212a" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:34.835216 15109 raft_consensus.cc:3060] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.835966 15109 raft_consensus.cc:2468] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:34.836202 15185 leader_election.cc:304] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:34.836426 17316 raft_consensus.cc:2804] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.836506 17316 raft_consensus.cc:697] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:34.836617 17316 consensus_queue.cc:237] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.841114 17730 raft_consensus.cc:493] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.841210 17730 raft_consensus.cc:515] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.841567 17730 leader_election.cc:290] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.841938 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1c15457dfac48e3a33de5a9c3d6f1f1" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:34.842298 14914 leader_election.cc:343] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.842533 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1c15457dfac48e3a33de5a9c3d6f1f1" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
W20251025 08:02:34.842813 14915 leader_election.cc:343] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.842875 14915 leader_election.cc:304] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.843050 17730 raft_consensus.cc:2749] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.843670 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 61c8a83c2146418184842b7d7dd594fa (DEFAULT_TABLE table=default.Table_d80d24fe6db14f0da8149898449ae86e [id=2283253a9522485d93d6c484c5eef6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.843888 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61c8a83c2146418184842b7d7dd594fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.844075 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 6ae883acfacf451495ae73e1e813ec71 (DEFAULT_TABLE table=default.Table_197dba326ac544d29c90a004200413bc [id=26a6f00041d04924b3e8eb2b279b55de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.845351 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 2fde39be14794d8680c332bb05c59292 (DEFAULT_TABLE table=default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.845750 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 6ae883acfacf451495ae73e1e813ec71 (DEFAULT_TABLE table=default.Table_197dba326ac544d29c90a004200413bc [id=26a6f00041d04924b3e8eb2b279b55de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.845956 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae883acfacf451495ae73e1e813ec71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.846590 14958 tablet_service.cc:1505] Processing CreateTablet for tablet c994b9b0fa3d46b9bb4c01610437972c (DEFAULT_TABLE table=default.Table_08073379da334076bcc5503770a32982 [id=1ee33ee129d749d0bd7f26dc49fca0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.847625 14947 tablet_service.cc:1505] Processing CreateTablet for tablet fb798a7e37434ec49c10ebcd7629be89 (DEFAULT_TABLE table=default.Table_c6019b486de543f29a1350bf7a073b96 [id=f2d5588e0383495fb7ac2ce8747c6f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.847733 15218 tablet_service.cc:1505] Processing CreateTablet for tablet c994b9b0fa3d46b9bb4c01610437972c (DEFAULT_TABLE table=default.Table_08073379da334076bcc5503770a32982 [id=1ee33ee129d749d0bd7f26dc49fca0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.847926 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c994b9b0fa3d46b9bb4c01610437972c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.848963 17198 ts_tablet_manager.cc:1929] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.849040 17198 log.cc:1199] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/86b1873446154249a80fa67b99496545
I20251025 08:02:34.849181 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 1648f727b0994f01bb6badc92472351c (DEFAULT_TABLE table=default.Table_bcf26fc494eb47ffbdecbeaadcf70015 [id=1801052116d047eea2541b61ab8430f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.849301 17198 ts_tablet_manager.cc:1950] T 86b1873446154249a80fa67b99496545 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.849390 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1648f727b0994f01bb6badc92472351c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.849615 14946 tablet_service.cc:1505] Processing CreateTablet for tablet 1648f727b0994f01bb6badc92472351c (DEFAULT_TABLE table=default.Table_bcf26fc494eb47ffbdecbeaadcf70015 [id=1801052116d047eea2541b61ab8430f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.849728 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 170) took 1329 ms. Trace:
I20251025 08:02:34.849771 17198 rpcz_store.cc:276] 1025 08:02:33.519815 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.538394 (+ 18579us) service_pool.cc:225] Handling call
1025 08:02:34.748824 (+1210430us) ts_tablet_manager.cc:1151] Deleting tablet 86b1873446154249a80fa67b99496545
1025 08:02:34.748831 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.847951 (+ 99120us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.848915 (+ 964us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.849717 (+ 802us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1209106}
I20251025 08:02:34.849974 17198 tablet_replica.cc:333] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.849980 15224 tablet_service.cc:1505] Processing CreateTablet for tablet fb798a7e37434ec49c10ebcd7629be89 (DEFAULT_TABLE table=default.Table_c6019b486de543f29a1350bf7a073b96 [id=f2d5588e0383495fb7ac2ce8747c6f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.850096 17198 raft_consensus.cc:2243] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.850164 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb798a7e37434ec49c10ebcd7629be89. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.851197 14946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1648f727b0994f01bb6badc92472351c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.850342 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 2fde39be14794d8680c332bb05c59292 (DEFAULT_TABLE table=default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.851632 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fde39be14794d8680c332bb05c59292. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.851851 17194 tablet_replica.cc:333] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.851951 17194 raft_consensus.cc:2243] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.852118 17194 raft_consensus.cc:2272] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.852475 17194 ts_tablet_manager.cc:1916] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.853170 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fde39be14794d8680c332bb05c59292. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.854576 17194 ts_tablet_manager.cc:1929] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.854635 17194 log.cc:1199] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/bf34039d909949af9357299bf8204891
I20251025 08:02:34.854846 17194 ts_tablet_manager.cc:1950] T bf34039d909949af9357299bf8204891 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.854960 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c994b9b0fa3d46b9bb4c01610437972c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.855080 17203 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "e51a2be794f04642b89386067ecbc77e" instance_seqno: 1761379342456414) as {username='slave'} at 127.14.70.2:42275; Asking this server to re-register.
I20251025 08:02:34.855301 17194 tablet_replica.cc:333] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.855424 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb798a7e37434ec49c10ebcd7629be89. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.856050 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet bf34039d909949af9357299bf8204891 (table default.Table_0762822d85ed47bc93809bd77c712935 [id=1e0739ca3fad4a22893a3453c3b2eac8]) successfully deleted
I20251025 08:02:34.855428 17194 raft_consensus.cc:2243] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.856251 17204 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" instance_seqno: 1761379342300428) as {username='slave'} at 127.14.70.1:46963; Asking this server to re-register.
I20251025 08:02:34.856417 17194 raft_consensus.cc:2272] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.856602 17798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 4 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:34.856709 17798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:34.856792 17798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94a96657c5fd49398b88e9ad615bfe1e. Latest consensus state: current_term: 4 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:34.856853 17798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:34.856925 17798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:34.856981 17798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 33b7e3c702ec44079d8b76a0ce6bae97 [sys.catalog]: This master's current role is: FOLLOWER
I20251025 08:02:34.857223 17194 ts_tablet_manager.cc:1916] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.859170 15027 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:34.859700 15162 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:34.861780 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 61c8a83c2146418184842b7d7dd594fa (DEFAULT_TABLE table=default.Table_d80d24fe6db14f0da8149898449ae86e [id=2283253a9522485d93d6c484c5eef6e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.861991 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61c8a83c2146418184842b7d7dd594fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.862968 17194 ts_tablet_manager.cc:1929] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.863086 17194 log.cc:1199] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/f65b1ad4764a4ed3a33baccaf278f043
I20251025 08:02:34.863346 17194 ts_tablet_manager.cc:1950] T f65b1ad4764a4ed3a33baccaf278f043 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.864773 16390 tablet_bootstrap.cc:492] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.864900 16390 ts_tablet_manager.cc:1403] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.098s user 0.001s sys 0.000s
I20251025 08:02:34.865406 16390 raft_consensus.cc:359] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.866662 16390 raft_consensus.cc:385] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.866748 16390 raft_consensus.cc:740] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.866920 16390 consensus_queue.cc:260] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.868978 17372 raft_consensus.cc:493] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.869046 17372 raft_consensus.cc:515] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.869303 17372 leader_election.cc:290] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.869918 16391 tablet_bootstrap.cc:492] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.870018 16391 ts_tablet_manager.cc:1403] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.000s
I20251025 08:02:34.870102 17620 tablet.cc:1722] T 3cac2ac7463944549b5d235ed2e5a480 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.870429 16391 raft_consensus.cc:359] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.870507 16391 raft_consensus.cc:385] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.870530 16391 raft_consensus.cc:740] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.870620 16391 consensus_queue.cc:260] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.870836 16391 ts_tablet_manager.cc:1434] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.871052 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6243825ae7b4307b5789aaee2473edc" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
W20251025 08:02:34.871861 15185 leader_election.cc:343] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.872138 17765 tablet.cc:1722] T 3cac2ac7463944549b5d235ed2e5a480 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.872473 16390 ts_tablet_manager.cc:1434] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20251025 08:02:34.872903 16390 tablet_bootstrap.cc:492] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.874255 16390 tablet_bootstrap.cc:654] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.874348 17204 ts_manager.cc:194] Registered new tserver with Master: ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
I20251025 08:02:34.875767 17566 tablet.cc:1722] T 3cac2ac7463944549b5d235ed2e5a480 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.875818 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6243825ae7b4307b5789aaee2473edc" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:34.876118 15183 leader_election.cc:343] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.876175 15183 leader_election.cc:304] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:34.876387 17316 raft_consensus.cc:2749] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.876629 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae883acfacf451495ae73e1e813ec71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.877125 17204 ts_manager.cc:194] Registered new tserver with Master: e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.877476 17194 tablet_replica.cc:333] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.877594 17194 raft_consensus.cc:2243] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.877668 17194 raft_consensus.cc:2272] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.877940 17194 ts_tablet_manager.cc:1916] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.878252 17537 raft_consensus.cc:493] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.878316 17537 raft_consensus.cc:515] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.878602 17537 leader_election.cc:290] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.878950 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2bc1c43a4724406a9e2cc2c8cb72bec" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.879017 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2bc1c43a4724406a9e2cc2c8cb72bec" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:34.879295 15049 leader_election.cc:343] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:34.879369 15048 leader_election.cc:343] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.879446 17198 raft_consensus.cc:2272] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.879487 15048 leader_election.cc:304] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.879688 17537 raft_consensus.cc:2749] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.879756 17194 ts_tablet_manager.cc:1929] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.879810 17194 log.cc:1199] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/9bb5b825be9a44d489151239947d471e
I20251025 08:02:34.879830 17198 ts_tablet_manager.cc:1916] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.880044 17194 ts_tablet_manager.cc:1950] T 9bb5b825be9a44d489151239947d471e P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.880518 17194 tablet_replica.cc:333] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.880622 17194 raft_consensus.cc:2243] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.880693 17194 raft_consensus.cc:2272] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.880935 17194 ts_tablet_manager.cc:1916] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.881040 17204 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" instance_seqno: 1761379342623763) as {username='slave'} at 127.14.70.3:39853; Asking this server to re-register.
I20251025 08:02:34.881867 17198 ts_tablet_manager.cc:1929] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.881925 17198 log.cc:1199] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/b4d1c652b6a4420a81e03cd58c6dbc69
I20251025 08:02:34.882185 17198 ts_tablet_manager.cc:1950] T b4d1c652b6a4420a81e03cd58c6dbc69 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.884229 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet f65b1ad4764a4ed3a33baccaf278f043 (table default.Table_b074f35366374acd92bf7528094773a0 [id=afe8a5e6aa824ba69530f71c2b2d4617]) successfully deleted
I20251025 08:02:34.884409 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 9bb5b825be9a44d489151239947d471e (table default.Table_f84103a22819458c976f0d1ca4716b47 [id=fe4920e7d4f143388063f22590eb2f64]) successfully deleted
W20251025 08:02:34.884510 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet bce04638a32443bc853ae242c6651ac5 because the tablet was not found. No further retry: Not found: Tablet not found: bce04638a32443bc853ae242c6651ac5
I20251025 08:02:34.885033 16391 tablet_bootstrap.cc:492] T 2c614480578945839a6662bafc62726c P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.885694 16391 tablet_bootstrap.cc:654] T 2c614480578945839a6662bafc62726c P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.886047 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 6ae883acfacf451495ae73e1e813ec71 (DEFAULT_TABLE table=default.Table_197dba326ac544d29c90a004200413bc [id=26a6f00041d04924b3e8eb2b279b55de]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.886289 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ae883acfacf451495ae73e1e813ec71. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.886379 15075 tablet_service.cc:1505] Processing CreateTablet for tablet 2fde39be14794d8680c332bb05c59292 (DEFAULT_TABLE table=default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.886583 15075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fde39be14794d8680c332bb05c59292. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.886693 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 86b1873446154249a80fa67b99496545 (table default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]) successfully deleted
I20251025 08:02:34.886776 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 1648f727b0994f01bb6badc92472351c (DEFAULT_TABLE table=default.Table_bcf26fc494eb47ffbdecbeaadcf70015 [id=1801052116d047eea2541b61ab8430f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.886962 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1648f727b0994f01bb6badc92472351c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.888091 16283 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_ed7344a27c434dd1bb0d7b1b9e535254"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.888423 16283 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed7344a27c434dd1bb0d7b1b9e535254 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.888916 15081 tablet_service.cc:1505] Processing CreateTablet for tablet c994b9b0fa3d46b9bb4c01610437972c (DEFAULT_TABLE table=default.Table_08073379da334076bcc5503770a32982 [id=1ee33ee129d749d0bd7f26dc49fca0fe]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.889117 17194 ts_tablet_manager.cc:1929] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.889150 15081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c994b9b0fa3d46b9bb4c01610437972c. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.889251 17194 log.cc:1199] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/d116fbec0c6149938b8f6c19af9607af
I20251025 08:02:34.889511 17194 ts_tablet_manager.cc:1950] T d116fbec0c6149938b8f6c19af9607af P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.890048 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet d116fbec0c6149938b8f6c19af9607af (table default.Table_85ecb3ae3f1a4810b5abcb29f861e881 [id=c1cc91015b38477f93e56504bf700ffb]) successfully deleted
I20251025 08:02:34.890885 16391 tablet_bootstrap.cc:492] T 2c614480578945839a6662bafc62726c P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.890949 16391 ts_tablet_manager.cc:1403] T 2c614480578945839a6662bafc62726c P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20251025 08:02:34.890149 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_bede321c044c4ea69863df8a8e0928de"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:34.891172 15093 tablet_service.cc:1505] Processing CreateTablet for tablet fb798a7e37434ec49c10ebcd7629be89 (DEFAULT_TABLE table=default.Table_c6019b486de543f29a1350bf7a073b96 [id=f2d5588e0383495fb7ac2ce8747c6f3d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.891364 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb798a7e37434ec49c10ebcd7629be89. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.891324 16391 raft_consensus.cc:359] T 2c614480578945839a6662bafc62726c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.891400 16391 raft_consensus.cc:385] T 2c614480578945839a6662bafc62726c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20251025 08:02:34.891407 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bede321c044c4ea69863df8a8e0928de in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.891428 16391 raft_consensus.cc:740] T 2c614480578945839a6662bafc62726c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.891518 16391 consensus_queue.cc:260] T 2c614480578945839a6662bafc62726c P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.891835 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 1e248b8303b1498e96178d4e46ad691e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.891957 17258 tablet_replica.cc:333] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.892068 17258 raft_consensus.cc:2243] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.892131 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet 5027b80220e34f5f8e1e8e8479ec41f3 with delete_type TABLET_DATA_DELETED (replaced by tablet bce04638a32443bc853ae242c6651ac5) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.892151 17258 raft_consensus.cc:2272] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.892452 17258 ts_tablet_manager.cc:1916] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.892488 17194 tablet_replica.cc:333] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.892892 17194 raft_consensus.cc:2243] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.894443 17534 raft_consensus.cc:493] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.894515 17534 raft_consensus.cc:515] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.894801 17534 leader_election.cc:290] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.894917 15239 raft_consensus.cc:1275] T d049bf946c744664aba74d7a12fa4ff1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 2 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251025 08:02:34.895112 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91d9fca3965e4ff8bb0a50574ede0209" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.895196 17258 ts_tablet_manager.cc:1929] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.895267 17258 log.cc:1199] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/1e248b8303b1498e96178d4e46ad691e
I20251025 08:02:34.895437 17258 ts_tablet_manager.cc:1950] T 1e248b8303b1498e96178d4e46ad691e P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:34.895879 15049 leader_election.cc:343] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.896011 17258 tablet_replica.cc:333] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.896085 15297 heartbeater.cc:461] Registering TS with master...
I20251025 08:02:34.896118 17258 raft_consensus.cc:2243] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:34.896142 17765 tablet.cc:1722] T acb84bad2f75474faecd00432d187ccf P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.896231 17258 pending_rounds.cc:70] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 1 pending ops.
I20251025 08:02:34.896271 17258 pending_rounds.cc:77] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609835870068736 op_type: NO_OP noop_request { }
I20251025 08:02:34.896312 17258 raft_consensus.cc:2889] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:34.896358 17258 raft_consensus.cc:2272] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.896479 17534 consensus_queue.cc:1048] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20251025 08:02:34.897051 17258 ts_tablet_manager.cc:1916] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.897513 16391 ts_tablet_manager.cc:1434] T 2c614480578945839a6662bafc62726c P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s
I20251025 08:02:34.897722 16391 tablet_bootstrap.cc:492] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.898063 17566 tablet.cc:1722] T acb84bad2f75474faecd00432d187ccf P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.898523 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 1e248b8303b1498e96178d4e46ad691e (table default.Table_64c962f064d64350a1fb6d539603c572 [id=766dd62ef84b4e56a871fbb018560a9f]) successfully deleted
I20251025 08:02:34.898837 16391 tablet_bootstrap.cc:654] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.899170 17258 ts_tablet_manager.cc:1929] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.899261 17258 log.cc:1199] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/5027b80220e34f5f8e1e8e8479ec41f3
I20251025 08:02:34.899528 17258 ts_tablet_manager.cc:1950] T 5027b80220e34f5f8e1e8e8479ec41f3 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.899824 17194 raft_consensus.cc:2272] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.900157 17194 ts_tablet_manager.cc:1916] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.900310 17620 tablet.cc:1722] T acb84bad2f75474faecd00432d187ccf P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:34.901147 17415 raft_consensus.cc:493] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.901224 17415 raft_consensus.cc:515] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.901587 17415 leader_election.cc:290] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.901899 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f141107d4674690acd51e499bc4e208" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:34.902223 14914 leader_election.cc:343] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.902335 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 5027b80220e34f5f8e1e8e8479ec41f3 (table default.Table_2723d06acdad494093ca794f37a40c63 [id=ce13cf6cceec4f6bb1cb22d48b226256]) successfully deleted
I20251025 08:02:34.902923 17194 ts_tablet_manager.cc:1929] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:34.902984 17194 log.cc:1199] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/d81b65e094a34703ac47897d9bfa4c7c
I20251025 08:02:34.903203 17194 ts_tablet_manager.cc:1950] T d81b65e094a34703ac47897d9bfa4c7c P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.903676 17194 tablet_replica.cc:333] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.903793 17194 raft_consensus.cc:2243] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.903865 17194 raft_consensus.cc:2272] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.904196 17204 ts_manager.cc:194] Registered new tserver with Master: f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.904348 17194 ts_tablet_manager.cc:1916] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.905200 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet d81b65e094a34703ac47897d9bfa4c7c (table default.Table_e45046c48bb54111b38f009cc14efd2d [id=768625af4c474964ad2b502cf0b03fa7]) successfully deleted
I20251025 08:02:34.905642 16390 tablet_bootstrap.cc:492] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.905751 16390 ts_tablet_manager.cc:1403] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.033s user 0.000s sys 0.002s
I20251025 08:02:34.906507 16390 raft_consensus.cc:359] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.906647 16390 raft_consensus.cc:385] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.906709 16390 raft_consensus.cc:740] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.906868 16390 consensus_queue.cc:260] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.907225 16390 ts_tablet_manager.cc:1434] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:34.907428 16390 tablet_bootstrap.cc:492] T 879ae11ae94b4d2eab76c1dc74e160ca P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.908353 16390 tablet_bootstrap.cc:654] T 879ae11ae94b4d2eab76c1dc74e160ca P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.908526 16391 tablet_bootstrap.cc:492] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.908607 16391 ts_tablet_manager.cc:1403] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.001s
I20251025 08:02:34.909053 16391 raft_consensus.cc:359] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.909133 16391 raft_consensus.cc:385] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.909173 16391 raft_consensus.cc:740] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.909273 16391 consensus_queue.cc:260] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.909842 16391 ts_tablet_manager.cc:1434] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.909991 17194 ts_tablet_manager.cc:1929] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:34.910043 16391 tablet_bootstrap.cc:492] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.910432 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "91d9fca3965e4ff8bb0a50574ede0209" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.911540 16391 tablet_bootstrap.cc:654] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:34.913154 15048 leader_election.cc:343] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.913182 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f141107d4674690acd51e499bc4e208" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.913231 15048 leader_election.cc:304] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.913278 15107 raft_consensus.cc:2468] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:34.913466 17534 raft_consensus.cc:2749] T 91d9fca3965e4ff8bb0a50574ede0209 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:34.914013 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 171) took 1394 ms. Trace:
I20251025 08:02:34.914067 17198 rpcz_store.cc:276] 1025 08:02:33.519859 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.539660 (+ 19801us) service_pool.cc:225] Handling call
1025 08:02:34.849922 (+1310262us) ts_tablet_manager.cc:1151] Deleting tablet b4d1c652b6a4420a81e03cd58c6dbc69
1025 08:02:34.849930 (+ 8us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.880780 (+ 30850us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.881825 (+ 1045us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.914000 (+ 32175us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1310153}
I20251025 08:02:34.914332 17198 tablet_replica.cc:333] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.914466 17198 raft_consensus.cc:2243] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.914521 14915 leader_election.cc:304] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.914660 17198 raft_consensus.cc:2272] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.915056 17415 raft_consensus.cc:2804] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.915082 17198 ts_tablet_manager.cc:1916] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.915112 17415 raft_consensus.cc:493] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.915148 17415 raft_consensus.cc:3060] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.915966 17415 raft_consensus.cc:515] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.916288 17415 leader_election.cc:290] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.916615 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f141107d4674690acd51e499bc4e208" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:34.916841 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "0f141107d4674690acd51e499bc4e208" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:34.916934 15107 raft_consensus.cc:3060] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.917196 16390 tablet_bootstrap.cc:492] T 879ae11ae94b4d2eab76c1dc74e160ca P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.917268 16390 ts_tablet_manager.cc:1403] T 879ae11ae94b4d2eab76c1dc74e160ca P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.000s
I20251025 08:02:34.917768 16390 raft_consensus.cc:359] T 879ae11ae94b4d2eab76c1dc74e160ca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.917840 15107 raft_consensus.cc:2468] T 0f141107d4674690acd51e499bc4e208 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:34.917862 16390 raft_consensus.cc:385] T 879ae11ae94b4d2eab76c1dc74e160ca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.917892 16390 raft_consensus.cc:740] T 879ae11ae94b4d2eab76c1dc74e160ca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.917985 16390 consensus_queue.cc:260] T 879ae11ae94b4d2eab76c1dc74e160ca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.918094 14915 leader_election.cc:304] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
W20251025 08:02:34.918299 14914 leader_election.cc:343] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.918344 16281 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet 38027ebb8a9e41418a412a53c7089cda
I20251025 08:02:34.918396 17415 raft_consensus.cc:2804] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.918471 17415 raft_consensus.cc:697] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:34.918581 17415 consensus_queue.cc:237] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.918828 16390 ts_tablet_manager.cc:1434] T 879ae11ae94b4d2eab76c1dc74e160ca P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:34.918982 16390 tablet_bootstrap.cc:492] T ea8a95b8fbf94520a2c219755cdc5d14 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.919911 16390 tablet_bootstrap.cc:654] T ea8a95b8fbf94520a2c219755cdc5d14 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.919993 16279 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet de53385f417d4e5eb34ab4537a9b638b
I20251025 08:02:34.920256 16279 catalog_manager.cc:6719] ReplaceTablet: tablet de53385f417d4e5eb34ab4537a9b638b deleted and replaced by tablet 588db918e8e440bdad7760e2968a15ba
I20251025 08:02:34.920439 16279 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_6c9870e0994744ba98aace68eba418f6" } new_table_name: "default.Table_d070a0d03864436c92b946479583f5ab" modify_external_catalogs: true
I20251025 08:02:34.921494 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_cd4d0d317d9545dea2ccad733022d6b2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:34.921800 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd4d0d317d9545dea2ccad733022d6b2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:34.922592 16286 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_ec80f327b59748efb9f7d1b60f08cd7c" } modify_external_catalogs: true
I20251025 08:02:34.922674 16286 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_ec80f327b59748efb9f7d1b60f08cd7c" } modify_external_catalogs: true
I20251025 08:02:34.923339 16284 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 95c9778bd0d94542bec79e9d36c6ce46
I20251025 08:02:34.923555 16284 catalog_manager.cc:6719] ReplaceTablet: tablet 95c9778bd0d94542bec79e9d36c6ce46 deleted and replaced by tablet a5b74e3cdd714975969dee9c0881c5fe
I20251025 08:02:34.923676 16284 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_79b8c7e1c9d84aa3ab5af10d4734f6ef" } modify_external_catalogs: true
I20251025 08:02:34.923743 16284 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_79b8c7e1c9d84aa3ab5af10d4734f6ef" } modify_external_catalogs: true
I20251025 08:02:34.928288 16391 tablet_bootstrap.cc:492] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:34.928364 16391 ts_tablet_manager.cc:1403] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.000s
I20251025 08:02:34.928826 16391 raft_consensus.cc:359] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.928918 16391 raft_consensus.cc:385] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.928949 16391 raft_consensus.cc:740] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.929061 16391 consensus_queue.cc:260] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.929323 16391 ts_tablet_manager.cc:1434] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:34.929472 16391 tablet_bootstrap.cc:492] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:34.929988 15223 tablet_service.cc:1552] Processing DeleteTablet for tablet de53385f417d4e5eb34ab4537a9b638b with delete_type TABLET_DATA_DELETED (replaced by tablet 588db918e8e440bdad7760e2968a15ba) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.930038 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 95c9778bd0d94542bec79e9d36c6ce46 with delete_type TABLET_DATA_DELETED (replaced by tablet a5b74e3cdd714975969dee9c0881c5fe) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:34.930502 16391 tablet_bootstrap.cc:654] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.932255 14956 tablet_service.cc:1552] Processing DeleteTablet for tablet de53385f417d4e5eb34ab4537a9b638b with delete_type TABLET_DATA_DELETED (replaced by tablet 588db918e8e440bdad7760e2968a15ba) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.932411 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet 95c9778bd0d94542bec79e9d36c6ce46 with delete_type TABLET_DATA_DELETED (replaced by tablet a5b74e3cdd714975969dee9c0881c5fe) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:34.933002 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet b4d1c652b6a4420a81e03cd58c6dbc69 (table default.Table_c2e0c935fdb34bc38f482cac268ad080 [id=62e3c831964e4f71a8ee6aca23069b44]) successfully deleted
I20251025 08:02:34.933677 17258 tablet_replica.cc:333] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:34.933784 17258 raft_consensus.cc:2243] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
W20251025 08:02:34.933832 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet de53385f417d4e5eb34ab4537a9b638b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de53385f417d4e5eb34ab4537a9b638b already in progress: creating tablet
I20251025 08:02:34.933863 17258 raft_consensus.cc:2272] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.934116 17258 ts_tablet_manager.cc:1916] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.936084 17372 raft_consensus.cc:493] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.936189 17258 ts_tablet_manager.cc:1929] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:34.936260 17258 log.cc:1199] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/95c9778bd0d94542bec79e9d36c6ce46
I20251025 08:02:34.936163 17372 raft_consensus.cc:515] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.936506 17258 ts_tablet_manager.cc:1950] T 95c9778bd0d94542bec79e9d36c6ce46 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:34.936625 17372 leader_election.cc:290] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.936954 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c614480578945839a6662bafc62726c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.937069 15107 raft_consensus.cc:2468] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:34.937345 15185 leader_election.cc:304] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.937842 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 95c9778bd0d94542bec79e9d36c6ce46 (table default.Table_754e539219a14fbba92f1f3fe54b0f2e [id=3e1281c3f28346a4a1dd2c4fcc990a2e]) successfully deleted
I20251025 08:02:34.938050 17372 raft_consensus.cc:2804] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.938102 17372 raft_consensus.cc:493] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.938139 17372 raft_consensus.cc:3060] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.938398 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet de53385f417d4e5eb34ab4537a9b638b with delete_type TABLET_DATA_DELETED (replaced by tablet 588db918e8e440bdad7760e2968a15ba) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.938741 15081 tablet_service.cc:1552] Processing DeleteTablet for tablet 95c9778bd0d94542bec79e9d36c6ce46 with delete_type TABLET_DATA_DELETED (replaced by tablet a5b74e3cdd714975969dee9c0881c5fe) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:34.939210 17372 raft_consensus.cc:515] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.939513 17372 leader_election.cc:290] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:34.939775 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c614480578945839a6662bafc62726c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.939877 14979 raft_consensus.cc:2468] T 2c614480578945839a6662bafc62726c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:34.940187 16390 tablet_bootstrap.cc:492] T ea8a95b8fbf94520a2c219755cdc5d14 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.940268 16390 ts_tablet_manager.cc:1403] T ea8a95b8fbf94520a2c219755cdc5d14 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.000s
I20251025 08:02:34.940675 16390 raft_consensus.cc:359] T ea8a95b8fbf94520a2c219755cdc5d14 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.940768 16390 raft_consensus.cc:385] T ea8a95b8fbf94520a2c219755cdc5d14 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.940800 16390 raft_consensus.cc:740] T ea8a95b8fbf94520a2c219755cdc5d14 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.940832 17799 mvcc.cc:204] Tried to move back new op lower bound from 7214609825438314496 to 7214609819441188864. Current Snapshot: MvccSnapshot[applied={T|T < 7214609825438314496 or (T in {7214609825438314496})}]
I20251025 08:02:34.940896 16390 consensus_queue.cc:260] T ea8a95b8fbf94520a2c219755cdc5d14 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.941169 16390 ts_tablet_manager.cc:1434] T ea8a95b8fbf94520a2c219755cdc5d14 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:34.941318 16390 tablet_bootstrap.cc:492] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.942157 16390 tablet_bootstrap.cc:654] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.942658 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c614480578945839a6662bafc62726c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:34.942749 15107 raft_consensus.cc:3060] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.943154 16390 tablet_bootstrap.cc:492] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:34.943220 16390 ts_tablet_manager.cc:1403] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:34.943627 15107 raft_consensus.cc:2468] T 2c614480578945839a6662bafc62726c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:34.943636 16390 raft_consensus.cc:359] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.943702 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "2c614480578945839a6662bafc62726c" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:34.943737 16390 raft_consensus.cc:385] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.943768 16390 raft_consensus.cc:740] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.943789 14979 raft_consensus.cc:3060] T 2c614480578945839a6662bafc62726c P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.943866 16390 consensus_queue.cc:260] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.944101 15185 leader_election.cc:304] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.944145 16390 ts_tablet_manager.cc:1434] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:34.944613 17316 raft_consensus.cc:2804] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.944681 17316 raft_consensus.cc:697] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:34.944756 14979 raft_consensus.cc:2468] T 2c614480578945839a6662bafc62726c P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:34.944777 17316 consensus_queue.cc:237] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.946709 17537 raft_consensus.cc:493] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f0f2f8ce3e9f4d9ba3f3f02813397c31)
I20251025 08:02:34.946780 17537 raft_consensus.cc:515] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } } peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } }
I20251025 08:02:34.947069 17537 leader_election.cc:290] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447), ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401)
W20251025 08:02:34.947916 15049 leader_election.cc:343] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Not found: Tablet not found: 0078dd6fb0e34d01a54889326dd6dfd7
I20251025 08:02:34.948010 14973 raft_consensus.cc:1275] T d049bf946c744664aba74d7a12fa4ff1 P ab02c9d78a9d42f193755d436c8d44b2 [term 2 FOLLOWER]: Refusing update from remote peer e51a2be794f04642b89386067ecbc77e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20251025 08:02:34.948441 16390 tablet_bootstrap.cc:492] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:34.949307 16390 tablet_bootstrap.cc:654] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:34.949414 15048 leader_election.cc:343] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 0078dd6fb0e34d01a54889326dd6dfd7
I20251025 08:02:34.949476 15048 leader_election.cc:304] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.949926 15642 consensus_queue.cc:1048] T d049bf946c744664aba74d7a12fa4ff1 P e51a2be794f04642b89386067ecbc77e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.950280 15642 raft_consensus.cc:2749] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20251025 08:02:34.951006 17274 tablet_bootstrap.cc:492] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.951089 17274 ts_tablet_manager.cc:1403] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.144s user 0.002s sys 0.000s
I20251025 08:02:34.951148 17415 consensus_queue.cc:1048] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.951481 17274 raft_consensus.cc:359] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.951567 17274 raft_consensus.cc:385] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.951607 17274 raft_consensus.cc:740] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.951711 17274 consensus_queue.cc:260] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.952445 17274 ts_tablet_manager.cc:1434] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.952580 17274 tablet_bootstrap.cc:492] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.953294 17274 tablet_bootstrap.cc:654] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.956465 17198 ts_tablet_manager.cc:1929] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:34.956578 17198 log.cc:1199] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/736f75f26af142e59e7996c2ebb80868
I20251025 08:02:34.910059 17194 log.cc:1199] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/3caafcc644e34ec1acc0d3741fd34721
I20251025 08:02:34.957085 17194 ts_tablet_manager.cc:1950] T 3caafcc644e34ec1acc0d3741fd34721 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:34.957933 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 3caafcc644e34ec1acc0d3741fd34721 (table default.Table_6c9870e0994744ba98aace68eba418f6 [id=984010acd02142579a16d6897862efb9]) successfully deleted
I20251025 08:02:34.958369 17534 raft_consensus.cc:493] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20251025 08:02:34.958447 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet de53385f417d4e5eb34ab4537a9b638b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet de53385f417d4e5eb34ab4537a9b638b already in progress: creating tablet
I20251025 08:02:34.958442 17534 raft_consensus.cc:515] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.958673 17194 tablet_replica.cc:333] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:34.958742 17534 leader_election.cc:290] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.958870 17194 raft_consensus.cc:2243] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.959002 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea8a95b8fbf94520a2c219755cdc5d14" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:34.959033 17194 raft_consensus.cc:2272] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.959112 15239 raft_consensus.cc:2468] T ea8a95b8fbf94520a2c219755cdc5d14 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:34.959391 15049 leader_election.cc:304] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.959546 17534 raft_consensus.cc:2804] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.959607 17534 raft_consensus.cc:493] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.959659 17534 raft_consensus.cc:3060] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.959760 17194 ts_tablet_manager.cc:1916] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.960595 17534 raft_consensus.cc:515] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.960911 17534 leader_election.cc:290] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.961036 17566 tablet.cc:1722] T 17e61bb1e9c94b949361b2ca152eb3d4 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:34.961347 14969 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea8a95b8fbf94520a2c219755cdc5d14" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:34.961460 14969 raft_consensus.cc:2468] T ea8a95b8fbf94520a2c219755cdc5d14 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:34.961648 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea8a95b8fbf94520a2c219755cdc5d14" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:34.961751 15249 raft_consensus.cc:3060] T ea8a95b8fbf94520a2c219755cdc5d14 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.961875 17198 ts_tablet_manager.cc:1950] T 736f75f26af142e59e7996c2ebb80868 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:34.962680 15249 raft_consensus.cc:2468] T ea8a95b8fbf94520a2c219755cdc5d14 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:34.962950 15049 leader_election.cc:304] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:34.963132 17765 tablet.cc:1722] T 17e61bb1e9c94b949361b2ca152eb3d4 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:34.963230 17537 raft_consensus.cc:2804] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.963299 17537 raft_consensus.cc:697] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:34.963416 17537 consensus_queue.cc:237] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.964819 14969 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "ea8a95b8fbf94520a2c219755cdc5d14" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:34.964918 14969 raft_consensus.cc:3060] T ea8a95b8fbf94520a2c219755cdc5d14 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.965823 14969 raft_consensus.cc:2468] T ea8a95b8fbf94520a2c219755cdc5d14 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:34.967818 17274 tablet_bootstrap.cc:492] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:34.967890 17274 ts_tablet_manager.cc:1403] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.000s
I20251025 08:02:34.968247 17274 raft_consensus.cc:359] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.968326 17274 raft_consensus.cc:385] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:34.968353 17274 raft_consensus.cc:740] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:34.968448 17274 consensus_queue.cc:260] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.968665 17274 ts_tablet_manager.cc:1434] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:34.968787 17274 tablet_bootstrap.cc:492] T 63085b146f03434b912d639b430a2cfe P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:34.969933 17274 tablet_bootstrap.cc:654] T 63085b146f03434b912d639b430a2cfe P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:34.975289 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 173) took 1069 ms. Trace:
I20251025 08:02:34.975387 17198 rpcz_store.cc:276] 1025 08:02:33.905353 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.905422 (+ 69us) service_pool.cc:225] Handling call
1025 08:02:34.914308 (+1008886us) ts_tablet_manager.cc:1151] Deleting tablet 736f75f26af142e59e7996c2ebb80868
1025 08:02:34.914314 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.916597 (+ 2283us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.956401 (+ 39804us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:34.975277 (+ 18876us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1002274}
I20251025 08:02:34.975723 17198 tablet_replica.cc:333] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:34.975732 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 736f75f26af142e59e7996c2ebb80868 (table default.Table_d77beb2fdfdd42e5b1a16072888cfcac [id=6a04bdbf8b9046c59dc87dd393367134]) successfully deleted
I20251025 08:02:34.975875 17198 raft_consensus.cc:2243] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:34.975997 17198 raft_consensus.cc:2272] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:34.976370 17198 ts_tablet_manager.cc:1916] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:34.982395 15224 tablet_service.cc:1505] Processing CreateTablet for tablet c28f755f85514675a07cef39d0e58622 (DEFAULT_TABLE table=default.Table_e0594fc0f0ec4d78b26142d30f694397 [id=e0b7215e76924c0796661680d7349b0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.982627 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28f755f85514675a07cef39d0e58622. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.982765 14940 tablet_service.cc:1505] Processing CreateTablet for tablet c28f755f85514675a07cef39d0e58622 (DEFAULT_TABLE table=default.Table_e0594fc0f0ec4d78b26142d30f694397 [id=e0b7215e76924c0796661680d7349b0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.982980 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28f755f85514675a07cef39d0e58622. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.983383 17731 consensus_queue.cc:1048] T c8bc7a0419e84a19a0349d0b7d63f174 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:34.988272 17731 raft_consensus.cc:493] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:34.988343 17731 raft_consensus.cc:515] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.988612 17731 leader_election.cc:290] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.989102 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2bc1c43a4724406a9e2cc2c8cb72bec" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:34.989435 14914 leader_election.cc:343] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:34.990540 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2bc1c43a4724406a9e2cc2c8cb72bec" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:34.990644 15103 raft_consensus.cc:2468] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:34.990825 14915 leader_election.cc:304] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:34.990998 17731 raft_consensus.cc:2804] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:34.991052 17731 raft_consensus.cc:493] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:34.991101 17731 raft_consensus.cc:3060] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.992007 17731 raft_consensus.cc:515] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.992300 17731 leader_election.cc:290] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:34.993629 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2bc1c43a4724406a9e2cc2c8cb72bec" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:34.993716 15103 raft_consensus.cc:3060] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:34.994369 17222 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36490 (request call id 0) took 3055 ms. Trace:
I20251025 08:02:34.994588 15103 raft_consensus.cc:2468] T f2bc1c43a4724406a9e2cc2c8cb72bec P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:34.995154 14915 leader_election.cc:304] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:34.995309 17731 raft_consensus.cc:2804] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:34.995373 17731 raft_consensus.cc:697] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:34.995477 17731 consensus_queue.cc:237] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:34.996181 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 9b9ff161e6034353a824cf8ab9489a73 (DEFAULT_TABLE table=default.Table_c2e0c935fdb34bc38f482cac268ad080 [id=62e3c831964e4f71a8ee6aca23069b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.996421 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9ff161e6034353a824cf8ab9489a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.996445 15224 tablet_service.cc:1505] Processing CreateTablet for tablet d10e9eaac6594a90876045e95710ecec (DEFAULT_TABLE table=default.Table_cd387a4e144d4b88921db554e1fd89da [id=7ea2a7735eb44b9597e8291b89f3994b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.996833 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 3dc1b610e8cd489fad12ca77d44b32f3 (DEFAULT_TABLE table=default.Table_7a1fe941fd114b82875d9b1b0ccb98e2 [id=ab675ac9c4de40c69dd7f12479c05d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.997238 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10e9eaac6594a90876045e95710ecec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.997910 14940 tablet_service.cc:1505] Processing CreateTablet for tablet d10e9eaac6594a90876045e95710ecec (DEFAULT_TABLE table=default.Table_cd387a4e144d4b88921db554e1fd89da [id=7ea2a7735eb44b9597e8291b89f3994b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.998108 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10e9eaac6594a90876045e95710ecec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.998277 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f2bc1c43a4724406a9e2cc2c8cb72bec" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:34.998574 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 3dc1b610e8cd489fad12ca77d44b32f3 (DEFAULT_TABLE table=default.Table_7a1fe941fd114b82875d9b1b0ccb98e2 [id=ab675ac9c4de40c69dd7f12479c05d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.994438 17222 rpcz_store.cc:276] 1025 08:02:31.938466 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:31.938908 (+ 442us) service_pool.cc:225] Handling call
1025 08:02:34.790143 (+2851235us) raft_consensus.cc:1471] Updating replica for 32 ops
1025 08:02:34.793089 (+ 2946us) raft_consensus.cc:1534] Early marking committed up to index 0
1025 08:02:34.793095 (+ 6us) raft_consensus.cc:1539] Triggering prepare for 32 ops
1025 08:02:34.793704 (+ 609us) write_op.cc:270] Start()
1025 08:02:34.793739 (+ 35us) write_op.cc:276] Timestamp: P: 1761379351387193 usec, L: 0
1025 08:02:34.794447 (+ 708us) write_op.cc:270] Start()
1025 08:02:34.794468 (+ 21us) write_op.cc:276] Timestamp: P: 1761379351387627 usec, L: 0
1025 08:02:34.794600 (+ 132us) write_op.cc:270] Start()
1025 08:02:34.794623 (+ 23us) write_op.cc:276] Timestamp: P: 1761379351399812 usec, L: 0
1025 08:02:34.794735 (+ 112us) write_op.cc:270] Start()
1025 08:02:34.794751 (+ 16us) write_op.cc:276] Timestamp: P: 1761379351400223 usec, L: 0
1025 08:02:34.794852 (+ 101us) write_op.cc:270] Start()
1025 08:02:34.794868 (+ 16us) write_op.cc:276] Timestamp: P: 1761379351400572 usec, L: 0
1025 08:02:34.794961 (+ 93us) write_op.cc:270] Start()
1025 08:02:34.794979 (+ 18us) write_op.cc:276] Timestamp: P: 1761379351404991 usec, L: 0
1025 08:02:34.795066 (+ 87us) write_op.cc:270] Start()
1025 08:02:34.795089 (+ 23us) write_op.cc:276] Timestamp: P: 1761379351405369 usec, L: 0
1025 08:02:34.795179 (+ 90us) write_op.cc:270] Start()
1025 08:02:34.795192 (+ 13us) write_op.cc:276] Timestamp: P: 1761379351407557 usec, L: 0
1025 08:02:34.795275 (+ 83us) write_op.cc:270] Start()
1025 08:02:34.795286 (+ 11us) write_op.cc:276] Timestamp: P: 1761379351431956 usec, L: 0
1025 08:02:34.795388 (+ 102us) write_op.cc:270] Start()
1025 08:02:34.795400 (+ 12us) write_op.cc:276] Timestamp: P: 1761379351439944 usec, L: 0
1025 08:02:34.795480 (+ 80us) write_op.cc:270] Start()
1025 08:02:34.795490 (+ 10us) write_op.cc:276] Timestamp: P: 1761379351441519 usec, L: 0
1025 08:02:34.795562 (+ 72us) write_op.cc:270] Start()
1025 08:02:34.795575 (+ 13us) write_op.cc:276] Timestamp: P: 1761379351529445 usec, L: 0
1025 08:02:34.795652 (+ 77us) write_op.cc:270] Start()
1025 08:02:34.795666 (+ 14us) write_op.cc:276] Timestamp: P: 1761379351570691 usec, L: 0
1025 08:02:34.795746 (+ 80us) write_op.cc:270] Start()
1025 08:02:34.795760 (+ 14us) write_op.cc:276] Timestamp: P: 1761379351599752 usec, L: 0
1025 08:02:34.795840 (+ 80us) write_op.cc:270] Start()
1025 08:02:34.795853 (+ 13us) write_op.cc:276] Timestamp: P: 1761379351651841 usec, L: 0
1025 08:02:34.795940 (+ 87us) write_op.cc:270] Start()
1025 08:02:34.795953 (+ 13us) write_op.cc:276] Timestamp: P: 1761379351652266 usec, L: 0
1025 08:02:34.796057 (+ 104us) write_op.cc:270] Start()
1025 08:02:34.796075 (+ 18us) write_op.cc:276] Timestamp: P: 1761379351661697 usec, L: 0
1025 08:02:34.796162 (+ 87us) write_op.cc:270] Start()
1025 08:02:34.796177 (+ 15us) write_op.cc:276] Timestamp: P: 1761379351669529 usec, L: 0
1025 08:02:34.796260 (+ 83us) write_op.cc:270] Start()
1025 08:02:34.796272 (+ 12us) write_op.cc:276] Timestamp: P: 1761379351687049 usec, L: 0
1025 08:02:34.850558 (+ 54286us) write_op.cc:270] Start()
1025 08:02:34.850590 (+ 32us) write_op.cc:276] Timestamp: P: 1761379351692091 usec, L: 0
1025 08:02:34.850776 (+ 186us) write_op.cc:270] Start()
1025 08:02:34.850797 (+ 21us) write_op.cc:276] Timestamp: P: 1761379351700940 usec, L: 0
1025 08:02:34.850918 (+ 121us) write_op.cc:270] Start()
1025 08:02:34.850937 (+ 19us) write_op.cc:276] Timestamp: P: 1761379351715416 usec, L: 0
1025 08:02:34.851027 (+ 90us) write_op.cc:270] Start()
1025 08:02:34.851043 (+ 16us) write_op.cc:276] Timestamp: P: 1761379351722509 usec, L: 0
1025 08:02:34.851144 (+ 101us) write_op.cc:270] Start()
1025 08:02:34.851159 (+ 15us) write_op.cc:276] Timestamp: P: 1761379351728167 usec, L: 0
1025 08:02:34.851262 (+ 103us) write_op.cc:270] Start()
1025 08:02:34.851277 (+ 15us) write_op.cc:276] Timestamp: P: 1761379351733435 usec, L: 0
1025 08:02:34.851354 (+ 77us) write_op.cc:270] Start()
1025 08:02:34.851366 (+ 12us) write_op.cc:276] Timestamp: P: 1761379351743317 usec, L: 0
1025 08:02:34.851461 (+ 95us) write_op.cc:270] Start()
1025 08:02:34.851475 (+ 14us) write_op.cc:276] Timestamp: P: 1761379351756975 usec, L: 0
1025 08:02:34.851563 (+ 88us) write_op.cc:270] Start()
1025 08:02:34.851573 (+ 10us) write_op.cc:276] Timestamp: P: 1761379351762490 usec, L: 0
1025 08:02:34.851631 (+ 58us) write_op.cc:270] Start()
1025 08:02:34.851640 (+ 9us) write_op.cc:276] Timestamp: P: 1761379351769056 usec, L: 0
1025 08:02:34.851695 (+ 55us) write_op.cc:270] Start()
1025 08:02:34.851704 (+ 9us) write_op.cc:276] Timestamp: P: 1761379351904552 usec, L: 0
1025 08:02:34.851761 (+ 57us) write_op.cc:270] Start()
1025 08:02:34.851772 (+ 11us) write_op.cc:276] Timestamp: P: 1761379351913651 usec, L: 0
1025 08:02:34.852684 (+ 912us) log.cc:844] Serialized 36952 byte log entry
1025 08:02:34.852949 (+ 265us) raft_consensus.cc:1645] Marking committed up to 733
1025 08:02:34.853095 (+ 146us) log.cc:844] Serialized 15 byte log entry
1025 08:02:34.853693 (+ 598us) raft_consensus.cc:1697] Filling consensus response to leader.
1025 08:02:34.853759 (+ 66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
1025 08:02:34.994271 (+140512us) raft_consensus.cc:1685] finished
1025 08:02:34.994273 (+ 2us) raft_consensus.cc:1691] UpdateReplicas() finished
1025 08:02:34.994355 (+ 82us) inbound_call.cc:173] Queueing success response
Related trace 'op':
1025 08:02:34.853326 (+ 0us) op_driver.cc:464] REPLICATION: finished
1025 08:02:34.864970 (+ 11644us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:34.865060 (+ 90us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:34.865066 (+ 6us) write_op.cc:435] Acquired schema lock
1025 08:02:34.865068 (+ 2us) tablet.cc:660] Decoding operations
1025 08:02:34.865142 (+ 74us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:34.865151 (+ 9us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:34.865154 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1025 08:02:34.865195 (+ 41us) tablet.cc:699] Row locks acquired
1025 08:02:34.865196 (+ 1us) write_op.cc:260] PREPARE: finished
1025 08:02:34.904994 (+ 39798us) write_op.cc:301] APPLY: starting
1025 08:02:34.905014 (+ 20us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:34.905269 (+ 255us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:34.905271 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:34.905345 (+ 74us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:34.905499 (+ 154us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
1025 08:02:34.905532 (+ 33us) write_op.cc:312] APPLY: finished
1025 08:02:34.905844 (+ 312us) log.cc:844] Serialized 29 byte log entry
1025 08:02:34.905951 (+ 107us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.905963 (+ 12us) write_op.cc:454] Released schema lock
1025 08:02:34.905970 (+ 7us) write_op.cc:341] FINISH: Updating metrics
1025 08:02:34.906101 (+ 131us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.906104 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
1025 08:02:34.853347 (+ 0us) op_driver.cc:464] REPLICATION: finished
1025 08:02:34.865391 (+ 12044us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:34.865464 (+ 73us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:34.865467 (+ 3us) write_op.cc:435] Acquired schema lock
1025 08:02:34.865468 (+ 1us) tablet.cc:660] Decoding operations
1025 08:02:34.865528 (+ 60us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:34.865549 (+ 21us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:34.865554 (+ 5us) tablet.cc:683] Acquiring locks for 2 operations
1025 08:02:34.865605 (+ 51us) tablet.cc:699] Row locks acquired
1025 08:02:34.865606 (+ 1us) write_op.cc:260] PREPARE: finished
1025 08:02:34.906224 (+ 40618us) write_op.cc:301] APPLY: starting
1025 08:02:34.906235 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:34.906254 (+ 19us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:34.906255 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:34.906292 (+ 37us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:34.906319 (+ 27us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
1025 08:02:34.906335 (+ 16us) write_op.cc:312] APPLY: finished
1025 08:02:34.906377 (+ 42us) log.cc:844] Serialized 29 byte log entry
1025 08:02:34.906417 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.906426 (+ 9us) write_op.cc:454] Released schema lock
1025 08:02:34.906429 (+ 3us) write_op.cc:341] FINISH: Updating metrics
1025 08:02:34.906474 (+ 45us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.906477 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
1025 08:02:34.853362 (+ 0us) op_driver.cc:464] REPLICATION: finished
1025 08:02:34.865762 (+ 12400us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:34.865823 (+ 61us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:34.865826 (+ 3us) write_op.cc:435] Acquired schema lock
1025 08:02:34.865828 (+ 2us) tablet.cc:660] Decoding operations
1025 08:02:34.865880 (+ 52us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:34.865887 (+ 7us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:34.865889 (+ 2us) tablet.cc:683] Acquiring locks for 2 operations
1025 08:02:34.865958 (+ 69us) tablet.cc:699] Row locks acquired
1025 08:02:34.865960 (+ 2us) write_op.cc:260] PREPARE: finished
1025 08:02:34.906519 (+ 40559us) write_op.cc:301] APPLY: starting
1025 08:02:34.906525 (+ 6us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:34.906542 (+ 17us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:34.906543 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:34.906576 (+ 33us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:34.906594 (+ 18us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
1025 08:02:34.906606 (+ 12us) write_op.cc:312] APPLY: finished
1025 08:02:34.906638 (+ 32us) log.cc:844] Serialized 29 byte log entry
1025 08:02:34.906663 (+ 25us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.906669 (+ 6us) write_op.cc:454] Released schema lock
1025 08:02:34.906672 (+ 3us) write_op.cc:341] FINISH: Updating metrics
1025 08:02:34.906700 (+ 28us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.906702 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
1025 08:02:34.853383 (+ 0us) op_driver.cc:464] REPLICATION: finished
1025 08:02:34.866110 (+ 12727us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:34.866175 (+ 65us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:34.866223 (+ 48us) write_op.cc:435] Acquired schema lock
1025 08:02:34.866226 (+ 3us) tablet.cc:660] Decoding operations
1025 08:02:34.866274 (+ 48us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:34.866282 (+ 8us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:34.866285 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
1025 08:02:34.866312 (+ 27us) tablet.cc:699] Row locks acquired
1025 08:02:34.866313 (+ 1us) write_op.cc:260] PREPARE: finished
1025 08:02:34.906733 (+ 40420us) write_op.cc:301] APPLY: starting
1025 08:02:34.906740 (+ 7us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:34.906752 (+ 12us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:34.906753 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:34.906770 (+ 17us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:34.906783 (+ 13us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
1025 08:02:34.906794 (+ 11us) write_op.cc:312] APPLY: finished
1025 08:02:34.906818 (+ 24us) log.cc:844] Serialized 23 byte log entry
1025 08:02:34.906840 (+ 22us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.906845 (+ 5us) write_op.cc:454] Released schema lock
1025 08:02:34.906848 (+ 3us) write_op.cc:341] FINISH: Updating metrics
1025 08:02:34.906874 (+ 26us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.906876 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
1025 08:02:34.853416 (+ 0us) op_driver.cc:464] REPLICATION: finished
1025 08:02:34.866455 (+ 13039us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:34.866519 (+ 64us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:34.866521 (+ 2us) write_op.cc:435] Acquired schema lock
1025 08:02:34.866523 (+ 2us) tablet.cc:660] Decoding operations
1025 08:02:34.867329 (+ 806us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:34.867348 (+ 19us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:34.867351 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1025 08:02:34.867387 (+ 36us) tablet.cc:699] Row locks acquired
1025 08:02:34.867388 (+ 1us) write_op.cc:260] PREPARE: finished
1025 08:02:34.906906 (+ 39518us) write_op.cc:301] APPLY: starting
1025 08:02:34.906912 (+ 6us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:34.906925 (+ 13us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:34.906927 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:34.907005 (+ 78us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:34.907022 (+ 17us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1025 08:02:34.907033 (+ 11us) write_op.cc:312] APPLY: finished
1025 08:02:34.907061 (+ 28us) log.cc:844] Serialized 29 byte log entry
1025 08:02:34.907085 (+ 24us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.907091 (+ 6us) write_op.cc:454] Released schema lock
1025 08:02:34.907094 (+ 3us) write_op.cc:341] FINISH: Updating metrics
1025 08:02:34.907127 (+ 33us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.907129 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
1025 08:02:34.853431 (+ 0us) op_driver.cc:464] REPLICATION: finished
1025 08:02:34.867440 (+ 14009us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:34.867494 (+ 54us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:34.867497 (+ 3us) write_op.cc:435] Acquired schema lock
1025 08:02:34.867498 (+ 1us) tablet.cc:660] Decoding operations
1025 08:02:34.867535 (+ 37us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:34.867540 (+ 5us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:34.867543 (+ 3us) tablet.cc:683] Acquiring locks for 1 operations
1025 08:02:34.867564 (+ 21us) tablet.cc:699] Row locks acquired
1025 08:02:34.867565 (+ 1us) write_op.cc:260] PREPARE: finished
1025 08:02:34.907163 (+ 39598us) write_op.cc:301] APPLY: starting
1025 08:02:34.907169 (+ 6us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:34.907182 (+ 13us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:34.907184 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:34.907200 (+ 16us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:34.907221 (+ 21us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
1025 08:02:34.907255 (+ 34us) write_op.cc:312] APPLY: finished
1025 08:02:34.907282 (+ 27us) log.cc:844] Serialized 23 byte log entry
1025 08:02:34.907305 (+ 23us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.907310 (+ 5us) write_op.cc:454] Released schema lock
1025 08:02:34.907313 (+ 3us) write_op.cc:341] FINISH: Updating metrics
1025 08:02:34.907339 (+ 26us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.907341 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
1025 08:02:34.853442 (+ 0us) op_driver.cc:464] REPLICATION: finished
1025 08:02:34.867606 (+ 14164us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:34.867651 (+ 45us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:34.867653 (+ 2us) write_op.cc:435] Acquired schema lock
1025 08:02:34.867654 (+ 1us) tablet.cc:660] Decoding operations
1025 08:02:34.867687 (+ 33us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:34.867692 (+ 5us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:34.867695 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1025 08:02:34.867722 (+ 27us) tablet.cc:699] Row locks acquired
1025 08:02:34.867723 (+ 1us) write_op.cc:260] PREPARE: finished
1025 08:02:34.907371 (+ 39648us) write_op.cc:301] APPLY: starting
1025 08:02:34.907377 (+ 6us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:34.907390 (+ 13us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:34.907392 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:34.907434 (+ 42us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:34.907450 (+ 16us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
1025 08:02:34.907460 (+ 10us) write_op.cc:312] APPLY: finished
1025 08:02:34.907485 (+ 25us) log.cc:844] Serialized 29 byte log entry
1025 08:02:34.907506 (+ 21us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.907512 (+ 6us) write_op.cc:454] Released schema lock
1025 08:02:34.907515 (+ 3us) write_op.cc:341] FINISH: Updating metrics
1025 08:02:34.907542 (+ 27us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.907544 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
1025 08:02:34.853454 (+ 0us) op_driver.cc:464] REPLICATION: finished
1025 08:02:34.867764 (+ 14310us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:34.867809 (+ 45us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:34.867811 (+ 2us) write_op.cc:435] Acquired schema lock
1025 08:02:34.867812 (+ 1us) tablet.cc:660] Decoding operations
1025 08:02:34.867861 (+ 49us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:34.867866 (+ 5us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:34.867869 (+ 3us) tablet.cc:683] Acquiring locks for 3 operations
1025 08:02:34.867901 (+ 32us) tablet.cc:699] Row locks acquired
1025 08:02:34.867903 (+ 2us) write_op.cc:260] PREPARE: finished
1025 08:02:34.907576 (+ 39673us) write_op.cc:301] APPLY: starting
1025 08:02:34.907581 (+ 5us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:34.907600 (+ 19us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:34.907601 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:34.907633 (+ 32us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:34.907649 (+ 16us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
1025 08:02:34.907660 (+ 11us) write_op.cc:312] APPLY: finished
1025 08:02:34.907689 (+ 29us) log.cc:844] Serialized 35 byte log entry
1025 08:02:34.907711 (+ 22us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.907727 (+ 16us) write_op.cc:454] Released schema lock
1025 08:02:34.907730 (+ 3us) write_op.cc:341] FINISH: Updating metrics
1025 08:02:34.907756 (+ 26us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.907759 (+ 3us) write_op.cc:454] Released schema lock
Related trace 'op':
1025 08:02:34.853464 (+ 0us) op_driver.cc:464] REPLICATION: finished
1025 08:02:34.867942 (+ 14478us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:34.867987 (+ 45us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:34.867990 (+ 3us) write_op.cc:435] Acquired schema lock
1025 08:02:34.867991 (+ 1us) tablet.cc:660] Decoding operations
1025 08:02:34.868028 (+ 37us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:34.868033 (+ 5us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:34.868035 (+ 2us) tablet.cc:683] Acquiring locks for 2 operations
1025 08:02:34.868083 (+ 48us) tablet.cc:699] Row locks acquired
1025 08:02:34.868084 (+ 1us) write_op.cc:260] PREPARE: finished
1025 08:02:34.907791 (+ 39707us) write_op.cc:301] APPLY: starting
1025 08:02:34.907797 (+ 6us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:34.907811 (+ 14us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:34.907812 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:34.907837 (+ 25us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:34.907852 (+ 15us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
1025 08:02:34.907863 (+ 11us) write_op.cc:312] APPLY: finished
1025 08:02:34.907889 (+ 26us) log.cc:844] Serialized 29 byte log entry
1025 08:02:34.907911 (+ 22us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.907917 (+ 6us) write_op.cc:454] Released schema lock
1025 08:02:34.907920 (+ 3us) write_op.cc:341] FINISH: Updating metrics
1025 08:02:34.907945 (+ 25us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.907947 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
1025 08:02:34.853474 (+ 0us) op_driver.cc:464] REPLICATION: finished
1025 08:02:34.868136 (+ 14662us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:34.868186 (+ 50us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:34.868188 (+ 2us) write_op.cc:435] Acquired schema lock
1025 08:02:34.868190 (+ 2us) tablet.cc:660] Decoding operations
1025 08:02:34.868239 (+ 49us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:34.868245 (+ 6us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:34.868247 (+ 2us) tablet.cc:683] Acquiring locks for 2 operations
1025 08:02:34.868281 (+ 34us) tablet.cc:699] Row locks acquired
1025 08:02:34.868282 (+ 1us) write_op.cc:260] PREPARE: finished
1025 08:02:34.907980 (+ 39698us) write_op.cc:301] APPLY: starting
1025 08:02:34.907986 (+ 6us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:34.908000 (+ 14us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:34.908001 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:34.908022 (+ 21us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:34.908037 (+ 15us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
1025 08:02:34.908047 (+ 10us) write_op.cc:312] APPLY: finished
1025 08:02:34.908072 (+ 25us) log.cc:844] Serialized 29 byte log entry
1025 08:02:34.908093 (+ 21us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.908098 (+ 5us) write_op.cc:454] Released schema lock
1025 08:02:34.908101 (+ 3us) write_op.cc:341] FINISH: Updating metrics
1025 08:02:34.908126 (+ 25us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.908128 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
1025 08:02:34.853485 (+ 0us) op_driver.cc:464] REPLICATION: finished
1025 08:02:34.868335 (+ 14850us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:34.868391 (+ 56us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:34.868394 (+ 3us) write_op.cc:435] Acquired schema lock
1025 08:02:34.868395 (+ 1us) tablet.cc:660] Decoding operations
1025 08:02:34.868439 (+ 44us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:34.868446 (+ 7us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:34.868449 (+ 3us) tablet.cc:683] Acquiring locks for 2 operations
1025 08:02:34.908171 (+ 39722us) tablet.cc:699] Row locks acquired
1025 08:02:34.908173 (+ 2us) write_op.cc:260] PREPARE: finished
1025 08:02:34.911503 (+ 3330us) write_op.cc:301] APPLY: starting
1025 08:02:34.911514 (+ 11us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:34.911536 (+ 22us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:34.911537 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:34.911577 (+ 40us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:34.911598 (+ 21us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
1025 08:02:34.911614 (+ 16us) write_op.cc:312] APPLY: finished
1025 08:02:34.911656 (+ 42us) log.cc:844] Serialized 29 byte log entry
1025 08:02:34.911692 (+ 36us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.911701 (+ 9us) write_op.cc:454] Released schema lock
1025 08:02:34.911707 (+ 6us) write_op.cc:341] FINISH: Updating metrics
1025 08:02:34.911747 (+ 40us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.911749 (+ 2us) write_op.cc:454] Released schema lock
Related trace 'op':
1025 08:02:34.853495 (+ 0us) op_driver.cc:464] REPLICATION: finished
1025 08:02:34.908239 (+ 54744us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:34.908315 (+ 76us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:34.908318 (+ 3us) write_op.cc:435] Acquired schema lock
1025 08:02:34.908319 (+ 1us) tablet.cc:660] Decoding operations
1025 08:02:34.908371 (+ 52us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:34.908378 (+ 7us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:34.908380 (+ 2us) tablet.cc:683] Acquiring locks for 1 operations
1025 08:02:34.908411 (+ 31us) tablet.cc:699] Row locks acquired
1025 08:02:34.908412 (+ 1us) write_op.cc:260] PREPARE: finished
1025 08:02:34.911788 (+ 3376us) write_op.cc:301] APPLY: starting
1025 08:02:34.911796 (+ 8us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:34.911814 (+ 18us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:34.911815 (+ 1us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:34.911838 (+ 23us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:34.911860 (+ 22us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
1025 08:02:34.911876 (+ 16us) write_op.cc:312] APPLY: finished
1025 08:02:34.911907 (+ 31us) log.cc:844] Serialized 23 byte log entry
1025 08:02:34.911933 (+ 26us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.911940 (+ 7us) write_op.cc:454] Released schema lock
1025 08:02:34.911944 (+ 4us) write_op.cc:341] FINISH: Updating metrics
1025 08:02:34.911982 (+ 38us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:02:34.911987 (+ 5us) write_op.cc:454] Released schema lock
Related trace 'op':
1025 08:02:34.853505 (+ 0us) op_driver.cc:464] REPLICATION: finished
1025 08:02:34.908459 (+ 54954us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
1025 08:02:34.908511 (+ 52us) write_op.cc:432] Acquiring schema lock in shared mode
1025 08:02:34.908513 (+ 2us) write_op.cc:435] Acquired schema lock
1025 08:02:34.908514 (+ 1us) tablet.cc:660] Decoding operations
1025 08:02:34.908740 (+ 226us) write_op.cc:620] Acquiring the partition lock for write op
1025 08:02:34.908747 (+ 7us) write_op.cc:641] Partition lock acquired for write op
1025 08:02:34.908750 (+ 3us) tablet.cc:683] Acquiring locks for 36 operations
1025 08:02:34.909065 (+ 315us) tablet.cc:699] Row locks acquired
1025 08:02:34.909067 (+ 2us) write_op.cc:260] PREPARE: finished
1025 08:02:34.912028 (+ 2961us) write_op.cc:301] APPLY: starting
1025 08:02:34.912038 (+ 10us) tablet.cc:1365] starting BulkCheckPresence
1025 08:02:34.912104 (+ 66us) tablet.cc:1368] finished BulkCheckPresence
1025 08:02:34.912106 (+ 2us) tablet.cc:1370] starting ApplyRowOperation cycle
1025 08:02:34.913632 (+ 1526us) tablet.cc:1381] finished ApplyRowOperation cycle
1025 08:02:34.913679 (+ 47us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=36
1025 08:02:34.913683 (+ 4us) write_op.cc:312] APPLY: finished
1025 08:02:34.913772 (+ 89us) log.cc:844] Serialized 236 byte log entry
1025 08:02:34.913802 (+ 30us) write_op.cc:489] Releasing partition, row and schema locks
1025 08:
I20251025 08:02:34.998802 14947 tablet_service.cc:1505] Processing CreateTablet for tablet b8e01602e0ec49358a259eb82ac9fd9b (DEFAULT_TABLE table=default.Table_2d23a19b70fe485986083303286874fa [id=692a311f7f26405b9318b2413517be77]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.998914 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc1b610e8cd489fad12ca77d44b32f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.999043 15218 tablet_service.cc:1505] Processing CreateTablet for tablet b8e01602e0ec49358a259eb82ac9fd9b (DEFAULT_TABLE table=default.Table_2d23a19b70fe485986083303286874fa [id=692a311f7f26405b9318b2413517be77]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:34.999245 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e01602e0ec49358a259eb82ac9fd9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:34.999356 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 9b9ff161e6034353a824cf8ab9489a73 (DEFAULT_TABLE table=default.Table_c2e0c935fdb34bc38f482cac268ad080 [id=62e3c831964e4f71a8ee6aca23069b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.001436 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e01602e0ec49358a259eb82ac9fd9b. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:35.002632 14914 leader_election.cc:343] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.003410 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc1b610e8cd489fad12ca77d44b32f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.003444 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9ff161e6034353a824cf8ab9489a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.003978 15081 tablet_service.cc:1505] Processing CreateTablet for tablet c28f755f85514675a07cef39d0e58622 (DEFAULT_TABLE table=default.Table_e0594fc0f0ec4d78b26142d30f694397 [id=e0b7215e76924c0796661680d7349b0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.004180 15081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28f755f85514675a07cef39d0e58622. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.006328 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 9b9ff161e6034353a824cf8ab9489a73 (DEFAULT_TABLE table=default.Table_c2e0c935fdb34bc38f482cac268ad080 [id=62e3c831964e4f71a8ee6aca23069b44]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.006532 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 3dc1b610e8cd489fad12ca77d44b32f3 (DEFAULT_TABLE table=default.Table_7a1fe941fd114b82875d9b1b0ccb98e2 [id=ab675ac9c4de40c69dd7f12479c05d15]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.006141 15093 tablet_service.cc:1505] Processing CreateTablet for tablet d10e9eaac6594a90876045e95710ecec (DEFAULT_TABLE table=default.Table_cd387a4e144d4b88921db554e1fd89da [id=7ea2a7735eb44b9597e8291b89f3994b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.006590 17620 tablet.cc:1722] T 17e61bb1e9c94b949361b2ca152eb3d4 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:35.006742 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b9ff161e6034353a824cf8ab9489a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.008692 16390 tablet_bootstrap.cc:492] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:35.008777 16390 ts_tablet_manager.cc:1403] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.000s
I20251025 08:02:35.009186 16390 raft_consensus.cc:359] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.009280 16390 raft_consensus.cc:385] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.009313 16390 raft_consensus.cc:740] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.009434 16390 consensus_queue.cc:260] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.009511 17194 ts_tablet_manager.cc:1929] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:35.009562 17194 log.cc:1199] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/95c9778bd0d94542bec79e9d36c6ce46
I20251025 08:02:35.009742 16390 ts_tablet_manager.cc:1434] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.009788 17194 ts_tablet_manager.cc:1950] T 95c9778bd0d94542bec79e9d36c6ce46 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:35.009914 16390 tablet_bootstrap.cc:492] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:35.010950 16390 tablet_bootstrap.cc:654] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.011950 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 95c9778bd0d94542bec79e9d36c6ce46 (table default.Table_754e539219a14fbba92f1f3fe54b0f2e [id=3e1281c3f28346a4a1dd2c4fcc990a2e]) successfully deleted
I20251025 08:02:35.012037 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3dc1b610e8cd489fad12ca77d44b32f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.013070 17595 consensus_queue.cc:1048] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:35.014303 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10e9eaac6594a90876045e95710ecec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.014384 17181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "94a96657c5fd49398b88e9ad615bfe1e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94a96657c5fd49398b88e9ad615bfe1e" member_type: VOTER last_known_addr { host: "127.14.70.62" port: 39499 } } peers { permanent_uuid: "33b7e3c702ec44079d8b76a0ce6bae97" member_type: VOTER last_known_addr { host: "127.14.70.61" port: 44347 } } peers { permanent_uuid: "7109d31951574de3bf05a86c94c11d21" member_type: VOTER last_known_addr { host: "127.14.70.60" port: 34453 } } }
I20251025 08:02:35.014479 17181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e [sys.catalog]: This master's current role is: LEADER
W20251025 08:02:35.016453 16282 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 588db918e8e440bdad7760e2968a15ba has no consensus state
I20251025 08:02:35.016652 16282 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_7a4a283a62d44234a76534b8384c227d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:35.016971 16282 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7a4a283a62d44234a76534b8384c227d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.018553 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_61a6db44e7c34f1db7cf3ed9aba4d411"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:35.018797 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61a6db44e7c34f1db7cf3ed9aba4d411 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.018891 17316 raft_consensus.cc:493] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.018965 17316 raft_consensus.cc:515] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.019258 17316 leader_election.cc:290] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
W20251025 08:02:35.019476 16279 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e20dba3c7f8642f5b9ce727f44c753f5 has no consensus state
I20251025 08:02:35.019565 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aae693881f9d40c789d242c6de5d9905" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:35.019642 16279 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_b87856fb91a2413b8d1687d56431ef16"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:35.019821 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aae693881f9d40c789d242c6de5d9905" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
W20251025 08:02:35.019873 16279 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b87856fb91a2413b8d1687d56431ef16 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.019922 15103 raft_consensus.cc:2468] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
W20251025 08:02:35.020011 15183 leader_election.cc:343] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.020205 15185 leader_election.cc:304] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:35.020388 17316 raft_consensus.cc:2804] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.020427 17316 raft_consensus.cc:493] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.020462 17316 raft_consensus.cc:3060] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.021322 17316 raft_consensus.cc:515] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.021377 16281 catalog_manager.cc:5649] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:35.021567 17316 leader_election.cc:290] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:35.021575 16281 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet fc62afd62257471e8590d28e49a50cb2 (table default.Table_8527e07298754b1ab5eefd758ff1fe70 [id=f317f6ac536c45beb5e90ab9bd55ebe7]). Expected version 2 got 0
I20251025 08:02:35.021646 16281 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet d6243825ae7b4307b5789aaee2473edc (table default.Table_3cb2ab7a99584877a1e8c650a29489db [id=d272aae5be5249ae9f40a67315f3756c]). Expected version 1 got 0
I20251025 08:02:35.022034 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aae693881f9d40c789d242c6de5d9905" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:35.022426 15183 leader_election.cc:343] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.022533 16280 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_a1711629a1364ff6b063997c7237c385 [id=0a4629613477421ba329364dbb42a8b6] alter complete (version 2)
I20251025 08:02:35.022869 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "aae693881f9d40c789d242c6de5d9905" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:35.022964 15103 raft_consensus.cc:3060] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.023468 16283 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_0a42fcc0637248fd9048c6d9d9e6055e" } new_table_name: "default.Table_390e29b52b3f41248a57bda951f2704f" modify_external_catalogs: true
I20251025 08:02:35.023806 15103 raft_consensus.cc:2468] T aae693881f9d40c789d242c6de5d9905 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:35.024047 15185 leader_election.cc:304] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:35.024236 17316 raft_consensus.cc:2804] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.024314 17316 raft_consensus.cc:697] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:35.024418 17316 consensus_queue.cc:237] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.025303 15642 raft_consensus.cc:493] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.025369 15642 raft_consensus.cc:515] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.025698 15642 leader_election.cc:290] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.025957 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6cbe1616ced4f47999a6a1365af0092" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:35.026268 15049 leader_election.cc:343] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.026875 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6cbe1616ced4f47999a6a1365af0092" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:35.027163 15048 leader_election.cc:343] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.027225 15048 leader_election.cc:304] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:35.027341 15642 raft_consensus.cc:2749] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:35.028834 16391 tablet_bootstrap.cc:492] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:35.028915 16391 ts_tablet_manager.cc:1403] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.099s user 0.002s sys 0.000s
I20251025 08:02:35.029333 16391 raft_consensus.cc:359] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.029426 16391 raft_consensus.cc:385] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.029451 16391 raft_consensus.cc:740] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.029541 16391 consensus_queue.cc:260] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.029760 16391 ts_tablet_manager.cc:1434] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.029896 16391 tablet_bootstrap.cc:492] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:35.030800 16391 tablet_bootstrap.cc:654] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.035043 17369 consensus_queue.cc:1048] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:35.036432 17198 ts_tablet_manager.cc:1929] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:35.037046 17274 tablet_bootstrap.cc:492] T 63085b146f03434b912d639b430a2cfe P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:35.037377 17274 ts_tablet_manager.cc:1403] T 63085b146f03434b912d639b430a2cfe P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.069s user 0.002s sys 0.000s
I20251025 08:02:35.037820 17274 raft_consensus.cc:359] T 63085b146f03434b912d639b430a2cfe P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.038005 17274 raft_consensus.cc:385] T 63085b146f03434b912d639b430a2cfe P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.038033 17274 raft_consensus.cc:740] T 63085b146f03434b912d639b430a2cfe P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.038144 17274 consensus_queue.cc:260] T 63085b146f03434b912d639b430a2cfe P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.038479 17274 ts_tablet_manager.cc:1434] T 63085b146f03434b912d639b430a2cfe P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.038584 17198 log.cc:1199] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/685d09c4a80b4d48b477cd4c0fc9db40
I20251025 08:02:35.038790 17274 tablet_bootstrap.cc:492] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:35.039602 17274 tablet_bootstrap.cc:654] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.040488 17369 raft_consensus.cc:493] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.040562 17369 raft_consensus.cc:515] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.040854 17369 leader_election.cc:290] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:35.041211 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c079391742cc4d488826c5536ab6d1d1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:35.041591 15183 leader_election.cc:343] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.040406 17198 ts_tablet_manager.cc:1950] T 685d09c4a80b4d48b477cd4c0fc9db40 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.041512 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c079391742cc4d488826c5536ab6d1d1" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
W20251025 08:02:35.042119 15185 leader_election.cc:343] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.042174 15185 leader_election.cc:304] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e
I20251025 08:02:35.042354 17316 raft_consensus.cc:2749] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:35.043033 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 195) took 1135 ms. Trace:
I20251025 08:02:35.043093 17198 rpcz_store.cc:276] 1025 08:02:33.906295 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.912047 (+ 5752us) service_pool.cc:225] Handling call
1025 08:02:34.975698 (+1063651us) ts_tablet_manager.cc:1151] Deleting tablet 685d09c4a80b4d48b477cd4c0fc9db40
1025 08:02:34.975704 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:34.978654 (+ 2950us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.036374 (+ 57720us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.041971 (+ 5597us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1063563}
I20251025 08:02:35.044204 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_e19a180657274070bdf8803988d6910e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:35.044536 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e19a180657274070bdf8803988d6910e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.045385 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 685d09c4a80b4d48b477cd4c0fc9db40 (table default.Table_27c6a21fc727493fba3613698ba9e108 [id=8e0aa39fb7de4352b22bd41fb1313236]) successfully deleted
I20251025 08:02:35.046727 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 175) took 1141 ms. Trace:
I20251025 08:02:35.046810 17198 rpcz_store.cc:276] 1025 08:02:33.905435 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.905523 (+ 88us) service_pool.cc:225] Handling call
1025 08:02:35.046677 (+1141154us) ts_tablet_manager.cc:1151] Deleting tablet d162f3ee21bd40ce9a9c74b7863a3878
1025 08:02:35.046683 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.046720 (+ 37us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1132433}
I20251025 08:02:35.049309 16286 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 76c31d4c83c740dab40bebd6c8d3f161
I20251025 08:02:35.049847 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet 76c31d4c83c740dab40bebd6c8d3f161 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:35.049919 17372 consensus_queue.cc:1048] T 29b4798bac204280b9c56ebb0f44302d P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20251025 08:02:35.050644 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 76c31d4c83c740dab40bebd6c8d3f161 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 76c31d4c83c740dab40bebd6c8d3f161 already in progress: creating tablet
I20251025 08:02:35.051061 16284 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet 107866bf24164791ab78b40079e4a1db
I20251025 08:02:35.051180 16284 master_service.cc:954] ReplaceTablet: received request to replace tablet af5a5d2903ff4142b1f1e70dd2a7d173 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:35.052089 16286 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_599c0d46a95d45b4aa9bab3b54b52470" } modify_external_catalogs: true
I20251025 08:02:35.052171 16286 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_599c0d46a95d45b4aa9bab3b54b52470" } modify_external_catalogs: true
I20251025 08:02:35.055950 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet 76c31d4c83c740dab40bebd6c8d3f161 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:35.056536 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 76c31d4c83c740dab40bebd6c8d3f161 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:35.058110 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 176) took 1152 ms. Trace:
I20251025 08:02:35.058211 17198 rpcz_store.cc:276] 1025 08:02:33.905474 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.905600 (+ 126us) service_pool.cc:225] Handling call
1025 08:02:35.058059 (+1152459us) ts_tablet_manager.cc:1151] Deleting tablet 93d383e3e2f4493d9cc8a71a4284e107
1025 08:02:35.058066 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.058100 (+ 34us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1139810}
I20251025 08:02:35.058409 17198 tablet_replica.cc:333] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
W20251025 08:02:35.058528 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 93d383e3e2f4493d9cc8a71a4284e107 because the tablet was not found. No further retry: Not found: Tablet not found: 93d383e3e2f4493d9cc8a71a4284e107
I20251025 08:02:35.058561 17198 raft_consensus.cc:2243] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.058574 15093 tablet_service.cc:1505] Processing CreateTablet for tablet b8e01602e0ec49358a259eb82ac9fd9b (DEFAULT_TABLE table=default.Table_2d23a19b70fe485986083303286874fa [id=692a311f7f26405b9318b2413517be77]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.058651 17198 raft_consensus.cc:2272] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.058825 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e01602e0ec49358a259eb82ac9fd9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.061872 16391 tablet_bootstrap.cc:492] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:35.061944 16391 ts_tablet_manager.cc:1403] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.032s user 0.002s sys 0.000s
I20251025 08:02:35.062397 16391 raft_consensus.cc:359] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.062494 16391 raft_consensus.cc:385] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.062520 16391 raft_consensus.cc:740] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.062611 16391 consensus_queue.cc:260] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.062856 16391 ts_tablet_manager.cc:1434] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.062991 16391 tablet_bootstrap.cc:492] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:35.063956 16391 tablet_bootstrap.cc:654] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.064430 16282 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_258c905a78d94ba197752a61781fa019" } modify_external_catalogs: true
I20251025 08:02:35.064548 16282 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_258c905a78d94ba197752a61781fa019" } modify_external_catalogs: true
I20251025 08:02:35.065681 17198 ts_tablet_manager.cc:1916] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.068635 17274 tablet_bootstrap.cc:492] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:35.068702 17274 ts_tablet_manager.cc:1403] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20251025 08:02:35.069052 17274 raft_consensus.cc:359] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.069128 17274 raft_consensus.cc:385] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.069290 17274 raft_consensus.cc:740] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.070765 15215 tablet_service.cc:1505] Processing CreateTablet for tablet bce04638a32443bc853ae242c6651ac5 (DEFAULT_TABLE table=default.Table_2723d06acdad494093ca794f37a40c63 [id=ce13cf6cceec4f6bb1cb22d48b226256]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.071036 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce04638a32443bc853ae242c6651ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.072817 17274 consensus_queue.cc:260] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.073484 17274 ts_tablet_manager.cc:1434] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20251025 08:02:35.073825 17274 tablet_bootstrap.cc:492] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:35.074173 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 1820be622ead4fd88437c79d95b34caf (DEFAULT_TABLE table=default.Table_093d20ac970543978ab5c4900b681def [id=e4bd5b62eaab4b0c938280d3021758fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.074397 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1820be622ead4fd88437c79d95b34caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.074848 17274 tablet_bootstrap.cc:654] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.076368 14940 tablet_service.cc:1505] Processing CreateTablet for tablet bce04638a32443bc853ae242c6651ac5 (DEFAULT_TABLE table=default.Table_2723d06acdad494093ca794f37a40c63 [id=ce13cf6cceec4f6bb1cb22d48b226256]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.076613 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce04638a32443bc853ae242c6651ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.078287 17198 ts_tablet_manager.cc:1929] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:35.079129 15093 tablet_service.cc:1505] Processing CreateTablet for tablet bce04638a32443bc853ae242c6651ac5 (DEFAULT_TABLE table=default.Table_2723d06acdad494093ca794f37a40c63 [id=ce13cf6cceec4f6bb1cb22d48b226256]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.079610 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce04638a32443bc853ae242c6651ac5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.079519 17198 log.cc:1199] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/2562325ea1c9436a85e1d675574c0a6c
I20251025 08:02:35.079726 16285 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_032e28c0e4594f2ea18bdab45b1ed067 [id=9926090b33ae4c169603cb1673d71c87] alter complete (version 1)
I20251025 08:02:35.079998 17198 ts_tablet_manager.cc:1950] T 2562325ea1c9436a85e1d675574c0a6c P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.080355 16391 tablet_bootstrap.cc:492] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:35.080422 16391 ts_tablet_manager.cc:1403] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.017s user 0.002s sys 0.000s
I20251025 08:02:35.080776 16391 raft_consensus.cc:359] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.080873 16391 raft_consensus.cc:385] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.080899 16391 raft_consensus.cc:740] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.080988 16391 consensus_queue.cc:260] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.081209 16391 ts_tablet_manager.cc:1434] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.081360 16391 tablet_bootstrap.cc:492] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:35.082221 16288 master_service.cc:954] ReplaceTablet: received request to replace tablet f2bc1c43a4724406a9e2cc2c8cb72bec from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:35.082295 16391 tablet_bootstrap.cc:654] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.084079 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 182) took 1178 ms. Trace:
I20251025 08:02:35.084872 17198 rpcz_store.cc:276] 1025 08:02:33.905712 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.905895 (+ 183us) service_pool.cc:225] Handling call
1025 08:02:35.058386 (+1152491us) ts_tablet_manager.cc:1151] Deleting tablet 2562325ea1c9436a85e1d675574c0a6c
1025 08:02:35.058392 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.077329 (+ 18937us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.078236 (+ 907us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.084071 (+ 5835us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1136122}
I20251025 08:02:35.085397 17198 tablet_replica.cc:333] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.086040 17198 raft_consensus.cc:2243] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.086352 17198 raft_consensus.cc:2272] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.086658 17198 ts_tablet_manager.cc:1916] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.087003 17274 tablet_bootstrap.cc:492] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:35.088728 17274 ts_tablet_manager.cc:1403] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.002s
W20251025 08:02:35.089092 16283 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1dacca1fcbad4795835ec08c8bd0dc3c consensus state has no leader
I20251025 08:02:35.089075 17274 raft_consensus.cc:359] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.089146 17274 raft_consensus.cc:385] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.089172 17274 raft_consensus.cc:740] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.089210 16283 master_service.cc:954] ReplaceTablet: received request to replace tablet 765cb9954ff544a4b6dc25c675f6e1e0 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:35.089259 17274 consensus_queue.cc:260] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.089571 17595 consensus_queue.cc:1048] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:35.090171 17274 ts_tablet_manager.cc:1434] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:35.090364 17274 tablet_bootstrap.cc:492] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:35.090492 17595 raft_consensus.cc:493] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.090550 17595 raft_consensus.cc:515] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.090839 17595 leader_election.cc:290] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.091358 16286 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 774988b980d8474e9b41518410c5dc9b
I20251025 08:02:35.091454 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76c31d4c83c740dab40bebd6c8d3f161" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:35.091557 15103 raft_consensus.cc:2468] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:35.091771 14915 leader_election.cc:304] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:35.091931 17595 raft_consensus.cc:2804] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.091923 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76c31d4c83c740dab40bebd6c8d3f161" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.091992 17595 raft_consensus.cc:493] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.092028 17595 raft_consensus.cc:3060] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.092875 17595 raft_consensus.cc:515] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.093055 16284 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet af5a5d2903ff4142b1f1e70dd2a7d173
I20251025 08:02:35.093144 17595 leader_election.cc:290] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.093266 16284 catalog_manager.cc:6719] ReplaceTablet: tablet af5a5d2903ff4142b1f1e70dd2a7d173 deleted and replaced by tablet c5eec1ac0e0b4217b26ec2e7832685a2
I20251025 08:02:35.093730 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet af5a5d2903ff4142b1f1e70dd2a7d173 with delete_type TABLET_DATA_DELETED (replaced by tablet c5eec1ac0e0b4217b26ec2e7832685a2) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:35.093856 17258 tablet_replica.cc:333] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
W20251025 08:02:35.093905 14914 leader_election.cc:343] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.093971 17258 raft_consensus.cc:2243] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.094051 17258 raft_consensus.cc:2272] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.094175 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76c31d4c83c740dab40bebd6c8d3f161" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:35.094430 17258 ts_tablet_manager.cc:1916] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.094435 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "76c31d4c83c740dab40bebd6c8d3f161" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:35.094544 15103 raft_consensus.cc:3060] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:35.094534 14914 leader_election.cc:343] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.095228 17274 tablet_bootstrap.cc:654] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.095445 15103 raft_consensus.cc:2468] T 76c31d4c83c740dab40bebd6c8d3f161 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:35.095723 14915 leader_election.cc:304] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:35.095894 17595 raft_consensus.cc:2804] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.095976 17595 raft_consensus.cc:697] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:35.096093 17595 consensus_queue.cc:237] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.096490 17258 ts_tablet_manager.cc:1929] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:35.096557 17258 log.cc:1199] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/af5a5d2903ff4142b1f1e70dd2a7d173
I20251025 08:02:35.096796 17258 ts_tablet_manager.cc:1950] T af5a5d2903ff4142b1f1e70dd2a7d173 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:35.098397 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet af5a5d2903ff4142b1f1e70dd2a7d173 (table default.Table_97dcb2270cdf4d21824166c30b3a62a9 [id=d53447a316c5438e86cdac872682b3a1]) successfully deleted
I20251025 08:02:35.098551 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet af5a5d2903ff4142b1f1e70dd2a7d173 with delete_type TABLET_DATA_DELETED (replaced by tablet c5eec1ac0e0b4217b26ec2e7832685a2) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:35.098932 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet 774988b980d8474e9b41518410c5dc9b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:35 UTC) from {username='slave'} at 127.0.0.1:42704
W20251025 08:02:35.099408 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 774988b980d8474e9b41518410c5dc9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 774988b980d8474e9b41518410c5dc9b already in progress: creating tablet
I20251025 08:02:35.099646 14956 tablet_service.cc:1552] Processing DeleteTablet for tablet 774988b980d8474e9b41518410c5dc9b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:35 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:35.100193 17198 ts_tablet_manager.cc:1929] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:35.100469 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_952f8f7b82db4a969cbadaf006d2ce26"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:35.100719 16391 tablet_bootstrap.cc:492] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:35.100783 16391 ts_tablet_manager.cc:1403] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.001s
W20251025 08:02:35.100811 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_952f8f7b82db4a969cbadaf006d2ce26 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.101135 16391 raft_consensus.cc:359] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.101208 16391 raft_consensus.cc:385] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.101233 16391 raft_consensus.cc:740] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.101343 16391 consensus_queue.cc:260] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.101583 16391 ts_tablet_manager.cc:1434] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:35.101720 16391 tablet_bootstrap.cc:492] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:35.102017 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_7ae12fcb917c4993be08496033060246"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:35.102303 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ae12fcb917c4993be08496033060246 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.102823 16391 tablet_bootstrap.cc:654] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.105083 16286 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_d1dd8988206f424faa2ebf7b9d0659a5" } new_table_name: "default.Table_04907829b7e14fd8af2736fe08a49e6f" modify_external_catalogs: true
I20251025 08:02:35.105914 17198 log.cc:1199] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/cb3569ec2cdd4736b264b00abf1fa36a
I20251025 08:02:35.106184 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 774988b980d8474e9b41518410c5dc9b with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:35 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:35.106331 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet af5a5d2903ff4142b1f1e70dd2a7d173 with delete_type TABLET_DATA_DELETED (replaced by tablet c5eec1ac0e0b4217b26ec2e7832685a2) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:35.106590 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 2562325ea1c9436a85e1d675574c0a6c (table default.Table_4b899f935c754aa2876c910eb2e208e3 [id=8a0e4fe9e4544c539cb23b0279c1deaf]) successfully deleted
I20251025 08:02:35.107399 17198 ts_tablet_manager.cc:1950] T cb3569ec2cdd4736b264b00abf1fa36a P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.108208 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 184) took 1202 ms. Trace:
I20251025 08:02:35.108299 17198 rpcz_store.cc:276] 1025 08:02:33.905790 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.906088 (+ 298us) service_pool.cc:225] Handling call
1025 08:02:35.085373 (+1179285us) ts_tablet_manager.cc:1151] Deleting tablet cb3569ec2cdd4736b264b00abf1fa36a
1025 08:02:35.085379 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.099315 (+ 13936us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.100152 (+ 837us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.108199 (+ 8047us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1161596}
I20251025 08:02:35.109755 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 183) took 1204 ms. Trace:
I20251025 08:02:35.109869 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet cb3569ec2cdd4736b264b00abf1fa36a (table default.Table_08073379da334076bcc5503770a32982 [id=1ee33ee129d749d0bd7f26dc49fca0fe]) successfully deleted
I20251025 08:02:35.110004 17198 rpcz_store.cc:276] 1025 08:02:33.905752 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.906012 (+ 260us) service_pool.cc:225] Handling call
1025 08:02:35.109694 (+1203682us) ts_tablet_manager.cc:1151] Deleting tablet e03e2e21e3f64bedb04c7e79aea6d49d
1025 08:02:35.109700 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.109747 (+ 47us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1182297}
W20251025 08:02:35.110352 16272 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet e03e2e21e3f64bedb04c7e79aea6d49d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e03e2e21e3f64bedb04c7e79aea6d49d already in progress: creating tablet
I20251025 08:02:35.110502 17198 tablet_replica.cc:333] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.113003 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 1820be622ead4fd88437c79d95b34caf (DEFAULT_TABLE table=default.Table_093d20ac970543978ab5c4900b681def [id=e4bd5b62eaab4b0c938280d3021758fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.113220 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1820be622ead4fd88437c79d95b34caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.113745 17198 raft_consensus.cc:2243] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.114118 17274 tablet_bootstrap.cc:492] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:35.114302 17274 ts_tablet_manager.cc:1403] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.001s
I20251025 08:02:35.114745 17274 raft_consensus.cc:359] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.114825 17274 raft_consensus.cc:385] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.114853 17274 raft_consensus.cc:740] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.115036 17595 raft_consensus.cc:493] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.115098 17595 raft_consensus.cc:515] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.115428 17595 leader_election.cc:290] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.115844 15237 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "879ae11ae94b4d2eab76c1dc74e160ca" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.115960 15237 raft_consensus.cc:2468] T 879ae11ae94b4d2eab76c1dc74e160ca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:35.116233 17194 tablet_replica.cc:333] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:35.116501 14914 leader_election.cc:304] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.116643 17194 raft_consensus.cc:2243] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:35.116768 17194 pending_rounds.cc:70] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:35.116787 17594 raft_consensus.cc:2804] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.116838 17594 raft_consensus.cc:493] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.116873 17594 raft_consensus.cc:3060] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.117743 17594 raft_consensus.cc:515] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.117980 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 0514d05680994b5f9bf7da9c62dd098a (DEFAULT_TABLE table=default.Table_5228048f3783458dbb44280a7a6e4816 [id=7fe739c2f676459d8c73632266babedb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.118018 17594 leader_election.cc:290] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.118196 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0514d05680994b5f9bf7da9c62dd098a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.118690 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "879ae11ae94b4d2eab76c1dc74e160ca" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:35.118798 15103 raft_consensus.cc:2468] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:35.118803 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "879ae11ae94b4d2eab76c1dc74e160ca" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:35.119009 15107 raft_consensus.cc:3060] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.119192 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "879ae11ae94b4d2eab76c1dc74e160ca" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:35.119287 15239 raft_consensus.cc:3060] T 879ae11ae94b4d2eab76c1dc74e160ca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.119961 15107 raft_consensus.cc:2468] T 879ae11ae94b4d2eab76c1dc74e160ca P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:35.120141 15239 raft_consensus.cc:2468] T 879ae11ae94b4d2eab76c1dc74e160ca P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:35.120308 14915 leader_election.cc:304] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:35.120728 17730 raft_consensus.cc:2804] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.120800 17730 raft_consensus.cc:697] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:35.120776 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 1820be622ead4fd88437c79d95b34caf (DEFAULT_TABLE table=default.Table_093d20ac970543978ab5c4900b681def [id=e4bd5b62eaab4b0c938280d3021758fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.120895 17730 consensus_queue.cc:237] T 879ae11ae94b4d2eab76c1dc74e160ca P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.120987 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1820be622ead4fd88437c79d95b34caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.121613 17274 consensus_queue.cc:260] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.121858 17274 ts_tablet_manager.cc:1434] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.008s user 0.000s sys 0.001s
I20251025 08:02:35.116791 17194 pending_rounds.cc:77] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609838474592256 op_type: NO_OP noop_request { }
I20251025 08:02:35.122504 17373 raft_consensus.cc:493] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.122534 17194 raft_consensus.cc:2889] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:35.122583 17194 raft_consensus.cc:2272] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.122586 17373 raft_consensus.cc:515] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.122722 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet 1e248b8303b1498e96178d4e46ad691e with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:32 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:35.122855 17373 leader_election.cc:290] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:35.123065 17274 tablet_bootstrap.cc:492] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:35.123463 16390 tablet_bootstrap.cc:492] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:35.123535 16390 ts_tablet_manager.cc:1403] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.114s user 0.002s sys 0.000s
I20251025 08:02:35.123569 14940 tablet_service.cc:1505] Processing CreateTablet for tablet 0514d05680994b5f9bf7da9c62dd098a (DEFAULT_TABLE table=default.Table_5228048f3783458dbb44280a7a6e4816 [id=7fe739c2f676459d8c73632266babedb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.123770 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0514d05680994b5f9bf7da9c62dd098a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.123916 17274 tablet_bootstrap.cc:654] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.123955 16390 raft_consensus.cc:359] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.124049 16390 raft_consensus.cc:385] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.124079 16390 raft_consensus.cc:740] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.124181 16390 consensus_queue.cc:260] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.124411 16390 ts_tablet_manager.cc:1434] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.124575 16390 tablet_bootstrap.cc:492] T 334015a0a5aa42c8b127d64e794c2705 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:35.124675 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "63085b146f03434b912d639b430a2cfe" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:35.124773 15107 raft_consensus.cc:2468] T 63085b146f03434b912d639b430a2cfe P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:35.125041 15185 leader_election.cc:304] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.125245 17372 raft_consensus.cc:2804] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.125294 17372 raft_consensus.cc:493] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.125330 17372 raft_consensus.cc:3060] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.125329 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "63085b146f03434b912d639b430a2cfe" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:35.125510 16390 tablet_bootstrap.cc:654] T 334015a0a5aa42c8b127d64e794c2705 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:35.125612 15183 leader_election.cc:343] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.126264 17372 raft_consensus.cc:515] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.126547 17372 leader_election.cc:290] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:35.126731 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "63085b146f03434b912d639b430a2cfe" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:35.127152 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "63085b146f03434b912d639b430a2cfe" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
W20251025 08:02:35.127215 15183 leader_election.cc:343] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.127241 15107 raft_consensus.cc:3060] T 63085b146f03434b912d639b430a2cfe P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
W20251025 08:02:35.127399 15049 consensus_peers.cc:597] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: af5a5d2903ff4142b1f1e70dd2a7d173. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:35.127427 15215 tablet_service.cc:1505] Processing CreateTablet for tablet cea8fd96b1fa4fc9a8fd22c4e6757f3f (DEFAULT_TABLE table=default.Table_6c09057554af4ae3aaff0255f8bfc04a [id=b5e8500eb77645b883e2e4aa0542c0fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.127606 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea8fd96b1fa4fc9a8fd22c4e6757f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.128041 15107 raft_consensus.cc:2468] T 63085b146f03434b912d639b430a2cfe P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:35.130200 16284 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_2eae5b9e44bc40acafb6a647bed4a4d9" } modify_external_catalogs: true
I20251025 08:02:35.130316 16284 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_2eae5b9e44bc40acafb6a647bed4a4d9" } modify_external_catalogs: true
I20251025 08:02:35.130797 16390 tablet_bootstrap.cc:492] T 334015a0a5aa42c8b127d64e794c2705 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:35.130870 16390 ts_tablet_manager.cc:1403] T 334015a0a5aa42c8b127d64e794c2705 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20251025 08:02:35.131280 16390 raft_consensus.cc:359] T 334015a0a5aa42c8b127d64e794c2705 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.131364 16390 raft_consensus.cc:385] T 334015a0a5aa42c8b127d64e794c2705 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.131397 16390 raft_consensus.cc:740] T 334015a0a5aa42c8b127d64e794c2705 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.131511 16390 consensus_queue.cc:260] T 334015a0a5aa42c8b127d64e794c2705 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.131767 16390 ts_tablet_manager.cc:1434] T 334015a0a5aa42c8b127d64e794c2705 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.131912 16390 tablet_bootstrap.cc:492] T b1fc8a8cfb73420f81f5b73839d3d3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:35.132277 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 0514d05680994b5f9bf7da9c62dd098a (DEFAULT_TABLE table=default.Table_5228048f3783458dbb44280a7a6e4816 [id=7fe739c2f676459d8c73632266babedb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.132489 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0514d05680994b5f9bf7da9c62dd098a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.132700 14956 tablet_service.cc:1505] Processing CreateTablet for tablet cea8fd96b1fa4fc9a8fd22c4e6757f3f (DEFAULT_TABLE table=default.Table_6c09057554af4ae3aaff0255f8bfc04a [id=b5e8500eb77645b883e2e4aa0542c0fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.132891 16390 tablet_bootstrap.cc:654] T b1fc8a8cfb73420f81f5b73839d3d3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.132894 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea8fd96b1fa4fc9a8fd22c4e6757f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.135763 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 37517c4c32c042eabcc8270de33af834 (DEFAULT_TABLE table=default.Table_27c6a21fc727493fba3613698ba9e108 [id=8e0aa39fb7de4352b22bd41fb1313236]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.136039 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37517c4c32c042eabcc8270de33af834. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.138161 15089 tablet_service.cc:1505] Processing CreateTablet for tablet cea8fd96b1fa4fc9a8fd22c4e6757f3f (DEFAULT_TABLE table=default.Table_6c09057554af4ae3aaff0255f8bfc04a [id=b5e8500eb77645b883e2e4aa0542c0fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.138409 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea8fd96b1fa4fc9a8fd22c4e6757f3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.138485 17537 raft_consensus.cc:493] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.138557 17537 raft_consensus.cc:515] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.138844 17537 leader_election.cc:290] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:35.139675 15048 leader_election.cc:343] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Not found: Tablet not found: 3caafcc644e34ec1acc0d3741fd34721
I20251025 08:02:35.139928 15185 leader_election.cc:304] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:35.139919 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 37517c4c32c042eabcc8270de33af834 (DEFAULT_TABLE table=default.Table_27c6a21fc727493fba3613698ba9e108 [id=8e0aa39fb7de4352b22bd41fb1313236]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.140045 17373 raft_consensus.cc:2804] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.140141 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37517c4c32c042eabcc8270de33af834. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.140127 17373 raft_consensus.cc:697] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:35.140241 17373 consensus_queue.cc:237] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.140872 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "3caafcc644e34ec1acc0d3741fd34721" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:35.142535 15049 leader_election.cc:343] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.142596 15049 leader_election.cc:304] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:35.142747 17537 raft_consensus.cc:2749] T 3caafcc644e34ec1acc0d3741fd34721 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:35.146852 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 5fcded6ebe3a42f4a83a65e44c080120 (DEFAULT_TABLE table=default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.147070 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcded6ebe3a42f4a83a65e44c080120. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.149111 17594 raft_consensus.cc:493] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.149199 17594 raft_consensus.cc:515] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.149506 17594 leader_election.cc:290] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.149724 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb2a4db00068482fb8d3b5313017e035" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:35.149838 15103 raft_consensus.cc:2468] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:35.149986 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb2a4db00068482fb8d3b5313017e035" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.150112 14915 leader_election.cc:304] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:35.150241 14958 tablet_service.cc:1505] Processing CreateTablet for tablet 5fcded6ebe3a42f4a83a65e44c080120 (DEFAULT_TABLE table=default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.150442 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcded6ebe3a42f4a83a65e44c080120. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:35.150461 14914 leader_election.cc:343] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.152456 17731 raft_consensus.cc:2804] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.152510 17731 raft_consensus.cc:493] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.152545 17731 raft_consensus.cc:3060] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.153384 17731 raft_consensus.cc:515] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.153687 17731 leader_election.cc:290] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.154371 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb2a4db00068482fb8d3b5313017e035" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:35.154496 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "cb2a4db00068482fb8d3b5313017e035" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:35.154593 15103 raft_consensus.cc:3060] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.155397 15103 raft_consensus.cc:2468] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
W20251025 08:02:35.155397 14914 leader_election.cc:343] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.155655 14915 leader_election.cc:304] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters: f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:35.156041 17731 raft_consensus.cc:2804] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.156132 17731 raft_consensus.cc:697] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:35.156246 17731 consensus_queue.cc:237] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.157011 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 467dcaf7cd764c5284adfa968a07447d (DEFAULT_TABLE table=default.Table_cc907ef022d94e439041d73d82596b73 [id=b5beb92cd03841f3a26a052f6846af9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.157235 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467dcaf7cd764c5284adfa968a07447d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.163281 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 37517c4c32c042eabcc8270de33af834 (DEFAULT_TABLE table=default.Table_27c6a21fc727493fba3613698ba9e108 [id=8e0aa39fb7de4352b22bd41fb1313236]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.163508 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37517c4c32c042eabcc8270de33af834. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.163749 17194 ts_tablet_manager.cc:1916] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.164589 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 467dcaf7cd764c5284adfa968a07447d (DEFAULT_TABLE table=default.Table_cc907ef022d94e439041d73d82596b73 [id=b5beb92cd03841f3a26a052f6846af9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.164791 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467dcaf7cd764c5284adfa968a07447d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.165970 17194 ts_tablet_manager.cc:1929] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:35.166025 17194 log.cc:1199] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/76c31d4c83c740dab40bebd6c8d3f161
I20251025 08:02:35.166281 17194 ts_tablet_manager.cc:1950] T 76c31d4c83c740dab40bebd6c8d3f161 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:35.166769 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 76c31d4c83c740dab40bebd6c8d3f161 (table default.Table_ec80f327b59748efb9f7d1b60f08cd7c [id=f2c68f806e5040b5ae0095c7156a0cd0]) successfully deleted
I20251025 08:02:35.166815 17194 tablet_replica.cc:333] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:35.166922 17194 raft_consensus.cc:2243] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.166997 17194 raft_consensus.cc:2272] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.167234 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 467dcaf7cd764c5284adfa968a07447d (DEFAULT_TABLE table=default.Table_cc907ef022d94e439041d73d82596b73 [id=b5beb92cd03841f3a26a052f6846af9a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.167281 17194 ts_tablet_manager.cc:1916] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.167434 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 467dcaf7cd764c5284adfa968a07447d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.167922 17198 raft_consensus.cc:2272] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.169255 16391 tablet_bootstrap.cc:492] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:35.169318 16391 ts_tablet_manager.cc:1403] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.068s user 0.000s sys 0.001s
I20251025 08:02:35.169452 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 5fcded6ebe3a42f4a83a65e44c080120 (DEFAULT_TABLE table=default.Table_6ee3473814d74349aedfe729d2e692e0 [id=c847cd8cbc4d4c34b6d4eecb9fdb4155]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.169642 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5fcded6ebe3a42f4a83a65e44c080120. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.169677 16391 raft_consensus.cc:359] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.169756 16391 raft_consensus.cc:385] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.169785 16391 raft_consensus.cc:740] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.169888 16391 consensus_queue.cc:260] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.170128 16391 ts_tablet_manager.cc:1434] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:35.170292 16391 tablet_bootstrap.cc:492] T 5dc32b27b3f743bf8719e39ea8c20e34 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:35.171123 16391 tablet_bootstrap.cc:654] T 5dc32b27b3f743bf8719e39ea8c20e34 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.173038 17594 raft_consensus.cc:493] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.173110 17594 raft_consensus.cc:515] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.173394 17594 leader_election.cc:290] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.173750 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12a6b5f9ed8041e9929c9f1673ac212a" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:35.173875 15107 raft_consensus.cc:2393] T 12a6b5f9ed8041e9929c9f1673ac212a P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ab02c9d78a9d42f193755d436c8d44b2 in current term 1: Already voted for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in this term.
I20251025 08:02:35.173883 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "12a6b5f9ed8041e9929c9f1673ac212a" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.174269 14914 leader_election.cc:304] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2; no voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:35.174453 17594 raft_consensus.cc:3060] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.175257 17594 raft_consensus.cc:2749] T 12a6b5f9ed8041e9929c9f1673ac212a P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:35.177466 17198 ts_tablet_manager.cc:1916] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.180640 17198 ts_tablet_manager.cc:1929] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:35.180707 17198 log.cc:1199] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/6b16e4b9ef4c41db83ab3bf55149719b
I20251025 08:02:35.180898 17198 ts_tablet_manager.cc:1950] T 6b16e4b9ef4c41db83ab3bf55149719b P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.181339 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 192) took 1275 ms. Trace:
I20251025 08:02:35.181397 17198 rpcz_store.cc:276] 1025 08:02:33.906135 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.906551 (+ 416us) service_pool.cc:225] Handling call
1025 08:02:35.110478 (+1203927us) ts_tablet_manager.cc:1151] Deleting tablet 6b16e4b9ef4c41db83ab3bf55149719b
1025 08:02:35.110484 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.179823 (+ 69339us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.180600 (+ 777us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.181329 (+ 729us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1182598}
I20251025 08:02:35.181654 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 6b16e4b9ef4c41db83ab3bf55149719b (table default.Table_bf6a70d1926d4a9da3c3ee62f85bf2cf [id=7b0f2a2cf9de45ed9a2dd070deaa13a3]) successfully deleted
I20251025 08:02:35.181865 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 172) took 1276 ms. Trace:
I20251025 08:02:35.181921 17198 rpcz_store.cc:276] 1025 08:02:33.905299 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.906592 (+ 1293us) service_pool.cc:225] Handling call
1025 08:02:35.181814 (+1275222us) ts_tablet_manager.cc:1151] Deleting tablet a2b8efa8ed634583b7bf7cc91bfc61a3
1025 08:02:35.181820 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.181857 (+ 37us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1253894}
W20251025 08:02:35.182143 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet a2b8efa8ed634583b7bf7cc91bfc61a3 because the tablet was not found. No further retry: Not found: Tablet not found: a2b8efa8ed634583b7bf7cc91bfc61a3
I20251025 08:02:35.190006 17274 tablet_bootstrap.cc:492] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:35.190086 17274 ts_tablet_manager.cc:1403] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.068s user 0.000s sys 0.002s
I20251025 08:02:35.190497 17274 raft_consensus.cc:359] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.190635 17274 raft_consensus.cc:385] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.190676 17274 raft_consensus.cc:740] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.190789 17274 consensus_queue.cc:260] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.191219 17274 ts_tablet_manager.cc:1434] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:35.191380 17274 tablet_bootstrap.cc:492] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:35.192176 17274 tablet_bootstrap.cc:654] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.194223 16390 tablet_bootstrap.cc:492] T b1fc8a8cfb73420f81f5b73839d3d3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:35.194224 16391 tablet_bootstrap.cc:492] T 5dc32b27b3f743bf8719e39ea8c20e34 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:35.194305 16390 ts_tablet_manager.cc:1403] T b1fc8a8cfb73420f81f5b73839d3d3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.000s
I20251025 08:02:35.194320 16391 ts_tablet_manager.cc:1403] T 5dc32b27b3f743bf8719e39ea8c20e34 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s
I20251025 08:02:35.194722 16390 raft_consensus.cc:359] T b1fc8a8cfb73420f81f5b73839d3d3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.194722 16391 raft_consensus.cc:359] T 5dc32b27b3f743bf8719e39ea8c20e34 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.194808 16391 raft_consensus.cc:385] T 5dc32b27b3f743bf8719e39ea8c20e34 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.194808 16390 raft_consensus.cc:385] T b1fc8a8cfb73420f81f5b73839d3d3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.194839 16390 raft_consensus.cc:740] T b1fc8a8cfb73420f81f5b73839d3d3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.194839 16391 raft_consensus.cc:740] T 5dc32b27b3f743bf8719e39ea8c20e34 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.194941 16391 consensus_queue.cc:260] T 5dc32b27b3f743bf8719e39ea8c20e34 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.194941 16390 consensus_queue.cc:260] T b1fc8a8cfb73420f81f5b73839d3d3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.195179 16391 ts_tablet_manager.cc:1434] T 5dc32b27b3f743bf8719e39ea8c20e34 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.195183 16390 ts_tablet_manager.cc:1434] T b1fc8a8cfb73420f81f5b73839d3d3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.195345 16390 tablet_bootstrap.cc:492] T 3caafcc644e34ec1acc0d3741fd34721 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:35.195379 17594 raft_consensus.cc:493] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.195436 17594 raft_consensus.cc:515] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.195744 17594 leader_election.cc:290] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.196292 16390 tablet_bootstrap.cc:654] T 3caafcc644e34ec1acc0d3741fd34721 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.197039 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "334015a0a5aa42c8b127d64e794c2705" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.197149 15249 raft_consensus.cc:2468] T 334015a0a5aa42c8b127d64e794c2705 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:35.197402 14914 leader_election.cc:304] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.197569 17594 raft_consensus.cc:2804] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.197619 17594 raft_consensus.cc:493] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.197662 17594 raft_consensus.cc:3060] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.198697 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "334015a0a5aa42c8b127d64e794c2705" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:35.198799 15107 raft_consensus.cc:2468] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:35.199860 17594 raft_consensus.cc:515] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.200134 17594 leader_election.cc:290] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.200467 16390 tablet_bootstrap.cc:492] T 3caafcc644e34ec1acc0d3741fd34721 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:35.200541 16390 ts_tablet_manager.cc:1403] T 3caafcc644e34ec1acc0d3741fd34721 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20251025 08:02:35.200551 15103 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "334015a0a5aa42c8b127d64e794c2705" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:35.200646 15103 raft_consensus.cc:3060] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.200670 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "334015a0a5aa42c8b127d64e794c2705" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:35.200748 15249 raft_consensus.cc:3060] T 334015a0a5aa42c8b127d64e794c2705 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.201505 15103 raft_consensus.cc:2468] T 334015a0a5aa42c8b127d64e794c2705 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:35.201676 15249 raft_consensus.cc:2468] T 334015a0a5aa42c8b127d64e794c2705 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:35.201979 14915 leader_election.cc:304] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:35.202073 16391 tablet_bootstrap.cc:492] T aae693881f9d40c789d242c6de5d9905 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:35.202564 17731 raft_consensus.cc:2804] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.202637 17731 raft_consensus.cc:697] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:35.202733 17731 consensus_queue.cc:237] T 334015a0a5aa42c8b127d64e794c2705 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.203192 16391 tablet_bootstrap.cc:654] T aae693881f9d40c789d242c6de5d9905 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.203063 16390 raft_consensus.cc:359] T 3caafcc644e34ec1acc0d3741fd34721 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.203431 16390 raft_consensus.cc:385] T 3caafcc644e34ec1acc0d3741fd34721 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.203521 16390 raft_consensus.cc:740] T 3caafcc644e34ec1acc0d3741fd34721 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.203676 16390 consensus_queue.cc:260] T 3caafcc644e34ec1acc0d3741fd34721 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.203860 17620 tablet.cc:1722] T 2a4b060efd054726b07702b691876147 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:35.204005 17274 tablet_bootstrap.cc:492] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:35.204046 16390 ts_tablet_manager.cc:1434] T 3caafcc644e34ec1acc0d3741fd34721 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20251025 08:02:35.204073 17274 ts_tablet_manager.cc:1403] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20251025 08:02:35.204233 16390 tablet_bootstrap.cc:492] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:35.204456 17274 raft_consensus.cc:359] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.204694 17274 raft_consensus.cc:385] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.204739 17274 raft_consensus.cc:740] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.204872 17274 consensus_queue.cc:260] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.205190 16390 tablet_bootstrap.cc:654] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.205199 17274 ts_tablet_manager.cc:1434] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:35.205374 17274 tablet_bootstrap.cc:492] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:35.206313 17274 tablet_bootstrap.cc:654] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.206568 17566 tablet.cc:1722] T 2a4b060efd054726b07702b691876147 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20251025 08:02:35.209230 17198 tablet_replica.cc:333] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.210037 17765 tablet.cc:1722] T 2a4b060efd054726b07702b691876147 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20251025 08:02:35.212340 15048 consensus_peers.cc:597] T af5a5d2903ff4142b1f1e70dd2a7d173 P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:35.212548 17198 raft_consensus.cc:2243] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.212687 17198 raft_consensus.cc:2272] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.213765 17369 consensus_queue.cc:1048] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:35.214104 17537 raft_consensus.cc:493] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.215396 17537 raft_consensus.cc:515] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.215683 17537 leader_election.cc:290] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.216087 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c079391742cc4d488826c5536ab6d1d1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.216188 15239 raft_consensus.cc:2468] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:35.216259 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c079391742cc4d488826c5536ab6d1d1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:35.216590 15049 leader_election.cc:304] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.216784 16390 tablet_bootstrap.cc:492] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:35.216856 16390 ts_tablet_manager.cc:1403] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.000s
W20251025 08:02:35.216992 15048 leader_election.cc:343] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.217288 16390 raft_consensus.cc:359] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.217386 16390 raft_consensus.cc:385] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.217415 16390 raft_consensus.cc:740] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.217435 17537 raft_consensus.cc:2804] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.217487 17537 raft_consensus.cc:493] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.217523 17537 raft_consensus.cc:3060] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.217518 16390 consensus_queue.cc:260] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.217782 16390 ts_tablet_manager.cc:1434] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.217947 16390 tablet_bootstrap.cc:492] T 91d9fca3965e4ff8bb0a50574ede0209 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:35.218384 17537 raft_consensus.cc:515] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.218679 17537 leader_election.cc:290] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.219024 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c079391742cc4d488826c5536ab6d1d1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:35.219115 15239 raft_consensus.cc:3060] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.219293 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c079391742cc4d488826c5536ab6d1d1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
W20251025 08:02:35.219547 15048 leader_election.cc:343] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.220028 15239 raft_consensus.cc:2468] T c079391742cc4d488826c5536ab6d1d1 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:35.220290 15049 leader_election.cc:304] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters: ab02c9d78a9d42f193755d436c8d44b2
I20251025 08:02:35.220469 16390 tablet_bootstrap.cc:654] T 91d9fca3965e4ff8bb0a50574ede0209 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.220531 17537 raft_consensus.cc:2804] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.220613 17537 raft_consensus.cc:697] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:35.220785 17537 consensus_queue.cc:237] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.223122 17198 ts_tablet_manager.cc:1916] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.226078 17372 consensus_queue.cc:1048] T 12a6b5f9ed8041e9929c9f1673ac212a P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:35.227102 17198 ts_tablet_manager.cc:1929] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:35.227214 17198 log.cc:1199] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/0078dd6fb0e34d01a54889326dd6dfd7
I20251025 08:02:35.227538 17198 ts_tablet_manager.cc:1950] T 0078dd6fb0e34d01a54889326dd6dfd7 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.229290 17194 ts_tablet_manager.cc:1929] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:35.229426 17194 log.cc:1199] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/af5a5d2903ff4142b1f1e70dd2a7d173
I20251025 08:02:35.229876 17194 ts_tablet_manager.cc:1950] T af5a5d2903ff4142b1f1e70dd2a7d173 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:35.236172 16391 tablet_bootstrap.cc:492] T aae693881f9d40c789d242c6de5d9905 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:35.236250 16391 ts_tablet_manager.cc:1403] T aae693881f9d40c789d242c6de5d9905 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.034s user 0.002s sys 0.000s
I20251025 08:02:35.236651 16391 raft_consensus.cc:359] T aae693881f9d40c789d242c6de5d9905 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.236732 16391 raft_consensus.cc:385] T aae693881f9d40c789d242c6de5d9905 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.236759 16391 raft_consensus.cc:740] T aae693881f9d40c789d242c6de5d9905 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.236850 16391 consensus_queue.cc:260] T aae693881f9d40c789d242c6de5d9905 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.237092 16391 ts_tablet_manager.cc:1434] T aae693881f9d40c789d242c6de5d9905 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.241847 16282 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 346c0c8bf30b4dbaa92436b45e5fbf47
I20251025 08:02:35.242274 16282 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_f35d0fa958084bb9bb792e93fd367806" } new_table_name: "default.Table_e42ecb552a87483ab36cd844e46d9f12" modify_external_catalogs: true
I20251025 08:02:35.242772 17274 tablet_bootstrap.cc:492] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:35.242835 17274 ts_tablet_manager.cc:1403] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.001s
I20251025 08:02:35.243203 17274 raft_consensus.cc:359] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.243289 17274 raft_consensus.cc:385] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.243314 17274 raft_consensus.cc:740] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.243413 17274 consensus_queue.cc:260] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.243638 17274 ts_tablet_manager.cc:1434] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20251025 08:02:35.244004 16390 tablet_bootstrap.cc:492] T 91d9fca3965e4ff8bb0a50574ede0209 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:35.243953 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_21bf5d84a8b448ac9748d5910801aaf1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:35.244065 16390 ts_tablet_manager.cc:1403] T 91d9fca3965e4ff8bb0a50574ede0209 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.000s
W20251025 08:02:35.244272 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_21bf5d84a8b448ac9748d5910801aaf1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.244366 16390 raft_consensus.cc:359] T 91d9fca3965e4ff8bb0a50574ede0209 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.244441 16390 raft_consensus.cc:385] T 91d9fca3965e4ff8bb0a50574ede0209 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.244469 16390 raft_consensus.cc:740] T 91d9fca3965e4ff8bb0a50574ede0209 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.244557 16390 consensus_queue.cc:260] T 91d9fca3965e4ff8bb0a50574ede0209 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.244755 16390 ts_tablet_manager.cc:1434] T 91d9fca3965e4ff8bb0a50574ede0209 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.244884 16390 tablet_bootstrap.cc:492] T d0de3ec67dcc4e41a447338869076314 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:35.245152 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 765cb9954ff544a4b6dc25c675f6e1e0
I20251025 08:02:35.245371 16283 catalog_manager.cc:6719] ReplaceTablet: tablet 765cb9954ff544a4b6dc25c675f6e1e0 deleted and replaced by tablet 79c60ffb5c5f4ad0a0207a0e5ba80c94
I20251025 08:02:35.245468 16283 master_service.cc:954] ReplaceTablet: received request to replace tablet a941ba28528d41699390e9db80f25594 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:35.245589 16390 tablet_bootstrap.cc:654] T d0de3ec67dcc4e41a447338869076314 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:35.246152 16286 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e203aefbbbf5447b9380f94f98e35319 has no consensus state
I20251025 08:02:35.246320 16286 master_service.cc:954] ReplaceTablet: received request to replace tablet 0d6f8c2ab96549e6b3bc13168de2b604 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:35.247053 16285 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e3cb96c3c06e438c8159a4212e4c0197" } new_table_name: "default.Table_232f967839b94b3195b2b9b849c36b55" modify_external_catalogs: true
I20251025 08:02:35.247725 17536 raft_consensus.cc:493] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.247797 17536 raft_consensus.cc:515] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.248097 17536 leader_election.cc:290] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.248798 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 765cb9954ff544a4b6dc25c675f6e1e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 79c60ffb5c5f4ad0a0207a0e5ba80c94) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:35.248831 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c23d5d373a30413b94508b50dd4fec89" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
W20251025 08:02:35.249082 15049 leader_election.cc:343] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.249148 16288 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet f2bc1c43a4724406a9e2cc2c8cb72bec
I20251025 08:02:35.249352 16288 catalog_manager.cc:6719] ReplaceTablet: tablet f2bc1c43a4724406a9e2cc2c8cb72bec deleted and replaced by tablet cfb02f4c7cfa423487226523fa38b984
I20251025 08:02:35.249408 17537 raft_consensus.cc:493] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.249472 17537 raft_consensus.cc:515] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.249490 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_247d1175e8d944908091de531fb4d65c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:35.249728 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_247d1175e8d944908091de531fb4d65c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.249789 17537 leader_election.cc:290] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.250847 16279 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet fc62afd62257471e8590d28e49a50cb2 (table default.Table_8527e07298754b1ab5eefd758ff1fe70 [id=f317f6ac536c45beb5e90ab9bd55ebe7]). Expected version 2 got 0
I20251025 08:02:35.250905 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b316ba50a48446338d49435a8e809ff4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.250993 15249 raft_consensus.cc:2468] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:35.251061 16279 catalog_manager.cc:5741] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401) does not have the latest schema for tablet d049bf946c744664aba74d7a12fa4ff1 (table default.Table_36b5cc8d55f84063a624820d55f1aac8 [id=33bbe4605d924011b9002a939a73203d]). Expected version 1 got 0
I20251025 08:02:35.251152 16279 catalog_manager.cc:5649] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 reported cstate change: term changed from 0 to 1, leader changed from <none> to ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1). New cstate: current_term: 1 leader_uuid: "ab02c9d78a9d42f193755d436c8d44b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:35.251291 15049 leader_election.cc:304] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.251430 17537 raft_consensus.cc:2804] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.251469 17537 raft_consensus.cc:493] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.251506 17537 raft_consensus.cc:3060] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.251808 16281 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_8d621c2f449e477ab01d1b67dc869408 [id=d318bca8bf144870aa5529426cfa9995] alter complete (version 1)
I20251025 08:02:35.252133 16280 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_f552b897a1464486b3a9e4673bb641d4 [id=ebfa83131bd946d0897b32ef3c188c19] alter complete (version 2)
I20251025 08:02:35.252431 17537 raft_consensus.cc:515] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.252508 16280 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_a24e0514b7d94c60a5b075e650077668" } new_table_name: "default.Table_12a6d692e3e14808840bbc62b3616cba" modify_external_catalogs: true
I20251025 08:02:35.252720 17537 leader_election.cc:290] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.253312 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet f2bc1c43a4724406a9e2cc2c8cb72bec with delete_type TABLET_DATA_DELETED (replaced by tablet cfb02f4c7cfa423487226523fa38b984) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:35.253428 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b316ba50a48446338d49435a8e809ff4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:35.253515 15249 raft_consensus.cc:3060] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.253922 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet f2bc1c43a4724406a9e2cc2c8cb72bec with delete_type TABLET_DATA_DELETED (replaced by tablet cfb02f4c7cfa423487226523fa38b984) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:35.254055 17258 tablet_replica.cc:333] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:35.254155 17258 raft_consensus.cc:2243] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.254248 17258 raft_consensus.cc:2272] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.254321 15249 raft_consensus.cc:2468] T b316ba50a48446338d49435a8e809ff4 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
W20251025 08:02:35.254410 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 765cb9954ff544a4b6dc25c675f6e1e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 765cb9954ff544a4b6dc25c675f6e1e0 already in progress: creating tablet
I20251025 08:02:35.254591 15049 leader_election.cc:304] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.254720 17537 raft_consensus.cc:2804] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.254787 17537 raft_consensus.cc:697] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:35.254881 17537 consensus_queue.cc:237] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.256887 17258 ts_tablet_manager.cc:1916] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.257551 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet 346c0c8bf30b4dbaa92436b45e5fbf47 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:35 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:35.257683 14956 tablet_service.cc:1552] Processing DeleteTablet for tablet 765cb9954ff544a4b6dc25c675f6e1e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 79c60ffb5c5f4ad0a0207a0e5ba80c94) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:35.257803 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet 346c0c8bf30b4dbaa92436b45e5fbf47 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:35 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:35.258198 17373 raft_consensus.cc:493] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.258272 17373 raft_consensus.cc:515] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.258603 17373 leader_election.cc:290] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:35.258847 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b826067888164df0af7da797d42c0862" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:35.258942 15107 raft_consensus.cc:2468] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:35.259032 17258 ts_tablet_manager.cc:1929] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:35.259088 17258 log.cc:1199] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/f2bc1c43a4724406a9e2cc2c8cb72bec
I20251025 08:02:35.259305 17258 ts_tablet_manager.cc:1950] T f2bc1c43a4724406a9e2cc2c8cb72bec P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:35.259311 15185 leader_election.cc:304] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.259711 17373 raft_consensus.cc:2804] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.259763 17373 raft_consensus.cc:493] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.259814 17373 raft_consensus.cc:3060] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.259845 17274 tablet_bootstrap.cc:492] T d6243825ae7b4307b5789aaee2473edc P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:35.259884 15089 tablet_service.cc:1552] Processing DeleteTablet for tablet 346c0c8bf30b4dbaa92436b45e5fbf47 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:35 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:35.260011 15092 tablet_service.cc:1552] Processing DeleteTablet for tablet 765cb9954ff544a4b6dc25c675f6e1e0 with delete_type TABLET_DATA_DELETED (replaced by tablet 79c60ffb5c5f4ad0a0207a0e5ba80c94) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:35.260099 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet f2bc1c43a4724406a9e2cc2c8cb72bec with delete_type TABLET_DATA_DELETED (replaced by tablet cfb02f4c7cfa423487226523fa38b984) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:35.260421 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet f2bc1c43a4724406a9e2cc2c8cb72bec (table default.Table_f35d0fa958084bb9bb792e93fd367806 [id=ae28464385cf4504b39a9292d794460f]) successfully deleted
I20251025 08:02:35.260716 17373 raft_consensus.cc:515] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.260818 17274 tablet_bootstrap.cc:654] T d6243825ae7b4307b5789aaee2473edc P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.261047 17258 tablet_replica.cc:333] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:35.261117 17373 leader_election.cc:290] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:35.261268 17258 raft_consensus.cc:2243] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.261471 17258 raft_consensus.cc:2272] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.261833 17258 ts_tablet_manager.cc:1916] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.262092 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b826067888164df0af7da797d42c0862" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:35.262207 15109 raft_consensus.cc:3060] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.263108 15109 raft_consensus.cc:2468] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:35.263715 15185 leader_election.cc:304] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.263871 17373 raft_consensus.cc:2804] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.263871 17258 ts_tablet_manager.cc:1929] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251025 08:02:35.263993 17373 raft_consensus.cc:697] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:35.264076 17258 log.cc:1199] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/346c0c8bf30b4dbaa92436b45e5fbf47
I20251025 08:02:35.264135 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 193) took 1357 ms. Trace:
I20251025 08:02:35.264119 17373 consensus_queue.cc:237] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.264197 17198 rpcz_store.cc:276] 1025 08:02:33.906207 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.906558 (+ 351us) service_pool.cc:225] Handling call
1025 08:02:35.209204 (+1302646us) ts_tablet_manager.cc:1151] Deleting tablet 0078dd6fb0e34d01a54889326dd6dfd7
1025 08:02:35.209210 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.225105 (+ 15895us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.226568 (+ 1463us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.241431 (+ 14863us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x5614390fb918. stack: 00007f02fd737e43 00007f02fd738435 00007f02fd29f89d 0000561430081e58 0000561430081eab 0000561430085df2 00007f02fd72e7d0 00007f02fd72e06d 00007f0301408fdd 00007f030141d79f 00007f0300550e14 00007f0300562e07 00007f030054ffb1 00007f030055d663 000056143010ebe9 00007f02fd75b634
1025 08:02:35.264123 (+ 22692us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":30994304,"tablet-delete.queue_time_us":1278855}
I20251025 08:02:35.264397 17198 tablet_replica.cc:333] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.264511 17198 raft_consensus.cc:2243] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.264597 17198 raft_consensus.cc:2272] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.264775 14973 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "c23d5d373a30413b94508b50dd4fec89" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:35.264848 14974 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b316ba50a48446338d49435a8e809ff4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:35.264919 17198 ts_tablet_manager.cc:1916] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.264953 14976 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b316ba50a48446338d49435a8e809ff4" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:35.265079 14971 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b826067888164df0af7da797d42c0862" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:35.265136 14970 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b826067888164df0af7da797d42c0862" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:35.265988 15183 leader_election.cc:343] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:35.266252 15048 leader_election.cc:343] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.266325 15048 leader_election.cc:304] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:35.264708 17258 ts_tablet_manager.cc:1950] T 346c0c8bf30b4dbaa92436b45e5fbf47 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:35.266407 16391 tablet_bootstrap.cc:492] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:35.266464 17536 raft_consensus.cc:2749] T c23d5d373a30413b94508b50dd4fec89 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20251025 08:02:35.266515 15048 leader_election.cc:343] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:35.266655 15048 leader_election.cc:343] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.266971 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 346c0c8bf30b4dbaa92436b45e5fbf47 (table default.Table_258c905a78d94ba197752a61781fa019 [id=ef3a1760f2c44935bbb79e518510905f]) successfully deleted
I20251025 08:02:35.267360 17198 ts_tablet_manager.cc:1929] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:35.267387 16391 tablet_bootstrap.cc:654] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.267421 17198 log.cc:1199] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/5027b80220e34f5f8e1e8e8479ec41f3
I20251025 08:02:35.267629 17198 ts_tablet_manager.cc:1950] T 5027b80220e34f5f8e1e8e8479ec41f3 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.268036 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 0078dd6fb0e34d01a54889326dd6dfd7 (table default.Table_8c35a9c9c9614e8bac181a2aa85e12ba [id=4f1a1f84f436411db166b8c28873a27b]) successfully deleted
I20251025 08:02:35.268306 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 194) took 1362 ms. Trace:
I20251025 08:02:35.268350 17198 rpcz_store.cc:276] 1025 08:02:33.906256 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.907339 (+ 1083us) service_pool.cc:225] Handling call
1025 08:02:35.264373 (+1357034us) ts_tablet_manager.cc:1151] Deleting tablet 5027b80220e34f5f8e1e8e8479ec41f3
1025 08:02:35.264379 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.265937 (+ 1558us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.267312 (+ 1375us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.268295 (+ 983us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1333948}
I20251025 08:02:35.268393 16391 tablet_bootstrap.cc:492] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:35.268460 16391 ts_tablet_manager.cc:1403] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:35.268527 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 185) took 1362 ms. Trace:
I20251025 08:02:35.268560 17198 rpcz_store.cc:276] 1025 08:02:33.905828 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.907422 (+ 1594us) service_pool.cc:225] Handling call
1025 08:02:35.268475 (+1361053us) ts_tablet_manager.cc:1151] Deleting tablet 5522e9c5bf904c63bc4b00a226a0cc45
1025 08:02:35.268480 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.268521 (+ 41us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1338021}
I20251025 08:02:35.268697 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 191) took 1362 ms. Trace:
I20251025 08:02:35.268733 17198 rpcz_store.cc:276] 1025 08:02:33.906090 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:33.907652 (+ 1562us) service_pool.cc:225] Handling call
1025 08:02:35.268649 (+1360997us) ts_tablet_manager.cc:1151] Deleting tablet f64222dd274f46e9bf79dba96c5c18b1
1025 08:02:35.268654 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.268689 (+ 35us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1338149}
I20251025 08:02:35.268848 17198 tablet_replica.cc:333] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.268878 16284 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet ba46d4b94db9478db3ff5ec6f097de1d
I20251025 08:02:35.268843 16391 raft_consensus.cc:359] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.268929 16391 raft_consensus.cc:385] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.268955 16391 raft_consensus.cc:740] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.268956 17198 raft_consensus.cc:2243] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.269039 17198 raft_consensus.cc:2272] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.269049 16391 consensus_queue.cc:260] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.269300 16391 ts_tablet_manager.cc:1434] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.269330 17198 ts_tablet_manager.cc:1916] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.269448 16391 tablet_bootstrap.cc:492] T 6b16e4b9ef4c41db83ab3bf55149719b P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
W20251025 08:02:35.270164 15183 leader_election.cc:343] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.270390 16391 tablet_bootstrap.cc:654] T 6b16e4b9ef4c41db83ab3bf55149719b P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.270833 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet af5a5d2903ff4142b1f1e70dd2a7d173 (table default.Table_97dcb2270cdf4d21824166c30b3a62a9 [id=d53447a316c5438e86cdac872682b3a1]) successfully deleted
W20251025 08:02:35.271231 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 774988b980d8474e9b41518410c5dc9b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 774988b980d8474e9b41518410c5dc9b already in progress: creating tablet
W20251025 08:02:35.271597 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 1e248b8303b1498e96178d4e46ad691e because the tablet was not found. No further retry: Not found: Tablet not found: 1e248b8303b1498e96178d4e46ad691e
I20251025 08:02:35.271824 17194 tablet_replica.cc:333] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:35.271855 17536 raft_consensus.cc:493] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.271932 17536 raft_consensus.cc:515] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.272048 17194 raft_consensus.cc:2243] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:35.272277 17536 leader_election.cc:290] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.272492 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d20a130fc8ea40ddba509d2825ac028d" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:35.272637 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d20a130fc8ea40ddba509d2825ac028d" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.272953 15081 tablet_service.cc:1552] Processing DeleteTablet for tablet ba46d4b94db9478db3ff5ec6f097de1d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:35 UTC) from {username='slave'} at 127.0.0.1:47284
W20251025 08:02:35.272958 15048 leader_election.cc:343] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
W20251025 08:02:35.273059 15049 leader_election.cc:343] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.273119 15049 leader_election.cc:304] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:35.273407 17536 raft_consensus.cc:2749] T d20a130fc8ea40ddba509d2825ac028d P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:35.273483 17198 ts_tablet_manager.cc:1929] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:35.273531 17198 log.cc:1199] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/5022f9beb59449828f59dca9d14caa50
I20251025 08:02:35.273784 17194 pending_rounds.cc:70] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:35.273999 17198 ts_tablet_manager.cc:1950] T 5022f9beb59449828f59dca9d14caa50 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.274936 17194 pending_rounds.cc:77] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609838062493696 op_type: NO_OP noop_request { }
I20251025 08:02:35.275070 17194 raft_consensus.cc:2889] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:35.275161 17194 raft_consensus.cc:2272] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
W20251025 08:02:35.275979 16272 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 5522e9c5bf904c63bc4b00a226a0cc45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5522e9c5bf904c63bc4b00a226a0cc45 already in progress: creating tablet
I20251025 08:02:35.276057 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 208) took 1012 ms. Trace:
I20251025 08:02:35.276113 17194 ts_tablet_manager.cc:1916] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:35.276134 16272 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet f64222dd274f46e9bf79dba96c5c18b1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f64222dd274f46e9bf79dba96c5c18b1 already in progress: creating tablet
I20251025 08:02:35.276119 17198 rpcz_store.cc:276] 1025 08:02:34.263859 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:34.264055 (+ 196us) service_pool.cc:225] Handling call
1025 08:02:35.268829 (+1004774us) ts_tablet_manager.cc:1151] Deleting tablet 5022f9beb59449828f59dca9d14caa50
1025 08:02:35.268834 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.271681 (+ 2847us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.273427 (+ 1746us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.276044 (+ 2617us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1004678}
I20251025 08:02:35.276286 17198 tablet_replica.cc:333] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.276404 17198 raft_consensus.cc:2243] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:35.277979 17198 raft_consensus.cc:2272] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.276441 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 5022f9beb59449828f59dca9d14caa50 (table default.Table_06d9fbe4ef5e4a59b12abb65af8ce2a0 [id=ce6a220ddfc540dbb17e28bc74b66449]) successfully deleted
I20251025 08:02:35.277251 16286 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 0d6f8c2ab96549e6b3bc13168de2b604
I20251025 08:02:35.277601 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_ce648facc65a4fd487973e520060a2ab"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:35.278306 16286 catalog_manager.cc:6719] ReplaceTablet: tablet 0d6f8c2ab96549e6b3bc13168de2b604 deleted and replaced by tablet ff00bcdc67aa457e92c95fb32d756fcd
I20251025 08:02:35.278319 16390 tablet_bootstrap.cc:492] T d0de3ec67dcc4e41a447338869076314 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
W20251025 08:02:35.278339 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ce648facc65a4fd487973e520060a2ab in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.278390 16390 ts_tablet_manager.cc:1403] T d0de3ec67dcc4e41a447338869076314 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.034s user 0.001s sys 0.000s
I20251025 08:02:35.278484 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_5543a009c537411a8bf92e25534ec7df"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:35.278632 17198 ts_tablet_manager.cc:1916] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:35.278729 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5543a009c537411a8bf92e25534ec7df in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.278736 16390 raft_consensus.cc:359] T d0de3ec67dcc4e41a447338869076314 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.278824 16390 raft_consensus.cc:385] T d0de3ec67dcc4e41a447338869076314 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.278853 16390 raft_consensus.cc:740] T d0de3ec67dcc4e41a447338869076314 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.277330 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet a941ba28528d41699390e9db80f25594
I20251025 08:02:35.278949 16390 consensus_queue.cc:260] T d0de3ec67dcc4e41a447338869076314 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.279085 16283 catalog_manager.cc:6719] ReplaceTablet: tablet a941ba28528d41699390e9db80f25594 deleted and replaced by tablet abdf2fe7c8f44e238a3330e05d7926e6
I20251025 08:02:35.279181 16390 ts_tablet_manager.cc:1434] T d0de3ec67dcc4e41a447338869076314 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:35.279217 16283 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e45046c48bb54111b38f009cc14efd2d" } modify_external_catalogs: true
I20251025 08:02:35.279296 16283 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e45046c48bb54111b38f009cc14efd2d" } modify_external_catalogs: true
I20251025 08:02:35.279338 16390 tablet_bootstrap.cc:492] T d6cbe1616ced4f47999a6a1365af0092 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:35.279877 15218 tablet_service.cc:1552] Processing DeleteTablet for tablet 0d6f8c2ab96549e6b3bc13168de2b604 with delete_type TABLET_DATA_DELETED (replaced by tablet ff00bcdc67aa457e92c95fb32d756fcd) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:35.280045 16390 tablet_bootstrap.cc:654] T d6cbe1616ced4f47999a6a1365af0092 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:35.280416 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 0d6f8c2ab96549e6b3bc13168de2b604 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d6f8c2ab96549e6b3bc13168de2b604 already in progress: creating tablet
I20251025 08:02:35.280465 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet a941ba28528d41699390e9db80f25594 with delete_type TABLET_DATA_DELETED (replaced by tablet abdf2fe7c8f44e238a3330e05d7926e6) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:35.280581 17258 tablet_replica.cc:333] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:35.280697 17258 raft_consensus.cc:2243] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:35.280840 17258 raft_consensus.cc:2272] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.280917 17198 ts_tablet_manager.cc:1929] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:35.280974 17198 log.cc:1199] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/d05bf0056dfc43eeb4105af559497bdc
I20251025 08:02:35.281129 17258 ts_tablet_manager.cc:1916] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.281205 17198 ts_tablet_manager.cc:1950] T d05bf0056dfc43eeb4105af559497bdc P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.281620 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 211) took 1017 ms. Trace:
I20251025 08:02:35.281669 17198 rpcz_store.cc:276] 1025 08:02:34.264297 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:34.264428 (+ 131us) service_pool.cc:225] Handling call
1025 08:02:35.276263 (+1011835us) ts_tablet_manager.cc:1151] Deleting tablet d05bf0056dfc43eeb4105af559497bdc
1025 08:02:35.276269 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.280010 (+ 3741us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.280873 (+ 863us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.281610 (+ 737us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1011744}
I20251025 08:02:35.282128 14958 tablet_service.cc:1552] Processing DeleteTablet for tablet a941ba28528d41699390e9db80f25594 with delete_type TABLET_DATA_DELETED (replaced by tablet abdf2fe7c8f44e238a3330e05d7926e6) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:35.282940 17258 ts_tablet_manager.cc:1929] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:35.283028 17258 log.cc:1199] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/a941ba28528d41699390e9db80f25594
I20251025 08:02:35.283493 17258 ts_tablet_manager.cc:1950] T a941ba28528d41699390e9db80f25594 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:35.283746 15081 tablet_service.cc:1552] Processing DeleteTablet for tablet 0d6f8c2ab96549e6b3bc13168de2b604 with delete_type TABLET_DATA_DELETED (replaced by tablet ff00bcdc67aa457e92c95fb32d756fcd) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:35.283993 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet a941ba28528d41699390e9db80f25594 with delete_type TABLET_DATA_DELETED (replaced by tablet abdf2fe7c8f44e238a3330e05d7926e6) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:35.284271 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 207) took 1020 ms. Trace:
I20251025 08:02:35.284436 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet a941ba28528d41699390e9db80f25594 (table default.Table_ad9841940177424384c1bbcbf700ea9d [id=b58927a3527c45cb946d1fcc0681d6bf]) successfully deleted
W20251025 08:02:35.284780 16285 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 345404470a4c4c5c936e22cc998ad516 has no consensus state
I20251025 08:02:35.284998 16285 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_11241d17fa3e4702b76986f6ce9d04d5" } modify_external_catalogs: true
I20251025 08:02:35.285084 16285 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_11241d17fa3e4702b76986f6ce9d04d5" } modify_external_catalogs: true
I20251025 08:02:35.286913 17194 ts_tablet_manager.cc:1929] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:35.286978 17194 log.cc:1199] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/f2bc1c43a4724406a9e2cc2c8cb72bec
I20251025 08:02:35.288092 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet d05bf0056dfc43eeb4105af559497bdc (table default.Table_96c726b8fcd341f2895079b79f53cf7c [id=72243e33e90940c09953a9ec2fcfd435]) successfully deleted
I20251025 08:02:35.289289 17194 ts_tablet_manager.cc:1950] T f2bc1c43a4724406a9e2cc2c8cb72bec P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:35.289335 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet ba46d4b94db9478db3ff5ec6f097de1d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:35 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:35.289363 17198 rpcz_store.cc:276] 1025 08:02:34.263823 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:34.272462 (+ 8639us) service_pool.cc:225] Handling call
1025 08:02:35.284197 (+1011735us) ts_tablet_manager.cc:1151] Deleting tablet f102eb1c22004790839b6563bd830786
1025 08:02:35.284203 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.284262 (+ 59us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1011657}
I20251025 08:02:35.289544 17198 tablet_replica.cc:333] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.289661 17198 raft_consensus.cc:2243] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.289741 17198 raft_consensus.cc:2272] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.290045 17198 ts_tablet_manager.cc:1916] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:35.290225 16272 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet f102eb1c22004790839b6563bd830786 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f102eb1c22004790839b6563bd830786 already in progress: creating tablet
I20251025 08:02:35.290704 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet f2bc1c43a4724406a9e2cc2c8cb72bec (table default.Table_f35d0fa958084bb9bb792e93fd367806 [id=ae28464385cf4504b39a9292d794460f]) successfully deleted
W20251025 08:02:35.291332 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 765cb9954ff544a4b6dc25c675f6e1e0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 765cb9954ff544a4b6dc25c675f6e1e0 already in progress: creating tablet
I20251025 08:02:35.291565 17194 tablet_replica.cc:333] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:35.291726 17194 raft_consensus.cc:2243] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:35.291922 17198 ts_tablet_manager.cc:1929] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:35.291990 17198 log.cc:1199] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/7f5c6a17507d4a5a8057a725d3299ab9
I20251025 08:02:35.292178 17194 raft_consensus.cc:2272] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.292227 17198 ts_tablet_manager.cc:1950] T 7f5c6a17507d4a5a8057a725d3299ab9 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.292253 16288 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_bb335e59db954b25b377adaaf49d0e47"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:35.292466 16280 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 3c86ceda5c2c4583b9ff388e82b5369f consensus state has no leader
W20251025 08:02:35.292527 16288 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bb335e59db954b25b377adaaf49d0e47 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.292614 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 209) took 1028 ms. Trace:
I20251025 08:02:35.292675 16280 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_e83835c3eaa94f4096bf89a3880ef9c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:35.292670 17198 rpcz_store.cc:276] 1025 08:02:34.263962 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:34.272561 (+ 8599us) service_pool.cc:225] Handling call
1025 08:02:35.289524 (+1016963us) ts_tablet_manager.cc:1151] Deleting tablet 7f5c6a17507d4a5a8057a725d3299ab9
1025 08:02:35.289529 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.291021 (+ 1492us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.291881 (+ 860us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.292604 (+ 723us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1016892}
I20251025 08:02:35.292843 17198 tablet_replica.cc:333] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.292936 17198 raft_consensus.cc:2243] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
W20251025 08:02:35.292932 16280 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e83835c3eaa94f4096bf89a3880ef9c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.293007 17198 raft_consensus.cc:2272] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.293288 17198 ts_tablet_manager.cc:1916] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.295276 17198 ts_tablet_manager.cc:1929] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:35.295347 17198 log.cc:1199] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/b826067888164df0af7da797d42c0862
I20251025 08:02:35.295536 17198 ts_tablet_manager.cc:1950] T b826067888164df0af7da797d42c0862 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.295533 16284 catalog_manager.cc:5649] T b316ba50a48446338d49435a8e809ff4 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:35.295714 16287 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_ad6af431fceb4b948de2abbc296414fc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:35.295913 16284 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 52765e926e904ec9b052db3135cfb77a (table default.Table_e91151e2cc6a437b99b47d5694fa6e80 [id=6716c87cf323485893ce723e76924979]). Expected version 1 got 0
W20251025 08:02:35.295979 16287 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad6af431fceb4b948de2abbc296414fc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.296137 16284 catalog_manager.cc:5649] T ea8a95b8fbf94520a2c219755cdc5d14 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:35.296237 17194 ts_tablet_manager.cc:1916] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.296330 16284 catalog_manager.cc:5649] T c079391742cc4d488826c5536ab6d1d1 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:35.296543 16284 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet d20a130fc8ea40ddba509d2825ac028d (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799]). Expected version 1 got 0
I20251025 08:02:35.296738 16284 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet d049bf946c744664aba74d7a12fa4ff1 (table default.Table_36b5cc8d55f84063a624820d55f1aac8 [id=33bbe4605d924011b9002a939a73203d]). Expected version 1 got 0
I20251025 08:02:35.296873 16284 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet fc62afd62257471e8590d28e49a50cb2 (table default.Table_8527e07298754b1ab5eefd758ff1fe70 [id=f317f6ac536c45beb5e90ab9bd55ebe7]). Expected version 2 got 0
I20251025 08:02:35.296986 16281 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_3b470b735ca242c9a8df091fc03ea60d [id=4e2fede2a3ad4c80b68f74b9ef40b72b] alter complete (version 1)
W20251025 08:02:35.297499 16282 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet cfb02f4c7cfa423487226523fa38b984 has no consensus state
I20251025 08:02:35.297842 16282 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_39b16d4513794370a809c027496a8357" } new_table_name: "default.Table_0edfa12cb3ba4ba5884a2eb5f7699c3b" modify_external_catalogs: true
I20251025 08:02:35.299232 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 210) took 1035 ms. Trace:
I20251025 08:02:35.299351 17198 rpcz_store.cc:276] 1025 08:02:34.264007 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:34.272649 (+ 8642us) service_pool.cc:225] Handling call
1025 08:02:35.292819 (+1020170us) ts_tablet_manager.cc:1151] Deleting tablet b826067888164df0af7da797d42c0862
1025 08:02:35.292826 (+ 7us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.294298 (+ 1472us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.295226 (+ 928us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.299221 (+ 3995us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1020100}
I20251025 08:02:35.299649 17198 tablet_replica.cc:333] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.299783 17198 raft_consensus.cc:2243] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:35.299969 17198 pending_rounds.cc:70] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e: Trying to abort 1 pending ops.
I20251025 08:02:35.300045 17198 pending_rounds.cc:77] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609833201618944 op_type: NO_OP noop_request { }
I20251025 08:02:35.301584 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 7f5c6a17507d4a5a8057a725d3299ab9 (table default.Table_c13a8bad402148f19fcdc19766286842 [id=b5be4f412cc04aa59c819d0e1cc403bf]) successfully deleted
I20251025 08:02:35.301757 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet b826067888164df0af7da797d42c0862 (table default.Table_c6f81392e62f401fa4a3ebe3de2eacbb [id=7eda6d3807c042d3a7aecf63ebd73fae]) successfully deleted
I20251025 08:02:35.303095 14956 tablet_service.cc:1552] Processing DeleteTablet for tablet 0d6f8c2ab96549e6b3bc13168de2b604 with delete_type TABLET_DATA_DELETED (replaced by tablet ff00bcdc67aa457e92c95fb32d756fcd) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:35.303313 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet ba46d4b94db9478db3ff5ec6f097de1d with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:35 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:35.303879 17198 raft_consensus.cc:2889] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:35.303993 17198 raft_consensus.cc:2272] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.304368 17198 ts_tablet_manager.cc:1916] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.305069 17765 tablet.cc:1722] T fc62afd62257471e8590d28e49a50cb2 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:35.305800 17620 tablet.cc:1722] T fc62afd62257471e8590d28e49a50cb2 P ab02c9d78a9d42f193755d436c8d44b2: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:35.306016 16285 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet adca8cd7558c456f874538e21aceb2c3
I20251025 08:02:35.306105 17198 ts_tablet_manager.cc:1929] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:35.306164 17198 log.cc:1199] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/2be36d176bf34fb6bd3c70b42af15cc9
I20251025 08:02:35.306201 16285 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_1b0681405e9c4d41923030d27404e9d2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:35.306476 17198 ts_tablet_manager.cc:1950] T 2be36d176bf34fb6bd3c70b42af15cc9 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
W20251025 08:02:35.306496 16285 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1b0681405e9c4d41923030d27404e9d2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.306656 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 212) took 1042 ms. Trace:
I20251025 08:02:35.306696 17198 rpcz_store.cc:276] 1025 08:02:34.264347 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:34.272735 (+ 8388us) service_pool.cc:225] Handling call
1025 08:02:35.299627 (+1026892us) ts_tablet_manager.cc:1151] Deleting tablet 2be36d176bf34fb6bd3c70b42af15cc9
1025 08:02:35.299632 (+ 5us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.305257 (+ 5625us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.306058 (+ 801us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.306649 (+ 591us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1026824}
I20251025 08:02:35.306854 17198 tablet_replica.cc:333] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.306983 17198 raft_consensus.cc:2243] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.307077 17198 raft_consensus.cc:2272] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.307333 16283 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet ca90e72e68324cf29dffafad4fca210c
I20251025 08:02:35.307356 17198 ts_tablet_manager.cc:1916] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.307487 16283 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_0a6ff7ae05a040c3be53115abe29f5ce" } modify_external_catalogs: true
I20251025 08:02:35.307561 16283 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_0a6ff7ae05a040c3be53115abe29f5ce" } modify_external_catalogs: true
I20251025 08:02:35.309051 17194 ts_tablet_manager.cc:1929] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20251025 08:02:35.310307 17566 tablet.cc:1722] T fc62afd62257471e8590d28e49a50cb2 P e51a2be794f04642b89386067ecbc77e: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20251025 08:02:35.310506 17194 log.cc:1199] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/346c0c8bf30b4dbaa92436b45e5fbf47
I20251025 08:02:35.310745 17194 ts_tablet_manager.cc:1950] T 346c0c8bf30b4dbaa92436b45e5fbf47 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:35.312603 16279 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_9d4427ccec9b4a2da3bbd2aab811ca29 [id=3f5c8992a5e44e0d960303db92eb62be] alter complete (version 1)
I20251025 08:02:35.313597 17198 ts_tablet_manager.cc:1929] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:35.313650 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 346c0c8bf30b4dbaa92436b45e5fbf47 (table default.Table_258c905a78d94ba197752a61781fa019 [id=ef3a1760f2c44935bbb79e518510905f]) successfully deleted
I20251025 08:02:35.314222 17194 tablet_replica.cc:333] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:35.314370 17194 raft_consensus.cc:2243] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.314507 17194 raft_consensus.cc:2272] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.314635 17198 log.cc:1199] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/b4a6f2b64c994f3abefef9724911a5fc
I20251025 08:02:35.314654 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 2be36d176bf34fb6bd3c70b42af15cc9 (table default.Table_65442dc666594e129611ee817db7b2c0 [id=de277558d55a46519b3c1e18c51f18fb]) successfully deleted
I20251025 08:02:35.314867 17198 ts_tablet_manager.cc:1950] T b4a6f2b64c994f3abefef9724911a5fc P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.314867 17194 ts_tablet_manager.cc:1916] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.315119 17198 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:47284 (request call id 213) took 1050 ms. Trace:
I20251025 08:02:35.315202 17198 rpcz_store.cc:276] 1025 08:02:34.264393 (+ 0us) service_pool.cc:168] Inserting onto call queue
1025 08:02:34.272823 (+ 8430us) service_pool.cc:225] Handling call
1025 08:02:35.306832 (+1034009us) ts_tablet_manager.cc:1151] Deleting tablet b4a6f2b64c994f3abefef9724911a5fc
1025 08:02:35.306838 (+ 6us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
1025 08:02:35.308172 (+ 1334us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.313552 (+ 5380us) tablet_metadata.cc:641] Metadata flushed
1025 08:02:35.315111 (+ 1559us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1033942}
I20251025 08:02:35.321650 17198 tablet_replica.cc:333] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
W20251025 08:02:35.321725 16282 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dfe5c16d330b4b428a00e7b8e2297c9b consensus state has no leader
I20251025 08:02:35.321810 17198 raft_consensus.cc:2243] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.321903 17198 raft_consensus.cc:2272] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.322147 16281 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_a09b3cce99d7469f85ae231bf3518fd9 [id=83fb26d8a404409c8f7bf016039f5c6e] alter complete (version 1)
I20251025 08:02:35.322268 17198 ts_tablet_manager.cc:1916] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.322377 17194 ts_tablet_manager.cc:1929] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20251025 08:02:35.322904 16283 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 62b2769c6ffc48f980ce7ed2bfa1dd75
I20251025 08:02:35.322958 16281 master_service.cc:954] ReplaceTablet: received request to replace tablet 54ac551e1e9a4bb1970be52edd04c0d3 from {username='slave'} at 127.0.0.1:39708
I20251025 08:02:35.323514 15224 tablet_service.cc:1552] Processing DeleteTablet for tablet 62b2769c6ffc48f980ce7ed2bfa1dd75 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:35 UTC) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:35.323710 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet b4a6f2b64c994f3abefef9724911a5fc (table default.Table_15d9c5aa50e643adb2dae30a80b6fcd4 [id=045593a2a7cf4197836b256661103ba5]) successfully deleted
I20251025 08:02:35.323745 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 62b2769c6ffc48f980ce7ed2bfa1dd75 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:35 UTC) from {username='slave'} at 127.0.0.1:47284
W20251025 08:02:35.323843 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet a40c5721a4304345b471960ed1691930 because the tablet was not found. No further retry: Not found: Tablet not found: a40c5721a4304345b471960ed1691930
W20251025 08:02:35.323925 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet bfdc6022cc5747439edcb8aa865b9437 because the tablet was not found. No further retry: Not found: Tablet not found: bfdc6022cc5747439edcb8aa865b9437
W20251025 08:02:35.323992 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet fc5f892ca7a246a28a556fe0eb3f5442 because the tablet was not found. No further retry: Not found: Tablet not found: fc5f892ca7a246a28a556fe0eb3f5442
W20251025 08:02:35.324044 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet c043ab70d7364e05b0b352ac5c416db1 because the tablet was not found. No further retry: Not found: Tablet not found: c043ab70d7364e05b0b352ac5c416db1
W20251025 08:02:35.324113 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 34c330b5dd544ae686f741cdd85d023d because the tablet was not found. No further retry: Not found: Tablet not found: 34c330b5dd544ae686f741cdd85d023d
W20251025 08:02:35.324168 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet ff20cd7d33a440bab24bd4a61fff1f30 because the tablet was not found. No further retry: Not found: Tablet not found: ff20cd7d33a440bab24bd4a61fff1f30
I20251025 08:02:35.324250 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet 62b2769c6ffc48f980ce7ed2bfa1dd75 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:35 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:35.324374 17194 log.cc:1199] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/a941ba28528d41699390e9db80f25594
I20251025 08:02:35.324638 17194 ts_tablet_manager.cc:1950] T a941ba28528d41699390e9db80f25594 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:35.324666 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet b826067888164df0af7da797d42c0862 with delete_type TABLET_DATA_DELETED (replaced by tablet bb517f3c7dc545f089eff1fcb4acbce9) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:35.325203 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet a941ba28528d41699390e9db80f25594 (table default.Table_ad9841940177424384c1bbcbf700ea9d [id=b58927a3527c45cb946d1fcc0681d6bf]) successfully deleted
W20251025 08:02:35.327875 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet ba46d4b94db9478db3ff5ec6f097de1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba46d4b94db9478db3ff5ec6f097de1d already in progress: creating tablet
W20251025 08:02:35.328177 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 0d6f8c2ab96549e6b3bc13168de2b604 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 0d6f8c2ab96549e6b3bc13168de2b604 already in progress: creating tablet
I20251025 08:02:35.328266 17198 ts_tablet_manager.cc:1929] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:35.328326 17198 log.cc:1199] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/cc676245d2984363b4af1e817b444c3d
I20251025 08:02:35.328513 17258 tablet_replica.cc:333] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:35.328569 17198 ts_tablet_manager.cc:1950] T cc676245d2984363b4af1e817b444c3d P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
W20251025 08:02:35.328668 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet ba46d4b94db9478db3ff5ec6f097de1d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ba46d4b94db9478db3ff5ec6f097de1d already in progress: creating tablet
I20251025 08:02:35.328869 17194 tablet_replica.cc:333] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:35.329041 17194 raft_consensus.cc:2243] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:35.329088 17258 raft_consensus.cc:2243] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.329248 17258 raft_consensus.cc:2272] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.329249 17194 raft_consensus.cc:2272] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.329551 17194 ts_tablet_manager.cc:1916] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.329612 17198 tablet_replica.cc:333] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.329614 17258 ts_tablet_manager.cc:1916] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.331367 17258 ts_tablet_manager.cc:1929] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:35.331447 17258 log.cc:1199] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/62b2769c6ffc48f980ce7ed2bfa1dd75
I20251025 08:02:35.331653 17258 ts_tablet_manager.cc:1950] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
I20251025 08:02:35.332096 17258 tablet_replica.cc:333] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31: stopping tablet replica
I20251025 08:02:35.332204 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet 62b2769c6ffc48f980ce7ed2bfa1dd75 (table default.Table_0a6ff7ae05a040c3be53115abe29f5ce [id=fb111be93abf42e9b40d60ddcf64190f]) successfully deleted
I20251025 08:02:35.332268 17258 raft_consensus.cc:2243] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:35.332386 17258 pending_rounds.cc:70] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Trying to abort 1 pending ops.
I20251025 08:02:35.332420 17258 pending_rounds.cc:77] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609839163092992 op_type: NO_OP noop_request { }
I20251025 08:02:35.332482 17258 raft_consensus.cc:2889] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:35.332543 17258 raft_consensus.cc:2272] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.332649 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet cc676245d2984363b4af1e817b444c3d (table default.Table_c9a43b4d33d14d7dbea3c1994be81413 [id=a26957427b014b0885f66b058ab6ece8]) successfully deleted
I20251025 08:02:35.333921 17194 ts_tablet_manager.cc:1929] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:35.334030 17194 log.cc:1199] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/62b2769c6ffc48f980ce7ed2bfa1dd75
I20251025 08:02:35.334316 17194 ts_tablet_manager.cc:1950] T 62b2769c6ffc48f980ce7ed2bfa1dd75 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:35.335729 16281 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet 54ac551e1e9a4bb1970be52edd04c0d3
I20251025 08:02:35.335973 16281 catalog_manager.cc:6719] ReplaceTablet: tablet 54ac551e1e9a4bb1970be52edd04c0d3 deleted and replaced by tablet 8d852805cb7a4c099337cbbaf1e18a2d
I20251025 08:02:35.336520 15215 tablet_service.cc:1552] Processing DeleteTablet for tablet 54ac551e1e9a4bb1970be52edd04c0d3 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d852805cb7a4c099337cbbaf1e18a2d) from {username='slave'} at 127.0.0.1:42704
I20251025 08:02:35.336546 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet 54ac551e1e9a4bb1970be52edd04c0d3 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d852805cb7a4c099337cbbaf1e18a2d) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:35.329730 17198 raft_consensus.cc:2243] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.337641 17198 raft_consensus.cc:2272] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.338079 17198 ts_tablet_manager.cc:1916] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:35.339816 17873 consensus_queue.cc:1175] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" status { last_received { term: 1 index: 1 } last_committed_idx: 0 last_received_current_leader { term: 1 index: 1 } }
I20251025 08:02:35.340130 17198 ts_tablet_manager.cc:1929] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:35.340265 17198 log.cc:1199] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/42e8a5ee7d6a42aaaf95c33617abff3f
I20251025 08:02:35.340335 17274 tablet_bootstrap.cc:492] T d6243825ae7b4307b5789aaee2473edc P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:35.340413 17274 ts_tablet_manager.cc:1403] T d6243825ae7b4307b5789aaee2473edc P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.081s user 0.000s sys 0.002s
I20251025 08:02:35.340555 17198 ts_tablet_manager.cc:1950] T 42e8a5ee7d6a42aaaf95c33617abff3f P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.340853 17274 raft_consensus.cc:359] T d6243825ae7b4307b5789aaee2473edc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.340950 17274 raft_consensus.cc:385] T d6243825ae7b4307b5789aaee2473edc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.340992 17274 raft_consensus.cc:740] T d6243825ae7b4307b5789aaee2473edc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.341107 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 42e8a5ee7d6a42aaaf95c33617abff3f (table default.Table_5d847a37cb0c456294cb5137046f80bb [id=1f6784494d0b4b98b46077a0af6c2ea8]) successfully deleted
I20251025 08:02:35.341094 17274 consensus_queue.cc:260] T d6243825ae7b4307b5789aaee2473edc P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.341150 17198 tablet_replica.cc:333] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.341284 17198 raft_consensus.cc:2243] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.341377 17274 ts_tablet_manager.cc:1434] T d6243825ae7b4307b5789aaee2473edc P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.341565 17274 tablet_bootstrap.cc:492] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:35.342315 17274 tablet_bootstrap.cc:654] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.341387 17198 raft_consensus.cc:2272] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.343218 17198 ts_tablet_manager.cc:1916] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.343256 17274 tablet_bootstrap.cc:492] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:35.343338 17536 raft_consensus.cc:493] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.343410 17274 ts_tablet_manager.cc:1403] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20251025 08:02:35.343397 17536 raft_consensus.cc:515] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.343758 17536 leader_election.cc:290] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.343956 17274 raft_consensus.cc:359] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.344260 17274 raft_consensus.cc:385] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.344344 17274 raft_consensus.cc:740] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.344530 17274 consensus_queue.cc:260] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.344924 17274 ts_tablet_manager.cc:1434] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.345117 17274 tablet_bootstrap.cc:492] T 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:35.345625 17198 ts_tablet_manager.cc:1929] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20251025 08:02:35.345700 17198 log.cc:1199] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/f426e93af38e4e17b30cd01eea12dcac
I20251025 08:02:35.345938 17198 ts_tablet_manager.cc:1950] T f426e93af38e4e17b30cd01eea12dcac P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.346313 17274 tablet_bootstrap.cc:654] T 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.346756 17198 tablet_replica.cc:333] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.346860 17198 raft_consensus.cc:2243] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.346944 17198 raft_consensus.cc:2272] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.347133 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet f426e93af38e4e17b30cd01eea12dcac (table default.Table_1d154c130315454cad4d9f3ea6bdd9b2 [id=a1ed1a0c27ef42c69acd197420340d7d]) successfully deleted
I20251025 08:02:35.347433 17198 ts_tablet_manager.cc:1916] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:35.347615 16272 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 1820be622ead4fd88437c79d95b34caf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1820be622ead4fd88437c79d95b34caf already in progress: creating tablet
W20251025 08:02:35.347919 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 47b0f93bac664a44989534097be9fd73 because the tablet was not found. No further retry: Not found: Tablet not found: 47b0f93bac664a44989534097be9fd73
W20251025 08:02:35.348114 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 98baf6e8d8e84b42a83054495ae19e01 because the tablet was not found. No further retry: Not found: Tablet not found: 98baf6e8d8e84b42a83054495ae19e01
I20251025 08:02:35.344029 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "52765e926e904ec9b052db3135cfb77a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.337652 17731 consensus_queue.cc:1048] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:35.348611 16390 tablet_bootstrap.cc:492] T d6cbe1616ced4f47999a6a1365af0092 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:35.349253 16390 ts_tablet_manager.cc:1403] T d6cbe1616ced4f47999a6a1365af0092 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.070s user 0.000s sys 0.002s
I20251025 08:02:35.349303 17258 ts_tablet_manager.cc:1916] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.349594 16390 raft_consensus.cc:359] T d6cbe1616ced4f47999a6a1365af0092 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.349669 16390 raft_consensus.cc:385] T d6cbe1616ced4f47999a6a1365af0092 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.349694 16390 raft_consensus.cc:740] T d6cbe1616ced4f47999a6a1365af0092 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.349783 16390 consensus_queue.cc:260] T d6cbe1616ced4f47999a6a1365af0092 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.350026 16390 ts_tablet_manager.cc:1434] T d6cbe1616ced4f47999a6a1365af0092 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
W20251025 08:02:35.350379 15049 leader_election.cc:343] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.350168 16390 tablet_bootstrap.cc:492] T 0f141107d4674690acd51e499bc4e208 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:35.351989 16390 tablet_bootstrap.cc:654] T 0f141107d4674690acd51e499bc4e208 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
W20251025 08:02:35.352815 14914 consensus_peers.cc:597] T 0f141107d4674690acd51e499bc4e208 P ab02c9d78a9d42f193755d436c8d44b2 -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:35.341471 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet 54ac551e1e9a4bb1970be52edd04c0d3 with delete_type TABLET_DATA_DELETED (replaced by tablet 8d852805cb7a4c099337cbbaf1e18a2d) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:35.344234 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "52765e926e904ec9b052db3135cfb77a" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
W20251025 08:02:35.353171 15048 leader_election.cc:343] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.353224 15048 leader_election.cc:304] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:35.353325 17536 raft_consensus.cc:2749] T 52765e926e904ec9b052db3135cfb77a P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:35.353904 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet 62b2769c6ffc48f980ce7ed2bfa1dd75 (table default.Table_0a6ff7ae05a040c3be53115abe29f5ce [id=fb111be93abf42e9b40d60ddcf64190f]) successfully deleted
W20251025 08:02:35.354310 16270 catalog_manager.cc:4965] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 54ac551e1e9a4bb1970be52edd04c0d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54ac551e1e9a4bb1970be52edd04c0d3 already in progress: creating tablet
I20251025 08:02:35.354609 17198 ts_tablet_manager.cc:1929] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:35.350931 17258 ts_tablet_manager.cc:1929] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:35.354790 17258 log.cc:1199] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-2/wal/wals/b826067888164df0af7da797d42c0862
I20251025 08:02:35.355053 17258 ts_tablet_manager.cc:1950] T b826067888164df0af7da797d42c0862 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Deleting consensus metadata
W20251025 08:02:35.355062 15048 consensus_peers.cc:597] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e -> Peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Couldn't send request to peer ab02c9d78a9d42f193755d436c8d44b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95c9778bd0d94542bec79e9d36c6ce46. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:35.355778 17198 log.cc:1199] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/1ddb3795876b486e992b58cea711afb3
I20251025 08:02:35.356084 17198 ts_tablet_manager.cc:1950] T 1ddb3795876b486e992b58cea711afb3 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.356624 16271 catalog_manager.cc:4985] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): tablet b826067888164df0af7da797d42c0862 (table default.Table_c6f81392e62f401fa4a3ebe3de2eacbb [id=7eda6d3807c042d3a7aecf63ebd73fae]) successfully deleted
I20251025 08:02:35.356688 17198 tablet_replica.cc:333] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.356789 17198 raft_consensus.cc:2243] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.356889 17198 raft_consensus.cc:2272] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.357336 17198 ts_tablet_manager.cc:1916] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20251025 08:02:35.356765 16271 catalog_manager.cc:4965] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): delete failed for tablet 54ac551e1e9a4bb1970be52edd04c0d3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 54ac551e1e9a4bb1970be52edd04c0d3 already in progress: creating tablet
I20251025 08:02:35.358484 16391 tablet_bootstrap.cc:492] T 6b16e4b9ef4c41db83ab3bf55149719b P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:35.358556 16391 ts_tablet_manager.cc:1403] T 6b16e4b9ef4c41db83ab3bf55149719b P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.089s user 0.002s sys 0.000s
I20251025 08:02:35.358918 16391 raft_consensus.cc:359] T 6b16e4b9ef4c41db83ab3bf55149719b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.359001 16391 raft_consensus.cc:385] T 6b16e4b9ef4c41db83ab3bf55149719b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.359016 17198 ts_tablet_manager.cc:1929] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20251025 08:02:35.359030 16391 raft_consensus.cc:740] T 6b16e4b9ef4c41db83ab3bf55149719b P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.359073 17198 log.cc:1199] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/cb2a4db00068482fb8d3b5313017e035
I20251025 08:02:35.359130 16391 consensus_queue.cc:260] T 6b16e4b9ef4c41db83ab3bf55149719b P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.359295 17198 ts_tablet_manager.cc:1950] T cb2a4db00068482fb8d3b5313017e035 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.359422 16391 ts_tablet_manager.cc:1434] T 6b16e4b9ef4c41db83ab3bf55149719b P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.359575 16391 tablet_bootstrap.cc:492] T 63085b146f03434b912d639b430a2cfe P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:35.360205 16391 tablet_bootstrap.cc:654] T 63085b146f03434b912d639b430a2cfe P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.360925 16391 tablet_bootstrap.cc:492] T 63085b146f03434b912d639b430a2cfe P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:35.361009 16391 ts_tablet_manager.cc:1403] T 63085b146f03434b912d639b430a2cfe P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.361361 16391 raft_consensus.cc:359] T 63085b146f03434b912d639b430a2cfe P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.361444 16391 raft_consensus.cc:385] T 63085b146f03434b912d639b430a2cfe P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.361474 16391 raft_consensus.cc:740] T 63085b146f03434b912d639b430a2cfe P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.361698 16391 consensus_queue.cc:260] T 63085b146f03434b912d639b430a2cfe P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.361804 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 1ddb3795876b486e992b58cea711afb3 (table default.Table_08013ca351ee49df9acad855462d7507 [id=8c00f3d93fc548109fc6a1893937d55b]) successfully deleted
I20251025 08:02:35.361971 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet cb2a4db00068482fb8d3b5313017e035 (table default.Table_24a3fc5c42d441fab7d881fb258a0ddb [id=866f01db50274ea29407f759600aff90]) successfully deleted
I20251025 08:02:35.362128 16391 ts_tablet_manager.cc:1434] T 63085b146f03434b912d639b430a2cfe P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.362402 16391 tablet_bootstrap.cc:492] T b1fc8a8cfb73420f81f5b73839d3d3cb P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:35.362711 16390 tablet_bootstrap.cc:492] T 0f141107d4674690acd51e499bc4e208 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:35.362782 16390 ts_tablet_manager.cc:1403] T 0f141107d4674690acd51e499bc4e208 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.002s
I20251025 08:02:35.363178 16391 tablet_bootstrap.cc:654] T b1fc8a8cfb73420f81f5b73839d3d3cb P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.363171 16390 raft_consensus.cc:359] T 0f141107d4674690acd51e499bc4e208 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.363260 16390 raft_consensus.cc:385] T 0f141107d4674690acd51e499bc4e208 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.363291 16390 raft_consensus.cc:740] T 0f141107d4674690acd51e499bc4e208 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.363410 16390 consensus_queue.cc:260] T 0f141107d4674690acd51e499bc4e208 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.363636 16390 ts_tablet_manager.cc:1434] T 0f141107d4674690acd51e499bc4e208 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:35.363777 16390 tablet_bootstrap.cc:492] T cb2a4db00068482fb8d3b5313017e035 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:35.364416 16391 tablet_bootstrap.cc:492] T b1fc8a8cfb73420f81f5b73839d3d3cb P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:35.364475 16391 ts_tablet_manager.cc:1403] T b1fc8a8cfb73420f81f5b73839d3d3cb P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20251025 08:02:35.364768 16390 tablet_bootstrap.cc:654] T cb2a4db00068482fb8d3b5313017e035 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.364847 16391 raft_consensus.cc:359] T b1fc8a8cfb73420f81f5b73839d3d3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.364931 16391 raft_consensus.cc:385] T b1fc8a8cfb73420f81f5b73839d3d3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.364989 16391 raft_consensus.cc:740] T b1fc8a8cfb73420f81f5b73839d3d3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.365087 16391 consensus_queue.cc:260] T b1fc8a8cfb73420f81f5b73839d3d3cb P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.365345 16391 ts_tablet_manager.cc:1434] T b1fc8a8cfb73420f81f5b73839d3d3cb P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.365486 16391 tablet_bootstrap.cc:492] T b316ba50a48446338d49435a8e809ff4 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:35.365787 17198 tablet_replica.cc:333] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.365921 17198 raft_consensus.cc:2243] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.366010 17198 raft_consensus.cc:2272] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.366355 16391 tablet_bootstrap.cc:654] T b316ba50a48446338d49435a8e809ff4 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.366343 17198 ts_tablet_manager.cc:1916] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.367208 17415 raft_consensus.cc:493] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.367276 17415 raft_consensus.cc:515] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.367556 17415 leader_election.cc:290] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
W20251025 08:02:35.367915 16272 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5fd09e6a6b3a4f8aa65d6be9e46d02ff already in progress: creating tablet
I20251025 08:02:35.368053 17198 ts_tablet_manager.cc:1929] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20251025 08:02:35.368076 16272 catalog_manager.cc:4965] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 1820be622ead4fd88437c79d95b34caf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1820be622ead4fd88437c79d95b34caf already in progress: creating tablet
I20251025 08:02:35.368111 17198 log.cc:1199] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/5564705a3771425da1f33830e7b51e03
I20251025 08:02:35.368373 17198 ts_tablet_manager.cc:1950] T 5564705a3771425da1f33830e7b51e03 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.368799 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6243825ae7b4307b5789aaee2473edc" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.368904 15239 raft_consensus.cc:2468] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:35.369089 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6243825ae7b4307b5789aaee2473edc" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:35.369180 15107 raft_consensus.cc:2468] T d6243825ae7b4307b5789aaee2473edc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:35.369277 14914 leader_election.cc:304] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.369774 17415 raft_consensus.cc:2804] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.369832 17415 raft_consensus.cc:493] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.369867 17415 raft_consensus.cc:3060] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.370750 17415 raft_consensus.cc:515] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.371044 17415 leader_election.cc:290] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.371328 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6243825ae7b4307b5789aaee2473edc" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:35.371419 15107 raft_consensus.cc:3060] T d6243825ae7b4307b5789aaee2473edc P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.372367 15107 raft_consensus.cc:2468] T d6243825ae7b4307b5789aaee2473edc P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:35.372385 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 5564705a3771425da1f33830e7b51e03 (table default.Table_f5a86fbd3f5440aca8ae7f7f495a983a [id=ec9b64d93dfc44a29aae35e6b02e2fe8]) successfully deleted
I20251025 08:02:35.372473 16391 tablet_bootstrap.cc:492] T b316ba50a48446338d49435a8e809ff4 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:35.372539 16391 ts_tablet_manager.cc:1403] T b316ba50a48446338d49435a8e809ff4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20251025 08:02:35.372601 14915 leader_election.cc:304] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:35.372726 17731 raft_consensus.cc:2804] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.372781 17731 raft_consensus.cc:697] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:35.372809 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6243825ae7b4307b5789aaee2473edc" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:35.372892 15239 raft_consensus.cc:3060] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.372885 17731 consensus_queue.cc:237] T d6243825ae7b4307b5789aaee2473edc P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.372987 16391 raft_consensus.cc:359] T b316ba50a48446338d49435a8e809ff4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.373072 16391 raft_consensus.cc:385] T b316ba50a48446338d49435a8e809ff4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.373099 16391 raft_consensus.cc:740] T b316ba50a48446338d49435a8e809ff4 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.373181 16391 consensus_queue.cc:260] T b316ba50a48446338d49435a8e809ff4 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.373379 16391 ts_tablet_manager.cc:1434] T b316ba50a48446338d49435a8e809ff4 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:35.373510 16391 tablet_bootstrap.cc:492] T b826067888164df0af7da797d42c0862 P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:35.373806 15239 raft_consensus.cc:2468] T d6243825ae7b4307b5789aaee2473edc P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:35.374466 16391 tablet_bootstrap.cc:654] T b826067888164df0af7da797d42c0862 P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.374658 17198 tablet_replica.cc:333] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.374778 17198 raft_consensus.cc:2243] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.374857 17198 raft_consensus.cc:2272] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.375149 17198 ts_tablet_manager.cc:1916] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.375592 17730 raft_consensus.cc:493] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.375689 17730 raft_consensus.cc:515] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.376032 17730 leader_election.cc:290] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.376536 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0de3ec67dcc4e41a447338869076314" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.376633 15239 raft_consensus.cc:2468] T d0de3ec67dcc4e41a447338869076314 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:35.376780 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0de3ec67dcc4e41a447338869076314" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:35.376866 15107 raft_consensus.cc:2468] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:35.377172 14914 leader_election.cc:304] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.377264 17198 ts_tablet_manager.cc:1929] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:35.377319 17198 log.cc:1199] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/4bb463fc8b104a87b5503bfc2467a23e
I20251025 08:02:35.377486 17730 raft_consensus.cc:2804] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.377538 17730 raft_consensus.cc:493] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.377565 17198 ts_tablet_manager.cc:1950] T 4bb463fc8b104a87b5503bfc2467a23e P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.377579 17730 raft_consensus.cc:3060] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.378063 17198 tablet_replica.cc:333] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e: stopping tablet replica
I20251025 08:02:35.378162 17198 raft_consensus.cc:2243] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus shutting down.
I20251025 08:02:35.378281 17198 raft_consensus.cc:2272] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.378671 17198 ts_tablet_manager.cc:1916] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.378959 17730 raft_consensus.cc:515] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.379328 17730 leader_election.cc:290] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.379710 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0de3ec67dcc4e41a447338869076314" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:35.379813 15239 raft_consensus.cc:3060] T d0de3ec67dcc4e41a447338869076314 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.380514 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d0de3ec67dcc4e41a447338869076314" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:35.380604 15107 raft_consensus.cc:3060] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.380692 15239 raft_consensus.cc:2468] T d0de3ec67dcc4e41a447338869076314 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:35.381405 15107 raft_consensus.cc:2468] T d0de3ec67dcc4e41a447338869076314 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:35.382040 14914 leader_election.cc:304] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.382354 17198 ts_tablet_manager.cc:1929] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:35.382880 17730 raft_consensus.cc:2804] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.382978 17730 raft_consensus.cc:697] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:35.383104 17730 consensus_queue.cc:237] T d0de3ec67dcc4e41a447338869076314 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.384136 17198 log.cc:1199] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-1/wal/wals/bf34039d909949af9357299bf8204891
I20251025 08:02:35.383849 17274 tablet_bootstrap.cc:492] T 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99 P e51a2be794f04642b89386067ecbc77e: No bootstrap required, opened a new log
I20251025 08:02:35.384415 17274 ts_tablet_manager.cc:1403] T 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99 P e51a2be794f04642b89386067ecbc77e: Time spent bootstrapping tablet: real 0.039s user 0.001s sys 0.001s
I20251025 08:02:35.385174 16272 catalog_manager.cc:4985] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): tablet 4bb463fc8b104a87b5503bfc2467a23e (table default.Table_5fe5289f69bd4a458aced0607d8247fa [id=cfa501bfaffb4d95893a0cd10caedcb4]) successfully deleted
I20251025 08:02:35.385174 17274 raft_consensus.cc:359] T 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.385270 17274 raft_consensus.cc:385] T 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.385319 17274 raft_consensus.cc:740] T 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Initialized, Role: FOLLOWER
W20251025 08:02:35.385345 16272 catalog_manager.cc:4952] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455): delete failed for tablet 2f64072c416f4a77b1c81855d7db8f01 because the tablet was not found. No further retry: Not found: Tablet not found: 2f64072c416f4a77b1c81855d7db8f01
I20251025 08:02:35.385655 17274 consensus_queue.cc:260] T 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99 P e51a2be794f04642b89386067ecbc77e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.386076 17274 ts_tablet_manager.cc:1434] T 1bdc6b5ec4ce4dd19e9cb8d8f5c7df99 P e51a2be794f04642b89386067ecbc77e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20251025 08:02:35.386150 16391 tablet_bootstrap.cc:492] T b826067888164df0af7da797d42c0862 P ab02c9d78a9d42f193755d436c8d44b2: No bootstrap required, opened a new log
I20251025 08:02:35.386245 16391 ts_tablet_manager.cc:1403] T b826067888164df0af7da797d42c0862 P ab02c9d78a9d42f193755d436c8d44b2: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.001s
I20251025 08:02:35.386395 17274 tablet_bootstrap.cc:492] T 5522e9c5bf904c63bc4b00a226a0cc45 P e51a2be794f04642b89386067ecbc77e: Bootstrap starting.
I20251025 08:02:35.386670 16391 raft_consensus.cc:359] T b826067888164df0af7da797d42c0862 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.386766 16391 raft_consensus.cc:385] T b826067888164df0af7da797d42c0862 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.386803 16391 raft_consensus.cc:740] T b826067888164df0af7da797d42c0862 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.386915 16391 consensus_queue.cc:260] T b826067888164df0af7da797d42c0862 P ab02c9d78a9d42f193755d436c8d44b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.387172 16391 ts_tablet_manager.cc:1434] T b826067888164df0af7da797d42c0862 P ab02c9d78a9d42f193755d436c8d44b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20251025 08:02:35.387369 16391 tablet_bootstrap.cc:492] T edfb86283bda491993a456e365f8760f P ab02c9d78a9d42f193755d436c8d44b2: Bootstrap starting.
I20251025 08:02:35.387899 17274 tablet_bootstrap.cc:654] T 5522e9c5bf904c63bc4b00a226a0cc45 P e51a2be794f04642b89386067ecbc77e: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.388293 16391 tablet_bootstrap.cc:654] T edfb86283bda491993a456e365f8760f P ab02c9d78a9d42f193755d436c8d44b2: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.388796 17198 ts_tablet_manager.cc:1950] T bf34039d909949af9357299bf8204891 P e51a2be794f04642b89386067ecbc77e: Deleting consensus metadata
I20251025 08:02:35.389154 17536 raft_consensus.cc:493] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.389763 17536 raft_consensus.cc:515] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.390072 17536 leader_election.cc:290] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.390326 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1fc8a8cfb73420f81f5b73839d3d3cb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:35.390417 14979 raft_consensus.cc:2468] T b1fc8a8cfb73420f81f5b73839d3d3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:35.390547 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1fc8a8cfb73420f81f5b73839d3d3cb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.390635 15239 raft_consensus.cc:2468] T b1fc8a8cfb73420f81f5b73839d3d3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:35.390650 15048 leader_election.cc:304] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:35.391247 17537 raft_consensus.cc:2804] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.391296 17537 raft_consensus.cc:493] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.391345 17537 raft_consensus.cc:3060] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.392203 17537 raft_consensus.cc:515] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.392454 17537 leader_election.cc:290] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.392681 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1fc8a8cfb73420f81f5b73839d3d3cb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:35.392767 14979 raft_consensus.cc:3060] T b1fc8a8cfb73420f81f5b73839d3d3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.393676 14979 raft_consensus.cc:2468] T b1fc8a8cfb73420f81f5b73839d3d3cb P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:35.393921 15048 leader_election.cc:304] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:35.394460 17536 raft_consensus.cc:2804] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.394538 17536 raft_consensus.cc:697] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:35.394647 17536 consensus_queue.cc:237] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:35.395535 15049 consensus_peers.cc:597] T 95c9778bd0d94542bec79e9d36c6ce46 P e51a2be794f04642b89386067ecbc77e -> Peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Couldn't send request to peer f0f2f8ce3e9f4d9ba3f3f02813397c31. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 95c9778bd0d94542bec79e9d36c6ce46. This is attempt 1: this message will repeat every 5th retry.
I20251025 08:02:35.396180 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "b1fc8a8cfb73420f81f5b73839d3d3cb" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:35.396270 15239 raft_consensus.cc:3060] T b1fc8a8cfb73420f81f5b73839d3d3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.396986 15239 raft_consensus.cc:2468] T b1fc8a8cfb73420f81f5b73839d3d3cb P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:35.397738 16390 tablet_bootstrap.cc:492] T cb2a4db00068482fb8d3b5313017e035 P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:35.397805 16390 ts_tablet_manager.cc:1403] T cb2a4db00068482fb8d3b5313017e035 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.034s user 0.000s sys 0.002s
I20251025 08:02:35.398286 16390 raft_consensus.cc:359] T cb2a4db00068482fb8d3b5313017e035 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.398368 16390 raft_consensus.cc:385] T cb2a4db00068482fb8d3b5313017e035 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.398396 16390 raft_consensus.cc:740] T cb2a4db00068482fb8d3b5313017e035 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.398496 16390 consensus_queue.cc:260] T cb2a4db00068482fb8d3b5313017e035 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.398751 16390 ts_tablet_manager.cc:1434] T cb2a4db00068482fb8d3b5313017e035 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20251025 08:02:35.398936 16390 tablet_bootstrap.cc:492] T 6b16e4b9ef4c41db83ab3bf55149719b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:35.399833 16390 tablet_bootstrap.cc:654] T 6b16e4b9ef4c41db83ab3bf55149719b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Neither blocks nor log segments found. Creating new log.
I20251025 08:02:35.411128 17537 raft_consensus.cc:493] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.411228 17537 raft_consensus.cc:515] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.411522 17537 leader_election.cc:290] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.411830 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1c15457dfac48e3a33de5a9c3d6f1f1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:35.411919 14979 raft_consensus.cc:2468] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 0.
I20251025 08:02:35.412138 15048 leader_election.cc:304] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:35.412457 17537 raft_consensus.cc:2804] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.412506 17537 raft_consensus.cc:493] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.412539 17537 raft_consensus.cc:3060] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.413316 17537 raft_consensus.cc:515] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.413586 17537 leader_election.cc:290] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.414320 14979 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1c15457dfac48e3a33de5a9c3d6f1f1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:35.414400 14979 raft_consensus.cc:3060] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.415134 14979 raft_consensus.cc:2468] T f1c15457dfac48e3a33de5a9c3d6f1f1 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e51a2be794f04642b89386067ecbc77e in term 1.
I20251025 08:02:35.415380 15048 leader_election.cc:304] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, e51a2be794f04642b89386067ecbc77e; no voters:
I20251025 08:02:35.415719 15642 raft_consensus.cc:2804] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.415788 15642 raft_consensus.cc:697] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [term 1 LEADER]: Becoming Leader. State: Replica: e51a2be794f04642b89386067ecbc77e, State: Running, Role: LEADER
I20251025 08:02:35.415791 16285 catalog_manager.cc:5649] T 63085b146f03434b912d639b430a2cfe P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:35.415886 15642 consensus_queue.cc:237] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.416054 16285 catalog_manager.cc:5741] TS f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447) does not have the latest schema for tablet d049bf946c744664aba74d7a12fa4ff1 (table default.Table_36b5cc8d55f84063a624820d55f1aac8 [id=33bbe4605d924011b9002a939a73203d]). Expected version 1 got 0
I20251025 08:02:35.416164 16285 catalog_manager.cc:5649] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:35.416473 16285 catalog_manager.cc:5649] T aae693881f9d40c789d242c6de5d9905 P f0f2f8ce3e9f4d9ba3f3f02813397c31 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3). New cstate: current_term: 1 leader_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: HEALTHY } } }
I20251025 08:02:35.416872 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 5aa88774f95443d08c6d786906c4fccb (DEFAULT_TABLE table=default.Table_e19a180657274070bdf8803988d6910e [id=ac6937db15c440a58df23fe16985d569]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.417104 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa88774f95443d08c6d786906c4fccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.417277 16279 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_08827051f1554df4942ebfe68c81a8be [id=b228e3c8480f475ca877713e168bcba8] alter complete (version 2)
I20251025 08:02:35.417634 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 5aa88774f95443d08c6d786906c4fccb (DEFAULT_TABLE table=default.Table_e19a180657274070bdf8803988d6910e [id=ac6937db15c440a58df23fe16985d569]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.417836 15081 tablet_service.cc:1505] Processing CreateTablet for tablet 7f37383620b249ee92328a06a534abb7 (DEFAULT_TABLE table=default.Table_7a4a283a62d44234a76534b8384c227d [id=6ee30f9b6a5046fab94ef9ad57986b37]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.418045 15092 tablet_service.cc:1505] Processing CreateTablet for tablet b8c4bfe543a340f49b25b2cf3200d487 (DEFAULT_TABLE table=default.Table_cd4d0d317d9545dea2ccad733022d6b2 [id=8c6a93b355b3486d9df03422685e9e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.418375 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 7f37383620b249ee92328a06a534abb7 (DEFAULT_TABLE table=default.Table_7a4a283a62d44234a76534b8384c227d [id=6ee30f9b6a5046fab94ef9ad57986b37]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.418566 15223 tablet_service.cc:1505] Processing CreateTablet for tablet e29e121a40df4c66842f78dbfd065c22 (DEFAULT_TABLE table=default.Table_b92940c2c118443988ab5c891fe2cd4b [id=cfe6f51cd0094e18a231c8af2799c0a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.418972 15217 tablet_service.cc:1505] Processing CreateTablet for tablet 295351e205d54c83ac7eff183b50dd9a (DEFAULT_TABLE table=default.Table_49a963b6e7b345b4ad3594a7648e6c10 [id=1b098f1153c34833a086282ffe1df079]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.419154 15089 tablet_service.cc:1505] Processing CreateTablet for tablet e29e121a40df4c66842f78dbfd065c22 (DEFAULT_TABLE table=default.Table_b92940c2c118443988ab5c891fe2cd4b [id=cfe6f51cd0094e18a231c8af2799c0a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.419196 15218 tablet_service.cc:1505] Processing CreateTablet for tablet b8c4bfe543a340f49b25b2cf3200d487 (DEFAULT_TABLE table=default.Table_cd4d0d317d9545dea2ccad733022d6b2 [id=8c6a93b355b3486d9df03422685e9e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.419678 14940 tablet_service.cc:1505] Processing CreateTablet for tablet 5aa88774f95443d08c6d786906c4fccb (DEFAULT_TABLE table=default.Table_e19a180657274070bdf8803988d6910e [id=ac6937db15c440a58df23fe16985d569]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.419842 15075 tablet_service.cc:1505] Processing CreateTablet for tablet 295351e205d54c83ac7eff183b50dd9a (DEFAULT_TABLE table=default.Table_49a963b6e7b345b4ad3594a7648e6c10 [id=1b098f1153c34833a086282ffe1df079]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.419909 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa88774f95443d08c6d786906c4fccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.420122 15239 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1c15457dfac48e3a33de5a9c3d6f1f1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.420749 17369 raft_consensus.cc:493] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.420845 17369 raft_consensus.cc:515] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.421134 17369 leader_election.cc:290] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:35.421192 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 177c06adaabe40f5a663f6c143a8d3d3 (DEFAULT_TABLE table=default.Table_4294a48c420d4c71b071172eed9f1145 [id=c8d28c1bfbe84d588c251cffbd8960b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.421948 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 7f37383620b249ee92328a06a534abb7 (DEFAULT_TABLE table=default.Table_7a4a283a62d44234a76534b8384c227d [id=6ee30f9b6a5046fab94ef9ad57986b37]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.422119 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f37383620b249ee92328a06a534abb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.423889 14958 tablet_service.cc:1505] Processing CreateTablet for tablet b8c4bfe543a340f49b25b2cf3200d487 (DEFAULT_TABLE table=default.Table_cd4d0d317d9545dea2ccad733022d6b2 [id=8c6a93b355b3486d9df03422685e9e15]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.424067 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c4bfe543a340f49b25b2cf3200d487. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:35.424615 15049 leader_election.cc:343] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.424804 15215 tablet_service.cc:1505] Processing CreateTablet for tablet 177c06adaabe40f5a663f6c143a8d3d3 (DEFAULT_TABLE table=default.Table_4294a48c420d4c71b071172eed9f1145 [id=c8d28c1bfbe84d588c251cffbd8960b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.425976 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "f1c15457dfac48e3a33de5a9c3d6f1f1" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:35.426136 14971 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dc32b27b3f743bf8719e39ea8c20e34" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:35.426265 14971 raft_consensus.cc:2468] T 5dc32b27b3f743bf8719e39ea8c20e34 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
W20251025 08:02:35.426471 15049 leader_election.cc:343] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.428872 16390 tablet_bootstrap.cc:492] T 6b16e4b9ef4c41db83ab3bf55149719b P f0f2f8ce3e9f4d9ba3f3f02813397c31: No bootstrap required, opened a new log
I20251025 08:02:35.428936 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aa88774f95443d08c6d786906c4fccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.429005 16390 ts_tablet_manager.cc:1403] T 6b16e4b9ef4c41db83ab3bf55149719b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.000s
I20251025 08:02:35.430596 16390 raft_consensus.cc:359] T 6b16e4b9ef4c41db83ab3bf55149719b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.430835 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c4bfe543a340f49b25b2cf3200d487. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.432235 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dc32b27b3f743bf8719e39ea8c20e34" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:35.432337 15109 raft_consensus.cc:2468] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 0.
I20251025 08:02:35.432586 15081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f37383620b249ee92328a06a534abb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.433734 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 295351e205d54c83ac7eff183b50dd9a (DEFAULT_TABLE table=default.Table_49a963b6e7b345b4ad3594a7648e6c10 [id=1b098f1153c34833a086282ffe1df079]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.433851 14947 tablet_service.cc:1552] Processing DeleteTablet for tablet cb2a4db00068482fb8d3b5313017e035 with delete_type TABLET_DATA_DELETED (replaced by tablet 81efa2a0e62e4e50b6f2a86d000c194d) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:35.433933 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295351e205d54c83ac7eff183b50dd9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.434098 14946 tablet_service.cc:1505] Processing CreateTablet for tablet 177c06adaabe40f5a663f6c143a8d3d3 (DEFAULT_TABLE table=default.Table_4294a48c420d4c71b071172eed9f1145 [id=c8d28c1bfbe84d588c251cffbd8960b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.434288 17194 tablet_replica.cc:333] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2: stopping tablet replica
I20251025 08:02:35.434345 14946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 177c06adaabe40f5a663f6c143a8d3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.434412 17194 raft_consensus.cc:2243] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Raft consensus shutting down.
I20251025 08:02:35.434545 17194 pending_rounds.cc:70] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2: Trying to abort 1 pending ops.
I20251025 08:02:35.434572 17194 pending_rounds.cc:77] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7214609838721224704 op_type: NO_OP noop_request { }
I20251025 08:02:35.434616 17194 raft_consensus.cc:2889] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20251025 08:02:35.434662 17194 raft_consensus.cc:2272] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20251025 08:02:35.436223 17194 ts_tablet_manager.cc:1916] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20251025 08:02:35.435138 15185 leader_election.cc:304] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e51a2be794f04642b89386067ecbc77e, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.436693 17316 raft_consensus.cc:2804] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.436744 17316 raft_consensus.cc:493] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.436782 17316 raft_consensus.cc:3060] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.437134 16390 raft_consensus.cc:385] T 6b16e4b9ef4c41db83ab3bf55149719b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20251025 08:02:35.437201 16390 raft_consensus.cc:740] T 6b16e4b9ef4c41db83ab3bf55149719b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Initialized, Role: FOLLOWER
I20251025 08:02:35.437413 16390 consensus_queue.cc:260] T 6b16e4b9ef4c41db83ab3bf55149719b P f0f2f8ce3e9f4d9ba3f3f02813397c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.437739 17316 raft_consensus.cc:515] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.438338 17194 ts_tablet_manager.cc:1929] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20251025 08:02:35.438397 17194 log.cc:1199] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2: Deleting WAL directory at /tmp/dist-test-taskbKFzMV/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1761379341361511-14616-0/minicluster-data/ts-0/wal/wals/cb2a4db00068482fb8d3b5313017e035
I20251025 08:02:35.438408 14971 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dc32b27b3f743bf8719e39ea8c20e34" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2"
I20251025 08:02:35.438520 14971 raft_consensus.cc:3060] T 5dc32b27b3f743bf8719e39ea8c20e34 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.438691 17194 ts_tablet_manager.cc:1950] T cb2a4db00068482fb8d3b5313017e035 P ab02c9d78a9d42f193755d436c8d44b2: Deleting consensus metadata
I20251025 08:02:35.437954 16390 ts_tablet_manager.cc:1434] T 6b16e4b9ef4c41db83ab3bf55149719b P f0f2f8ce3e9f4d9ba3f3f02813397c31: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s
I20251025 08:02:35.439035 16390 tablet_bootstrap.cc:492] T 76c31d4c83c740dab40bebd6c8d3f161 P f0f2f8ce3e9f4d9ba3f3f02813397c31: Bootstrap starting.
I20251025 08:02:35.418581 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f37383620b249ee92328a06a534abb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.439570 14971 raft_consensus.cc:2468] T 5dc32b27b3f743bf8719e39ea8c20e34 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:35.439677 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8c4bfe543a340f49b25b2cf3200d487. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.435534 15213 tablet_service.cc:1505] Processing CreateTablet for tablet 6bfed0e462ee4fa6be696d1909ae5b55 (DEFAULT_TABLE table=default.Table_e74e29b85e094351a03724c06d61c612 [id=04407b4ef5ef49e69c548b18b5f59081]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.439817 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 177c06adaabe40f5a663f6c143a8d3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.439837 15217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295351e205d54c83ac7eff183b50dd9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.440029 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 177c06adaabe40f5a663f6c143a8d3d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.440099 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "5dc32b27b3f743bf8719e39ea8c20e34" candidate_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:35.440207 15107 raft_consensus.cc:3060] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.440265 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29e121a40df4c66842f78dbfd065c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.441062 15107 raft_consensus.cc:2468] T 5dc32b27b3f743bf8719e39ea8c20e34 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f2f8ce3e9f4d9ba3f3f02813397c31 in term 1.
I20251025 08:02:35.441274 15213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfed0e462ee4fa6be696d1909ae5b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.441826 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29e121a40df4c66842f78dbfd065c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.441869 15183 leader_election.cc:304] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.442065 17372 raft_consensus.cc:2804] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.442132 17372 raft_consensus.cc:697] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 LEADER]: Becoming Leader. State: Replica: f0f2f8ce3e9f4d9ba3f3f02813397c31, State: Running, Role: LEADER
I20251025 08:02:35.442250 17372 consensus_queue.cc:237] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.443840 15075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295351e205d54c83ac7eff183b50dd9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.445006 16281 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_ce11251d6b4243ac8902b50912f11fc3" } modify_external_catalogs: true
I20251025 08:02:35.445109 16281 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_ce11251d6b4243ac8902b50912f11fc3" } modify_external_catalogs: true
I20251025 08:02:35.445636 16284 catalog_manager.cc:6194] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: default.Table_5f2746d8cc7341d9a30870387f129fa2 [id=846c344408284b8e8a0e5da1d328255d] alter complete (version 1)
W20251025 08:02:35.446404 16284 catalog_manager.cc:5841] Failed to send AlterTable RPC for tablet d20a130fc8ea40ddba509d2825ac028d (table default.Table_b1e1deafd90b45ec8e77ad538bb9b20b [id=40bbd91ee80d45cebf7aa038f726f799], current schema version=1): Not found: failed to reset TS proxy: No leader found: Tablet d20a130fc8ea40ddba509d2825ac028d consensus state has no leader
I20251025 08:02:35.448292 15217 tablet_service.cc:1505] Processing CreateTablet for tablet f3ee8840e4d947c093c6fecff7472c75 (DEFAULT_TABLE table=default.Table_4030e2a15f3544569f37151166b5f237 [id=87d853c16b3e46d0b314c592ec26d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.438050 17316 leader_election.cc:290] T 5dc32b27b3f743bf8719e39ea8c20e34 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [CANDIDATE]: Term 1 election: Requested vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455)
I20251025 08:02:35.448515 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 59f4174b579e4b3381a09daa5c9cb902 (DEFAULT_TABLE table=default.Table_951e3633f70643de8a63e9408b868fe9 [id=07414175bc6b402092624ab8bc17e82b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.448658 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 48ca5443d1d34484952c74c679e40ea3 (DEFAULT_TABLE table=default.Table_99a55c635acb4fcb8bc04dda7e713648 [id=db62128752c045159b1295de6d521a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.448734 14957 tablet_service.cc:1505] Processing CreateTablet for tablet 48ca5443d1d34484952c74c679e40ea3 (DEFAULT_TABLE table=default.Table_99a55c635acb4fcb8bc04dda7e713648 [id=db62128752c045159b1295de6d521a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.448819 15220 tablet_service.cc:1505] Processing CreateTablet for tablet 2fac27ca46234498b597719ee9616a29 (DEFAULT_TABLE table=default.Table_91cef80713834b28acb457e1592574da [id=20a8ffc005934d398c6c0905afe909ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.448920 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ca5443d1d34484952c74c679e40ea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.448494 15217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ee8840e4d947c093c6fecff7472c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.449875 14947 tablet_service.cc:1505] Processing CreateTablet for tablet f3ee8840e4d947c093c6fecff7472c75 (DEFAULT_TABLE table=default.Table_4030e2a15f3544569f37151166b5f237 [id=87d853c16b3e46d0b314c592ec26d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.450093 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ee8840e4d947c093c6fecff7472c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.450713 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ca5443d1d34484952c74c679e40ea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.451484 16270 catalog_manager.cc:4985] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): tablet cb2a4db00068482fb8d3b5313017e035 (table default.Table_24a3fc5c42d441fab7d881fb258a0ddb [id=866f01db50274ea29407f759600aff90]) successfully deleted
I20251025 08:02:35.452015 15220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fac27ca46234498b597719ee9616a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.454124 16283 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_1d2927175bb04c65b7282eba42cf7791"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:35.454488 16283 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1d2927175bb04c65b7282eba42cf7791 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.455206 14949 tablet_service.cc:1505] Processing CreateTablet for tablet 2fac27ca46234498b597719ee9616a29 (DEFAULT_TABLE table=default.Table_91cef80713834b28acb457e1592574da [id=20a8ffc005934d398c6c0905afe909ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.455400 14949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fac27ca46234498b597719ee9616a29. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.458567 14946 tablet_service.cc:1505] Processing CreateTablet for tablet 59f4174b579e4b3381a09daa5c9cb902 (DEFAULT_TABLE table=default.Table_951e3633f70643de8a63e9408b868fe9 [id=07414175bc6b402092624ab8bc17e82b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.458767 14946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f4174b579e4b3381a09daa5c9cb902. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.461287 15085 tablet_service.cc:1505] Processing CreateTablet for tablet c21ffe55ab6b4734aa405db20848ec32 (DEFAULT_TABLE table=default.Table_1029c610ee7e4b2a93f661c8a47f4e97 [id=5517a56b797c4e3eafc83a6a0f9d5bb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.461624 15085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21ffe55ab6b4734aa405db20848ec32. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.462162 14958 tablet_service.cc:1505] Processing CreateTablet for tablet e29e121a40df4c66842f78dbfd065c22 (DEFAULT_TABLE table=default.Table_b92940c2c118443988ab5c891fe2cd4b [id=cfe6f51cd0094e18a231c8af2799c0a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.462374 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e29e121a40df4c66842f78dbfd065c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.463032 14947 tablet_service.cc:1505] Processing CreateTablet for tablet c21ffe55ab6b4734aa405db20848ec32 (DEFAULT_TABLE table=default.Table_1029c610ee7e4b2a93f661c8a47f4e97 [id=5517a56b797c4e3eafc83a6a0f9d5bb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.463230 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21ffe55ab6b4734aa405db20848ec32. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.464753 17369 consensus_queue.cc:1048] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:35.465571 15075 tablet_service.cc:1505] Processing CreateTablet for tablet 6bfed0e462ee4fa6be696d1909ae5b55 (DEFAULT_TABLE table=default.Table_e74e29b85e094351a03724c06d61c612 [id=04407b4ef5ef49e69c548b18b5f59081]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.465766 15075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfed0e462ee4fa6be696d1909ae5b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.465915 14956 tablet_service.cc:1552] Processing DeleteTablet for tablet 76c31d4c83c740dab40bebd6c8d3f161 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:34 UTC) from {username='slave'} at 127.0.0.1:41762
I20251025 08:02:35.466372 14944 tablet_service.cc:1505] Processing CreateTablet for tablet 6bfed0e462ee4fa6be696d1909ae5b55 (DEFAULT_TABLE table=default.Table_e74e29b85e094351a03724c06d61c612 [id=04407b4ef5ef49e69c548b18b5f59081]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.466410 15215 tablet_service.cc:1505] Processing CreateTablet for tablet c21ffe55ab6b4734aa405db20848ec32 (DEFAULT_TABLE table=default.Table_1029c610ee7e4b2a93f661c8a47f4e97 [id=5517a56b797c4e3eafc83a6a0f9d5bb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.466581 14944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bfed0e462ee4fa6be696d1909ae5b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.466631 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c21ffe55ab6b4734aa405db20848ec32. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.466862 15081 tablet_service.cc:1505] Processing CreateTablet for tablet f3ee8840e4d947c093c6fecff7472c75 (DEFAULT_TABLE table=default.Table_4030e2a15f3544569f37151166b5f237 [id=87d853c16b3e46d0b314c592ec26d3d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.467046 15081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ee8840e4d947c093c6fecff7472c75. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.468586 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f4174b579e4b3381a09daa5c9cb902. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.469097 15092 tablet_service.cc:1505] Processing CreateTablet for tablet 48ca5443d1d34484952c74c679e40ea3 (DEFAULT_TABLE table=default.Table_99a55c635acb4fcb8bc04dda7e713648 [id=db62128752c045159b1295de6d521a95]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.469305 15092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48ca5443d1d34484952c74c679e40ea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.471277 15094 tablet_service.cc:1552] Processing DeleteTablet for tablet cb2a4db00068482fb8d3b5313017e035 with delete_type TABLET_DATA_DELETED (replaced by tablet 81efa2a0e62e4e50b6f2a86d000c194d) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:35.471486 15089 tablet_service.cc:1505] Processing CreateTablet for tablet 59f4174b579e4b3381a09daa5c9cb902 (DEFAULT_TABLE table=default.Table_951e3633f70643de8a63e9408b868fe9 [id=07414175bc6b402092624ab8bc17e82b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.471673 15089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59f4174b579e4b3381a09daa5c9cb902. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.472381 14956 tablet_service.cc:1505] Processing CreateTablet for tablet 345404470a4c4c5c936e22cc998ad516 (DEFAULT_TABLE table=default.Table_232f967839b94b3195b2b9b849c36b55 [id=56510f4b7fa546e7b22c4a8f746e2231]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.472581 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 345404470a4c4c5c936e22cc998ad516. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.473560 15093 tablet_service.cc:1552] Processing DeleteTablet for tablet d05bf0056dfc43eeb4105af559497bdc with delete_type TABLET_DATA_DELETED (replaced by tablet 6e08efb3c79041ae97ae37e289ccc8f4) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:35.475370 17536 raft_consensus.cc:493] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.475437 17536 raft_consensus.cc:515] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.475688 17536 leader_election.cc:290] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.476600 15094 tablet_service.cc:1505] Processing CreateTablet for tablet 345404470a4c4c5c936e22cc998ad516 (DEFAULT_TABLE table=default.Table_232f967839b94b3195b2b9b849c36b55 [id=56510f4b7fa546e7b22c4a8f746e2231]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.476811 15094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 345404470a4c4c5c936e22cc998ad516. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.478658 14971 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dacca1fcbad4795835ec08c8bd0dc3c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab02c9d78a9d42f193755d436c8d44b2" is_pre_election: true
I20251025 08:02:35.478999 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_4f853cc600734a2ba7426c4087f864c7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:35.479167 15093 tablet_service.cc:1505] Processing CreateTablet for tablet 25ea9963acac4140ad7d878fc429c090 (DEFAULT_TABLE table=default.Table_f84103a22819458c976f0d1ca4716b47 [id=fe4920e7d4f143388063f22590eb2f64]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:35.479302 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4f853cc600734a2ba7426c4087f864c7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.479362 15093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ea9963acac4140ad7d878fc429c090. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.480741 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "1dacca1fcbad4795835ec08c8bd0dc3c" candidate_uuid: "e51a2be794f04642b89386067ecbc77e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.481360 16284 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_f4191d1423de42d9b489221fe1e2fb69" } new_table_name: "default.Table_c623d9972e8b483592728411bd7029aa" modify_external_catalogs: true
I20251025 08:02:35.482081 16279 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_88c8dfe8402449b2905e123b2003367e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20251025 08:02:35.482368 14940 tablet_service.cc:1552] Processing DeleteTablet for tablet f2bc1c43a4724406a9e2cc2c8cb72bec with delete_type TABLET_DATA_DELETED (replaced by tablet cfb02f4c7cfa423487226523fa38b984) from {username='slave'} at 127.0.0.1:41762
W20251025 08:02:35.482378 16279 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_88c8dfe8402449b2905e123b2003367e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.483186 14957 tablet_service.cc:1505] Processing CreateTablet for tablet e04051505b134c0489cbc73ce4dc3e2f (DEFAULT_TABLE table=default.Table_b87856fb91a2413b8d1687d56431ef16 [id=124068957d084b00b2e0c68c061f28a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.483376 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04051505b134c0489cbc73ce4dc3e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.484138 16287 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e42ecb552a87483ab36cd844e46d9f12" } modify_external_catalogs: true
I20251025 08:02:35.484225 16287 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e42ecb552a87483ab36cd844e46d9f12" } modify_external_catalogs: true
I20251025 08:02:35.486042 15217 tablet_service.cc:1505] Processing CreateTablet for tablet f334665c1bc3418fb68d23e28c5de309 (DEFAULT_TABLE table=default.Table_5d847a37cb0c456294cb5137046f80bb [id=1f6784494d0b4b98b46077a0af6c2ea8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.486263 15217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f334665c1bc3418fb68d23e28c5de309. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.486395 15227 tablet_service.cc:1505] Processing CreateTablet for tablet 581ae5b123654b78822566d97d312f6e (DEFAULT_TABLE table=default.Table_f4191d1423de42d9b489221fe1e2fb69 [id=adb49ac093344675a9db3e1e5b2a1e13]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.486420 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 6e08efb3c79041ae97ae37e289ccc8f4 (DEFAULT_TABLE table=default.Table_96c726b8fcd341f2895079b79f53cf7c [id=72243e33e90940c09953a9ec2fcfd435]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.486588 15227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581ae5b123654b78822566d97d312f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.486732 15214 tablet_service.cc:1505] Processing CreateTablet for tablet e203aefbbbf5447b9380f94f98e35319 (DEFAULT_TABLE table=default.Table_04907829b7e14fd8af2736fe08a49e6f [id=935b0358d2be4a5493a64c0f1a72f5e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.486912 15214 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e203aefbbbf5447b9380f94f98e35319. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.488111 15223 tablet_service.cc:1505] Processing CreateTablet for tablet e04051505b134c0489cbc73ce4dc3e2f (DEFAULT_TABLE table=default.Table_b87856fb91a2413b8d1687d56431ef16 [id=124068957d084b00b2e0c68c061f28a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.488292 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e04051505b134c0489cbc73ce4dc3e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.488497 15226 tablet_service.cc:1505] Processing CreateTablet for tablet 588db918e8e440bdad7760e2968a15ba (DEFAULT_TABLE table=default.Table_83c9d2e0ee66486bb2da7d98664ca406 [id=321b596b7ce44599a5136e0b1fa6886f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.488644 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e08efb3c79041ae97ae37e289ccc8f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.488945 16280 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_070334199e524a3ab6f7cf59e619d05c" } new_table_name: "default.Table_53f8db09b9224cd384f10d38cb65d07a" modify_external_catalogs: true
I20251025 08:02:35.486270 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 9754d7716a574a819bfe31545f577225 (DEFAULT_TABLE table=default.Table_42835d781d0b4b6fa5d1bc0662ffa85d [id=4a39f1c22e3540b09477279222318a3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.490537 16281 catalog_manager.cc:5936] T 00000000000000000000000000000000 P 94a96657c5fd49398b88e9ad615bfe1e: Sending DeleteTablet for 3 replicas of tablet e66c7b43490a4391a59e09f1832a53b3
I20251025 08:02:35.490929 15213 tablet_service.cc:1505] Processing CreateTablet for tablet 49d8b65885dd47d7b176295cf5b647b2 (DEFAULT_TABLE table=default.Table_089d1f21fd52485da83680d50e16774a [id=624062b2458e4860958430113086b03a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.491442 15224 tablet_service.cc:1505] Processing CreateTablet for tablet 345404470a4c4c5c936e22cc998ad516 (DEFAULT_TABLE table=default.Table_232f967839b94b3195b2b9b849c36b55 [id=56510f4b7fa546e7b22c4a8f746e2231]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.491504 15220 tablet_service.cc:1505] Processing CreateTablet for tablet a5b74e3cdd714975969dee9c0881c5fe (DEFAULT_TABLE table=default.Table_754e539219a14fbba92f1f3fe54b0f2e [id=3e1281c3f28346a4a1dd2c4fcc990a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.491780 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9754d7716a574a819bfe31545f577225. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.491796 14949 tablet_service.cc:1505] Processing CreateTablet for tablet 581ae5b123654b78822566d97d312f6e (DEFAULT_TABLE table=default.Table_f4191d1423de42d9b489221fe1e2fb69 [id=adb49ac093344675a9db3e1e5b2a1e13]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.491977 14949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581ae5b123654b78822566d97d312f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.493566 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 588db918e8e440bdad7760e2968a15ba. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:35.494429 15049 leader_election.cc:343] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.494979 14946 tablet_service.cc:1505] Processing CreateTablet for tablet 9754d7716a574a819bfe31545f577225 (DEFAULT_TABLE table=default.Table_42835d781d0b4b6fa5d1bc0662ffa85d [id=4a39f1c22e3540b09477279222318a3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.495173 14946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9754d7716a574a819bfe31545f577225. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.495689 14940 tablet_service.cc:1505] Processing CreateTablet for tablet f334665c1bc3418fb68d23e28c5de309 (DEFAULT_TABLE table=default.Table_5d847a37cb0c456294cb5137046f80bb [id=1f6784494d0b4b98b46077a0af6c2ea8]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.495894 14940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f334665c1bc3418fb68d23e28c5de309. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.495882 16281 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_bcf26fc494eb47ffbdecbeaadcf70015" } new_table_name: "default.Table_6ea13da2d2d74c80a12d5140441b75d2" modify_external_catalogs: true
I20251025 08:02:35.496536 16283 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_fe3d00981835406aaad0dca74b67698a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:35.496830 16283 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fe3d00981835406aaad0dca74b67698a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.498346 17415 raft_consensus.cc:493] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20251025 08:02:35.498420 17415 raft_consensus.cc:515] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.498708 17415 leader_election.cc:290] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.499148 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6cbe1616ced4f47999a6a1365af0092" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" is_pre_election: true
I20251025 08:02:35.499255 15249 raft_consensus.cc:2468] T d6cbe1616ced4f47999a6a1365af0092 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:35.499389 14947 tablet_service.cc:1505] Processing CreateTablet for tablet a7da1dee64144d949a5ebfae28bca8b5 (DEFAULT_TABLE table=default.Table_bede321c044c4ea69863df8a8e0928de [id=88367b91ad094bdebe65659597a113f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.499521 14914 leader_election.cc:304] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.499599 14947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7da1dee64144d949a5ebfae28bca8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.499655 17415 raft_consensus.cc:2804] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20251025 08:02:35.499696 17415 raft_consensus.cc:493] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20251025 08:02:35.499734 17415 raft_consensus.cc:3060] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.500591 17415 raft_consensus.cc:515] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
W20251025 08:02:35.500808 16284 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 581ae5b123654b78822566d97d312f6e consensus state has no leader
I20251025 08:02:35.500883 17415 leader_election.cc:290] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Requested vote from peers e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455), f0f2f8ce3e9f4d9ba3f3f02813397c31 (127.14.70.3:45447)
I20251025 08:02:35.501014 16284 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_2629692fc6534164b8b2c6a9127ad397"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:35.501308 16284 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2629692fc6534164b8b2c6a9127ad397 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.501648 15249 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6cbe1616ced4f47999a6a1365af0092" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31"
I20251025 08:02:35.501732 15249 raft_consensus.cc:3060] T d6cbe1616ced4f47999a6a1365af0092 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.501730 16286 catalog_manager.cc:3527] Servicing AlterTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_e83835c3eaa94f4096bf89a3880ef9c3" } new_table_name: "default.Table_edf9f1623b7a49d3a9cdbf4242da6459" modify_external_catalogs: true
I20251025 08:02:35.501952 16287 catalog_manager.cc:5931] Not sending DeleteTablet requests; no consensus state for tablet cfb02f4c7cfa423487226523fa38b984
I20251025 08:02:35.502621 15249 raft_consensus.cc:2468] T d6cbe1616ced4f47999a6a1365af0092 P f0f2f8ce3e9f4d9ba3f3f02813397c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:35.503054 14914 leader_election.cc:304] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31; no voters:
I20251025 08:02:35.503356 15224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 345404470a4c4c5c936e22cc998ad516. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.503479 15220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5b74e3cdd714975969dee9c0881c5fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.505709 15213 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49d8b65885dd47d7b176295cf5b647b2. 1 dirs total, 0 dirs full, 0 dirs failed
W20251025 08:02:35.506633 16280 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f39a76fab5e843d6a2a963dd9bf627a6 consensus state has no leader
W20251025 08:02:35.507215 16281 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1648f727b0994f01bb6badc92472351c consensus state has no leader
I20251025 08:02:35.508991 15215 tablet_service.cc:1505] Processing CreateTablet for tablet a7da1dee64144d949a5ebfae28bca8b5 (DEFAULT_TABLE table=default.Table_bede321c044c4ea69863df8a8e0928de [id=88367b91ad094bdebe65659597a113f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.509168 15215 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7da1dee64144d949a5ebfae28bca8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.510913 15218 tablet_service.cc:1505] Processing CreateTablet for tablet 25ea9963acac4140ad7d878fc429c090 (DEFAULT_TABLE table=default.Table_f84103a22819458c976f0d1ca4716b47 [id=fe4920e7d4f143388063f22590eb2f64]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.511116 15218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25ea9963acac4140ad7d878fc429c090. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.511586 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet d6243825ae7b4307b5789aaee2473edc (table default.Table_3cb2ab7a99584877a1e8c650a29489db [id=d272aae5be5249ae9f40a67315f3756c]). Expected version 1 got 0
I20251025 08:02:35.511684 16288 catalog_manager.cc:5649] T b1fc8a8cfb73420f81f5b73839d3d3cb P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
I20251025 08:02:35.511897 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 1dacca1fcbad4795835ec08c8bd0dc3c (table default.Table_390e29b52b3f41248a57bda951f2704f [id=438ba3cc67564d1bac9cd6653033546e]). Expected version 1 got 0
I20251025 08:02:35.511974 16288 catalog_manager.cc:5741] TS e51a2be794f04642b89386067ecbc77e (127.14.70.2:37455) does not have the latest schema for tablet 52765e926e904ec9b052db3135cfb77a (table default.Table_e91151e2cc6a437b99b47d5694fa6e80 [id=6716c87cf323485893ce723e76924979]). Expected version 1 got 0
I20251025 08:02:35.512048 16288 catalog_manager.cc:5649] T f1c15457dfac48e3a33de5a9c3d6f1f1 P e51a2be794f04642b89386067ecbc77e reported cstate change: term changed from 0 to 1, leader changed from <none> to e51a2be794f04642b89386067ecbc77e (127.14.70.2). New cstate: current_term: 1 leader_uuid: "e51a2be794f04642b89386067ecbc77e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } health_report { overall_health: UNKNOWN } } }
W20251025 08:02:35.513290 16286 catalog_manager.cc:5909] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e7afc74e7c734c2aaed031b809e9dd14 has no consensus state
I20251025 08:02:35.513633 16280 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_f8add13b20594dd3805bd39c32fd84ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:35.513875 16280 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8add13b20594dd3805bd39c32fd84ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.514288 17731 raft_consensus.cc:2804] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 FOLLOWER]: Leader election won for term 1
I20251025 08:02:35.514365 17731 raft_consensus.cc:697] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [term 1 LEADER]: Becoming Leader. State: Replica: ab02c9d78a9d42f193755d436c8d44b2, State: Running, Role: LEADER
I20251025 08:02:35.514464 17731 consensus_queue.cc:237] T d6cbe1616ced4f47999a6a1365af0092 P ab02c9d78a9d42f193755d436c8d44b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ab02c9d78a9d42f193755d436c8d44b2" member_type: VOTER last_known_addr { host: "127.14.70.1" port: 35401 } } peers { permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 } } peers { permanent_uuid: "f0f2f8ce3e9f4d9ba3f3f02813397c31" member_type: VOTER last_known_addr { host: "127.14.70.3" port: 45447 } }
I20251025 08:02:35.514624 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 497152224ddc48c8aa0be0e83f417794 (DEFAULT_TABLE table=default.Table_5a29e7dba4ba43dfbd0c27981080a1ac [id=8611464429b848fbb277f6a03557cd0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.514827 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497152224ddc48c8aa0be0e83f417794. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.516866 14948 tablet_service.cc:1505] Processing CreateTablet for tablet fa8498aa14134865bb66420bd9a291a9 (DEFAULT_TABLE table=default.Table_00a996a12a5947f0968c86f66bcebc23 [id=ffaf1d2d1e8047bc96e2da8e333bbe09]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.517058 14948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8498aa14134865bb66420bd9a291a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.518865 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 140cc7a1ea2149adaacb2d254f84deea (DEFAULT_TABLE table=default.Table_65442dc666594e129611ee817db7b2c0 [id=de277558d55a46519b3c1e18c51f18fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.518919 15226 tablet_service.cc:1505] Processing CreateTablet for tablet bb517f3c7dc545f089eff1fcb4acbce9 (DEFAULT_TABLE table=default.Table_c6f81392e62f401fa4a3ebe3de2eacbb [id=7eda6d3807c042d3a7aecf63ebd73fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.519065 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140cc7a1ea2149adaacb2d254f84deea. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.519096 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb517f3c7dc545f089eff1fcb4acbce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.520723 15212 tablet_service.cc:1505] Processing CreateTablet for tablet 65f28f3dc42d46688c646e8573dc6ee4 (DEFAULT_TABLE table=default.Table_5fe5289f69bd4a458aced0607d8247fa [id=cfa501bfaffb4d95893a0cd10caedcb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.520888 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f28f3dc42d46688c646e8573dc6ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.520895 14950 tablet_service.cc:1505] Processing CreateTablet for tablet bb517f3c7dc545f089eff1fcb4acbce9 (DEFAULT_TABLE table=default.Table_c6f81392e62f401fa4a3ebe3de2eacbb [id=7eda6d3807c042d3a7aecf63ebd73fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.521078 14950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb517f3c7dc545f089eff1fcb4acbce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.522369 14953 tablet_service.cc:1505] Processing CreateTablet for tablet 65f28f3dc42d46688c646e8573dc6ee4 (DEFAULT_TABLE table=default.Table_5fe5289f69bd4a458aced0607d8247fa [id=cfa501bfaffb4d95893a0cd10caedcb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.522543 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f28f3dc42d46688c646e8573dc6ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.524526 15109 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6cbe1616ced4f47999a6a1365af0092" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e" is_pre_election: true
I20251025 08:02:35.524641 15109 raft_consensus.cc:2468] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 0.
I20251025 08:02:35.524624 16286 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_b2d443a3678b4511b0c786c9d1fb3198"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:35.524893 16286 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b2d443a3678b4511b0c786c9d1fb3198 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20251025 08:02:35.525194 15048 leader_election.cc:343] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): Illegal state: must be running to vote when last-logged opid is not known
I20251025 08:02:35.525283 15048 leader_election.cc:304] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e51a2be794f04642b89386067ecbc77e; no voters: ab02c9d78a9d42f193755d436c8d44b2, f0f2f8ce3e9f4d9ba3f3f02813397c31
I20251025 08:02:35.525725 17534 raft_consensus.cc:2749] T 1dacca1fcbad4795835ec08c8bd0dc3c P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20251025 08:02:35.526080 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 588db918e8e440bdad7760e2968a15ba (DEFAULT_TABLE table=default.Table_83c9d2e0ee66486bb2da7d98664ca406 [id=321b596b7ce44599a5136e0b1fa6886f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.526304 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 588db918e8e440bdad7760e2968a15ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.526376 15107 tablet_service.cc:1911] Received RequestConsensusVote() RPC: tablet_id: "d6cbe1616ced4f47999a6a1365af0092" candidate_uuid: "ab02c9d78a9d42f193755d436c8d44b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e51a2be794f04642b89386067ecbc77e"
I20251025 08:02:35.526468 15107 raft_consensus.cc:3060] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e [term 0 FOLLOWER]: Advancing to term 1
I20251025 08:02:35.527405 15107 raft_consensus.cc:2468] T d6cbe1616ced4f47999a6a1365af0092 P e51a2be794f04642b89386067ecbc77e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab02c9d78a9d42f193755d436c8d44b2 in term 1.
I20251025 08:02:35.527544 15079 tablet_service.cc:1505] Processing CreateTablet for tablet 9754d7716a574a819bfe31545f577225 (DEFAULT_TABLE table=default.Table_42835d781d0b4b6fa5d1bc0662ffa85d [id=4a39f1c22e3540b09477279222318a3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.527729 15079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9754d7716a574a819bfe31545f577225. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.528247 15088 tablet_service.cc:1505] Processing CreateTablet for tablet 265348993cd5454db519ed47a0fdc94a (DEFAULT_TABLE table=default.Table_55080d399c634dd5a1e0c536a7d09394 [id=f7fb9bb3d29a4162888939ba3adda98e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.528434 15088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265348993cd5454db519ed47a0fdc94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.529191 15091 tablet_service.cc:1552] Processing DeleteTablet for tablet e66c7b43490a4391a59e09f1832a53b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:35 UTC) from {username='slave'} at 127.0.0.1:47284
I20251025 08:02:35.529395 15091 tablet_service.cc:1505] Processing CreateTablet for tablet 7346d6acee3a433389c09e7325e2b074 (DEFAULT_TABLE table=default.Table_61a6db44e7c34f1db7cf3ed9aba4d411 [id=f55b9905fb504801b1daffd988a4444a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.529486 15079 tablet_service.cc:1505] Processing CreateTablet for tablet 584ba15c80264af8a513ad6dd500ed79 (DEFAULT_TABLE table=default.Table_537aa6710d7f492199d5a5848140311b [id=957671980ad34abea56599da8a5745d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.529574 15091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7346d6acee3a433389c09e7325e2b074. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.529764 15076 tablet_service.cc:1505] Processing CreateTablet for tablet 581ae5b123654b78822566d97d312f6e (DEFAULT_TABLE table=default.Table_f4191d1423de42d9b489221fe1e2fb69 [id=adb49ac093344675a9db3e1e5b2a1e13]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.529968 15076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 581ae5b123654b78822566d97d312f6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.530069 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 584ba15c80264af8a513ad6dd500ed79 (DEFAULT_TABLE table=default.Table_537aa6710d7f492199d5a5848140311b [id=957671980ad34abea56599da8a5745d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.530297 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584ba15c80264af8a513ad6dd500ed79. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.532775 15078 tablet_service.cc:1505] Processing CreateTablet for tablet 6e08efb3c79041ae97ae37e289ccc8f4 (DEFAULT_TABLE table=default.Table_96c726b8fcd341f2895079b79f53cf7c [id=72243e33e90940c09953a9ec2fcfd435]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.532969 15078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e08efb3c79041ae97ae37e289ccc8f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.533069 16281 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_bb335e59db954b25b377adaaf49d0e47" } modify_external_catalogs: true
I20251025 08:02:35.533154 16281 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_bb335e59db954b25b377adaaf49d0e47" } modify_external_catalogs: true
I20251025 08:02:35.533875 16283 catalog_manager.cc:2507] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_3d5f1adc46e8481386de4051dd453445" } modify_external_catalogs: true
I20251025 08:02:35.533984 16283 catalog_manager.cc:2755] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39708:
table { table_name: "default.Table_3d5f1adc46e8481386de4051dd453445" } modify_external_catalogs: true
I20251025 08:02:35.534394 15086 tablet_service.cc:1505] Processing CreateTablet for tablet e203aefbbbf5447b9380f94f98e35319 (DEFAULT_TABLE table=default.Table_04907829b7e14fd8af2736fe08a49e6f [id=935b0358d2be4a5493a64c0f1a72f5e2]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.534580 15086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e203aefbbbf5447b9380f94f98e35319. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.534775 14952 tablet_service.cc:1505] Processing CreateTablet for tablet 3be3f5f5bcdf492e8ddd9ddb55243c0e (DEFAULT_TABLE table=default.Table_ed7344a27c434dd1bb0d7b1b9e535254 [id=602c150afc1542f2a336a7fd55eee19f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.535022 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be3f5f5bcdf492e8ddd9ddb55243c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.536393 15084 tablet_service.cc:1505] Processing CreateTablet for tablet 497152224ddc48c8aa0be0e83f417794 (DEFAULT_TABLE table=default.Table_5a29e7dba4ba43dfbd0c27981080a1ac [id=8611464429b848fbb277f6a03557cd0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.536587 15084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 497152224ddc48c8aa0be0e83f417794. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.537302 14948 tablet_service.cc:1505] Processing CreateTablet for tablet 265348993cd5454db519ed47a0fdc94a (DEFAULT_TABLE table=default.Table_55080d399c634dd5a1e0c536a7d09394 [id=f7fb9bb3d29a4162888939ba3adda98e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.537407 15226 tablet_service.cc:1505] Processing CreateTablet for tablet 0ce1af769efc47e096cace5227d2adeb (DEFAULT_TABLE table=default.Table_397376f0721d44dda0d0affaf2f33ecc [id=797edabe8a214401b1c2bcb0a54d1807]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.537504 14948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 265348993cd5454db519ed47a0fdc94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.537659 15226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ce1af769efc47e096cace5227d2adeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.538391 15090 tablet_service.cc:1505] Processing CreateTablet for tablet fa8498aa14134865bb66420bd9a291a9 (DEFAULT_TABLE table=default.Table_00a996a12a5947f0968c86f66bcebc23 [id=ffaf1d2d1e8047bc96e2da8e333bbe09]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.538604 15090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8498aa14134865bb66420bd9a291a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.539920 14953 tablet_service.cc:1505] Processing CreateTablet for tablet c5eec1ac0e0b4217b26ec2e7832685a2 (DEFAULT_TABLE table=default.Table_97dcb2270cdf4d21824166c30b3a62a9 [id=d53447a316c5438e86cdac872682b3a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.540163 14959 tablet_service.cc:1505] Processing CreateTablet for tablet 7346d6acee3a433389c09e7325e2b074 (DEFAULT_TABLE table=default.Table_61a6db44e7c34f1db7cf3ed9aba4d411 [id=f55b9905fb504801b1daffd988a4444a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.540378 14955 tablet_service.cc:1505] Processing CreateTablet for tablet 0ce1af769efc47e096cace5227d2adeb (DEFAULT_TABLE table=default.Table_397376f0721d44dda0d0affaf2f33ecc [id=797edabe8a214401b1c2bcb0a54d1807]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.540503 15077 tablet_service.cc:1505] Processing CreateTablet for tablet 140cc7a1ea2149adaacb2d254f84deea (DEFAULT_TABLE table=default.Table_65442dc666594e129611ee817db7b2c0 [id=de277558d55a46519b3c1e18c51f18fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.540716 15077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140cc7a1ea2149adaacb2d254f84deea. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.540879 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5eec1ac0e0b4217b26ec2e7832685a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.542615 15083 tablet_service.cc:1505] Processing CreateTablet for tablet bb517f3c7dc545f089eff1fcb4acbce9 (DEFAULT_TABLE table=default.Table_c6f81392e62f401fa4a3ebe3de2eacbb [id=7eda6d3807c042d3a7aecf63ebd73fae]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.542809 15083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb517f3c7dc545f089eff1fcb4acbce9. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.543120 16279 catalog_manager.cc:2257] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39708:
name: "default.Table_93a435fd15f849ac880d7a4982912805"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20251025 08:02:35.543387 16279 catalog_manager.cc:7011] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_93a435fd15f849ac880d7a4982912805 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20251025 08:02:35.544083 17373 consensus_queue.cc:1048] T 2c614480578945839a6662bafc62726c P f0f2f8ce3e9f4d9ba3f3f02813397c31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e51a2be794f04642b89386067ecbc77e" member_type: VOTER last_known_addr { host: "127.14.70.2" port: 37455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20251025 08:02:35.544633 15217 tablet_service.cc:1505] Processing CreateTablet for tablet dd811643780343589986ef5df7aa80c1 (DEFAULT_TABLE table=default.Table_70fcac50b79d43949a6a412c67f22cf9 [id=57ae396418cb4b249cefbc4cca79c06f]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.544715 15222 tablet_service.cc:1505] Processing CreateTablet for tablet 81efa2a0e62e4e50b6f2a86d000c194d (DEFAULT_TABLE table=default.Table_24a3fc5c42d441fab7d881fb258a0ddb [id=866f01db50274ea29407f759600aff90]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.544839 15217 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd811643780343589986ef5df7aa80c1. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.544900 15223 tablet_service.cc:1505] Processing CreateTablet for tablet 7346d6acee3a433389c09e7325e2b074 (DEFAULT_TABLE table=default.Table_61a6db44e7c34f1db7cf3ed9aba4d411 [id=f55b9905fb504801b1daffd988a4444a]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.544932 15222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81efa2a0e62e4e50b6f2a86d000c194d. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.545083 15223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7346d6acee3a433389c09e7325e2b074. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.545266 15219 tablet_service.cc:1505] Processing CreateTablet for tablet 650ecc7878234aef9ed0bbadaf20a059 (DEFAULT_TABLE table=default.Table_2df0c9f4b493424f84f729bc94fc9470 [id=9ee18f9c5af74fdb8b9fd6c2b95ba9bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.545477 15219 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 650ecc7878234aef9ed0bbadaf20a059. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.546978 15225 tablet_service.cc:1505] Processing CreateTablet for tablet 584ba15c80264af8a513ad6dd500ed79 (DEFAULT_TABLE table=default.Table_537aa6710d7f492199d5a5848140311b [id=957671980ad34abea56599da8a5745d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.547173 15225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 584ba15c80264af8a513ad6dd500ed79. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.547704 15221 tablet_service.cc:1505] Processing CreateTablet for tablet 8308365dc2aa4dc481120522448eb408 (DEFAULT_TABLE table=default.Table_a360cd87c12742a694649f84110e33bf [id=55cb0f00e844437b85efc6915a33e291]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.547937 15221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8308365dc2aa4dc481120522448eb408. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.549717 14958 tablet_service.cc:1505] Processing CreateTablet for tablet a5b74e3cdd714975969dee9c0881c5fe (DEFAULT_TABLE table=default.Table_754e539219a14fbba92f1f3fe54b0f2e [id=3e1281c3f28346a4a1dd2c4fcc990a2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.550069 15216 tablet_service.cc:1505] Processing CreateTablet for tablet 436b734d748e4334922104acefc83aec (DEFAULT_TABLE table=default.Table_221f5dc73cd04df6bab5ce24f8f01509 [id=2a0e4c250c664b12872f6bee8e2ce232]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.550346 15216 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 436b734d748e4334922104acefc83aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.550415 15212 tablet_service.cc:1505] Processing CreateTablet for tablet c5eec1ac0e0b4217b26ec2e7832685a2 (DEFAULT_TABLE table=default.Table_97dcb2270cdf4d21824166c30b3a62a9 [id=d53447a316c5438e86cdac872682b3a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.550632 15212 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5eec1ac0e0b4217b26ec2e7832685a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.552387 15228 tablet_service.cc:1505] Processing CreateTablet for tablet b8af701fff6a47a691d7196f2eb40015 (DEFAULT_TABLE table=default.Table_c7244244ce0f4f91b75edf56ecb49442 [id=c8e216bd3a414a17a768f8ebeb1ab62b]), partition=RANGE (key) PARTITION UNBOUNDED
I20251025 08:02:35.552583 15228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8af701fff6a47a691d7196f2eb40015. 1 dirs total, 0 dirs full, 0 dirs failed
I20251025 08:02:35.554005 15087 tablet_service.cc:1505] Processing CreateTablet for tablet 65f28f3dc42d46688c646e8573dc6ee4 (DEFAULT_TABLE table=default.Table_5fe5289f69bd4a458aced0607d8247fa [id=cfa501bfaffb4d95893a0cd10caedcb4]), partition=RANGE (key) PARTITION UNBOUNDED
W20251025 08:02:35.554116 16270 catalog_manager.cc:4952] TS ab02c9d78a9d42f193755d436c8d44b2 (127.14.70.1:35401): delete failed for tablet 76c31d4c83c740dab40bebd6c8d3f161 because the tablet was not found. No further retry: Not found: Tablet not found: 76c31d4c83c740dab40bebd6c8d3f161
I20251025 08:02:35.554348 14957 tablet_service.cc:1552] Processing DeleteTablet for tablet e66c7b43490a4391a59e09f1832a53b3 with delete_type TABLET_DATA_DELETED (Table deleted at 2025-10-25 08:02:35 UTC) from {username='slave'